So there is nothing stopping debris from entering the drivers?
That shouldn't be the case, unless they sold you a faulty(or in this case, a pair with missing parts) IEMs.
The filter system on SE line is different from that of Etys. I don't think Shure will recommend that you pull out the filter. The filters in them are semi-permanent for the average user.