With the filters out, they lose some of the thickness of the overall sound. Some might say it decreases the cohesiveness, but I find that it makes the sound more forward and less spaced-out sounding, yet simultaneously improves dynamics. The stage might lose a bit of width. The bass gains more of a punch, it doesn't have the same softness that it does with the filters. The highs and upper mids are definitely more prevalent, and the highs can be sibilant at times. The mids strike a half-way point between the creamy sound of the filtered SM3 and the raw feel of the original ASG-1s. The extra emphasis in the highs makes them sound much better for strings than the filtered version; I would say this, along with bass impact, are the most immediately improvements. The sound is overall more fatiguing, but also more precise, with better bass impact and less darkness.
For caution, I will say that they definitely lose their smoothness, it won't be the rich sound you are used to by now, and they will be noticeably more fatiguing. For me, it was worth it; might not be for you. If you really like the way they sound, no sense tampering with it. For me, I wanted just that extra bit of bass impact, and it was a bit too dark for some of my psytrance and classical guitar stuff.