Believe me, coming from someone who
has damaged his hearing through excessive noise levels - better safe than sorry. The ridicule you get is temporary, but the hearing damage is permanent. Don't **** it up. If I had the option to rewind time and get myself to stop my insane antics earlier on in life, I wouldn't hesitate to do so, but it's too late now.
Still, if you're that worried, I'd suggest you get a decibel meter and check out a lot of the environments that you're normally worried about, then consult a few hearing damage/volume level charts and see if you're in any danger. 85dB may seem high, but you're only at reasonable risk if you're exposed to it for 8 hours or more, so you probably will find that you don't
have to wear hearing protection in quite as many situations.
I use my ES2 for earplug purposes in a lot of locations now, whether they be bars or clubs or just general gatherings where a lot of loud music is present. But, when there is no hearing danger, I prefer not to wear them due to the anti-social aspect of it.
Also, invest in custom-molded earplugs. They're
much more comfortable. I'd say invest in custom-molded IEMs too, as they sound
much better than universal-fit ones as well, but that's just the evil head-fi'er in me talking