The mains ground connection is there as a SAFETY ground, in the event that there is an internal short within the component. Components supplies with 2 prong mains connectors (within the States) are generally certified by UL (or other ETL lab) as passing rigorous testing including the verification of double insulation for transformers and/or switching supplies, and 'creepage' requirements to ensure the minimal possibility of malfunction that would require the grounding of a conductive enclosure to minimize the possibility of electrocuiton.
Certainly, the lifting of a required ground can and often minimizes ground loop induced hum and noise. If you're a hermit and don't live near anyone, its your call as to whether you want to lift that ground for its obvious potential benefits. Think of it as social Darwinism in action.
If you live in proximity to others, consider the tradeoffs -
Minimization of ground loop induced problems
vs.
1. Endangering the lives of small children from electrocution who may poke around your components while holding and possibly spilling their 'sippy' cups full of liquid. Components are are known to fail through no fault of anyone other than the manufacturer, which is why components that haven't been rigorously tested come with 3 prong plugs.
2, Denial of insurance coverage if you're found out, regardless of whether your actions were the causal factor.
3. Possible criminal prosecution for knowingly endangering life, limb and property.
There are techniques for minimizing ground loops that do not compromise required safety grounding of the chassis -
http://db.audioasylum.com/cgi/m.mpl?...rophead&n=8150
http://sound.westhost.com/earthing.htm
FWIW