It depends on the type and power of the amp. For a 15W SS amp, there's no true need for it, and yes, it would probably degrade the sound. For a 100W SS amp, you'd probably blow the cans without it. For a ~30W tube amp, the box is there to protect the amp more than the headphones. (All in gross generalities, but that's the idea).