Quote:
You say that to make a proper comparison you must first "level the playing field", but it looks pretty level to me. It almost sounds to me like you're going to take away from one player and add to the other, until they are almost equal and then compare them. Are you really going to cripple one player until it's comparable to one that was inferior, just so it's "fair"? That you need to turn off EQ on both, even though EQ is an essential component of the sound. IMO, this is nothing like how fast a car speeds up compared to the smell of the leather; EQ and raw sound are much more relevant to each other than that. I see your points, but the one thing that bothers me is that you're rating one player less than another because it sounds better without EQ. What is a player is better because of the EQ?
It's long been an established standard to measure audio equipment with the EQ, tone controls, etc. set to "off". That way you're measuring the true performance of the equipment, rather than how the EQ colors the sound. And with some players, there are almost an infinite number of different possible EQ settings, so it's impossible to evaluate them all in any meaningful way.
Comparing portable players with the EQ turned on would be like comparing digital cameras with the special visual effects turned on. You'd have no idea how good of normal pictures the camera can take, and because the effects differ from camera to camera, you couldn't even compare (with words at least) say the poster effect on a Canon to the poster effect on a Nikon. What good is that?
And it's also not practical to record hundreds of sample sound files from each player for users to listen to the various EQ settings so they can decide for themselves. The recordings, to not degrade the sound, would have to be very high quality so they'd collectively be huge. And then there's still the issue of all the different hardware people would *listen* to the recorded samples on and what EQ they had enabled on the playback end. So they might be trying to evaluate EQ on top of EQ. See the problem?
As I said several posts earlier in this thread, if you want to rate players based on the sound of their EQ, that's a very *subjective* criteria and we're back to tasting wine or the smell of leather. One man's pleasure is another man's poison.
I also acknowledged previously that Cowon, for example, has more EQ options than many players. And that may well be part of the reason they get good ratings for sound quality. So I'm not trying to ignore the issue.
Those who master and mix music typically use as accurate of monitor speakers or headphones as they can justify for exactly the same reasons. They don't crank in a bunch of EQ into their monitoring rig--even if they personally like lots of EQ--because they have no idea if whoever listens to their material will have similar EQ. It's highly unlikely they won't. So their music would end up sounding way different than intended virtually everywhere but in their own studio. So most master their music to some known reference not a system tweaked with their own personal EQ bias.
As Anomaly2 and others have correctly said, the only fair way to objectively compare the *accuracy* of various players--i.e. how true they are to the original source material--is with the EQ turned off. So that's how it's done. That way you're comparing Apples with Apples. There is no handicap. There is no unfair advantage. There is no subjective sound altering EQ that one may find pleasant and another horrible. There's just the source material with whatever unavoidable distortions the player has.
If you want to bring EQ into the picture, you turn this entire discussion from being objective--i.e. hard numbers that are easily compared--to being almost entirely subjective--i.e. what kind of EQ JUST ONE person prefers. Which is more useful to a third party looking for information on which player to buy? They have no idea if they have the same tastes in EQ as the person writing the review. But they can easily compare how Player A starts rolling off below 50 hz and is missing the really deep bass entirely compared to Player B that's virtually flat to 20hz. Or they can compare distortion levels (which are typically degraded with EQ turned on), etc.