Quote:
he is very smart for doing that cause that's what we all should being doing is trusting our own ears. if we can't trust our own ears and rely too much on measuring gear and equipment we will never be able to enjoy the type of sound we like and always will be dissatisfied.
the measuring gear is just as flawed as our own hearing so use the tools we are most accustomed and use to having around the most. our ears. it will achieve much more fluid results that we enjoy overall.
I respectfully disagree, in part because there is so much potential in these little cans that it's easy to be sub-optimal because even sub-optimal they kick ass. But when they are really well setup they are sublime.
Properly setup measuring gear has a very high correlation to what we hear, though it is not perfect because test setups tend to measure variables in isolation. How the integration of time domain, frequency domain, and distortion combine to create the user perception is not well understood, but certainly test gear can find problems most people could never isolate without a technical assist, such as a narrow band resonance or a sharp void. I've seldom seen a change that improves test results that did not improve the sound quality on the phones I have modded (and the number is up to about 30 now).
While our ears should be the ultimate judge, remember that someone like LFF is a professional mixing engineer, and spends his day tweaking aspects of recordings to clean up the mix and achieve a better sound. He can identify a problem with frequency response because he is immersed in the science and art of adjusting specific aspects of a mix to get a certain sound, and has a good idea of what is actually accurate, and which changes create what perceived change in sound.
While I am an audio engineer and a (poor) musician, I can simply not do this as well as he does. But as an engineer I can use technology to compensate, and maybe get an overall solution that is competitive (maybe better, who knows) because I can detect specifics in transient response and distortion that you could not really get a handle on by ear besides judging "fast and clean." But how fast and how clean is VERY hard for most people to gauge. Not to put him on a pedestal, but LFF probably could do this.
Another area that complicates perception-based tuning is that our ears "break in" and start to process the sound of a given headphone as "normal" after a short while. We've probably all experienced that phones sound better with familiarity. Tyll has shown phones do break in, which is no surprise, as I know for sure speakers do. But the user-adaptation makes it probable that many users will rather quickly begin overlook the errors in sound if the overall experience is still OK, and eventually think that a colored sound is accurate.
For example, I've had a few local T50 modders come by and test their mods. Most felt their mods were great and liked the sound (only one felt that he'd missed the mark and wanted to figure out where the problems were). When measured, it became clear that their mods had some major problems like huge bass suckouts, major resonances, no bass below 100Hz, very ragged frequency response, etc, and when fixed they preferred the result.
This happened to me to when I first put mine on a bench to measure. To my chagrin, I found that my "ear" for accuracy had declined a lot in the decade that I'd stopped doing speaker design work. With test gear, I've now been able to retrain myself, and have a strong sense of what is accurate just be ear, but I'm still no LFF, and I've been putting a lot of time on this, as I'm looking to start a commercial venture.
So sorry for the long post on this, but I just wanted to share my POV that ears-only testing may produce a pleasing result, but it may be well short of a great result unless you have truly gifted ears or extensive training, and testing really can matter.
If people want to chime in, it might be worth starting a thread on testing/hearing and tweaking as a separate thread, because this could derail the T50 thread... Testing vs. hearing often gets a bit emotional, and there's no possibility of getting everyone to agree on a definitive approach, but in the end, I think that using your ears and equipment is the only way to get the optimal result for those who aren't LFF-level hearing acuity...