Originally Posted by Draca
Should have said 'one's senses' not 'your senses' - wasn't meaning to single you out, have just been seeing this odd resistance to believing DBT results recently which I find quite annoying.
In fact, in re-reading your post, you are actually suggesting believing one's senses over a DBT based on how they are set-up, but I fail to see how the concept of setting up a DBT is difficult or problematic. I know you wish not to go over your reasons again, but would it be possible for you to summarise quickly why you find DBTs flawed?
I don't disbelieve DBT results. Why should I not. Afterall, in this particular context, they are results of a straightforward execution and reading process. What some, including myself would contest here, is whether or not the results provide valid information. Validity is affected by how the DBX test is conducted. Successful blinding is only one condition to satisfy. The other condition is that all other environmental or procedural variables are accounted for and paid attention to. Inattention to all variables will give results, no doubt, but they wouldn't necessarily represent what happens in different circumstances where the variables involved are different. Now when you are of the opinion that the DBT design and execution is questionable, will you then take the results and proceed to conclude that your senses have been playing tricks on you?
Take one example:
I personally hear damning differences between some cables when used with particular cans. I hear more differences between some cables than I do between 256Kbit and lossless files. I hear differences between some cables while I hear none whether or not I use a P-51 Mustang with my IEMs or ATH-ESW9A's. I am therefore suspicious of any scientific data that claims there never being a difference. I've looked at and considered the study designs and execution of DBT's to answer this question and I'm not happy with the DBX tests. I wish not to get into why. The thread I sited has it all there.
OTOH, I'm happy with DBX tests that are used to differentiate encoding formats and bitrates. The DBX test design and execution are VERY different from that for the cables. I therefore trust the results a lot more and willingly accept their validity over that of my senses.
It's not the concept of a DBT that's problematic. What's problematic is the careful consideration of EACH DBT on its own merit, and whether or not its design and execution will lead to results that can be considered valid and true in answering the question being posed.
The problem on this forum and which has resulted in this thread may be illustrated by this:
- a person posts asking about cable A vs cable B
- someone advises cable B
- another posts that one shouldn't bother since cables don't make a difference and demands of the poster recommending cable B, evidence to support his recommendation.
- DBT's are then sited refuting audible differences between cables.
- others chime in to support both claims that cables do or that they do not make a difference.
- some stick to the specific issue and the tests involved.
- unfortunately some begin to generalize and assume that those who have a problem with specific DBT's, have problems with DBT's in general and that they are always blindly trusting their own senses and assuming their senses to be infallible etc. Things break down from there since it's a genuinely ridiculous generalisation with no real basis behind it.
Edited by aimlink - 6/1/10 at 2:04pm