Are blind tests bogus? Examples of blind tests with positive results.
Oct 9, 2010 at 4:58 AM Post #16 of 30
Thanks for that BlackbeardBen. That a $700 amp, which is pretty expensive in my book can sound the same as a far more expensive one shows diminishing returns and issues over the conducting of blind tests.
 
May 16, 2012 at 5:41 AM Post #18 of 30
Thanks for the thread.
 
 
I don't think blind tests involve trickery or deception very often, but they do encounter statistical error or come to some weird conclusions.
 
I think when looking for subtle differences clearly you need to know what to look for, sometimes only 1 in 10 people or less are capable of scoring a positive result, yet they are lost in the pool of data and it's overlooked as chance. 
 
Looking for striking differences (like speakers) is easier and there are less factors to consider, right?  Also, speakers are at the very end of the chain, which helps.  With other components we have to listen to them with speakers, so the speaker or IEM used can influence the result.  To me that's very clear from my experience with IEM's, that some are more transparent than others, some - even expensive models - will tend to sound 'the same' irrespective to source, which is a positive or negative depending on how you look at it.
 
I think the rapid-switching time aligned ABX technique may possibly have some errors too, in how the human mind perceives that switching, so I'd prefer to see more tests with a 6 second pause between excerpts, or non time aligned, etc.
 
The listener should notice which technique they're more sensitive to and be able to choose, if the tests forces a time aligned 0.1 second or less switch then it's imposing unnatural conditions on the listener.  I believe that volume and FR changes are much easier to pick up in 0.1 second switching but that doesn't mean all sounds are across the board, considering how the mind works.
 
Just as an example, if you can identify someones voice on the phone, would it be easier to identify a very similar voice with ABX, like their twin?  Or do you think, if you listened hours apart, your sonic memory would pick up the very subtle differences in their voices equally well either way?
 
May 26, 2012 at 10:58 AM Post #19 of 30
Quote:
- I do not like the blind tests that have been done where people are told they are listening to different cables, but in fact there has been no change. It is interesting, but again a bit dubious when something like a wire coat hanger is slipped into a cable test without anyone's knowledge.

How does it even matter ?
IF there is in fact a difference 'like night and day, a veil fell from my ears ..etc etc'
they should hear the difference anyway, shouldn't they ?
And if there ISN'T a difference, they should also hear that !
 
It is no more deceptive than how our hearing works .
You could do a AB-test with two identical wires but tell the subjects that 'A' is a coat-hanger and a portion of them will magically start to hear the differences !
 
Also, speakers/transducers have no place in this discussion, no objectivist ever claimed they sound the same, clearly they don't .
Incredibly, this is reflected in measurements of speakers ! So, I guess you CAN measure speakers reliably, but electronic devices ?
No, because they posses 'the magical synergy-factor' that you can't measure .
 
 
Regarding the ABX  documentation linked in the OP http://home.provide.net/~djcarlst/abx_pwr.htm
Yes, people CAN reliably distinguish between a 10 watt Valve-amp and a 400 watt transistor-amp !
Therefore we can conclude that all gear sounds different and blindtests showing otherwise are faulty ?
 
May 26, 2012 at 2:11 PM Post #20 of 30
Quote:
I think the rapid-switching time aligned ABX technique may possibly have some errors too, in how the human mind perceives that switching, so I'd prefer to see more tests with a 6 second pause between excerpts, or non time aligned, etc.

 
You can go ahead and use slow switching if you want but it will just give you even more more fails.  The reason rapid switching is preferred is because it gives you the very best chance of discerning differences.  For up to about 200ms humans retain a very precise echo-like auditory memory that stores most of the information your ears actually heard and is far less susceptible to conscious shifting of attention.  Anything after that is heavily influenced by conscious shifting of attention to different parts of the sound as well as unconscious biases and expectation.
 
This picture form Audioskeptic's blog sums it up rather nicely.
 

 
The human brain cannot store or or even process all the data it receives from the senses.  Everything you consciously see or hear has already undergone what amounts to lossy compression in order to reduce the torrent of raw data to something your conscious mind can handle.  When you change your focus and concentrate of another aspect of a sight or sound you're essentially messing with the compression settings and changing which data is discarded.  If you listen to one part of the sound you can't listen to the others.
 
Dec 15, 2016 at 11:36 AM Post #22 of 30
The Gadget Show (Channel 5 UK) Series 24, Episode 6, turntables.
 
https://www.my5.tv/the-gadget-show/season-24/episode-6
 
Presenter Jon Bentley is joined by Radio 1 DJ, Adele Roberts as the do a blind listening test to three turntables from Pro-ject (low price) Clearaudio (medium) and Linn (high). Both can tell which is which in terms of sound quality and they agree the Clearaudio (it is a £1000 turntable) is the best buy, the much more expensive Linn is not dramatically better.
 
Dec 15, 2016 at 5:42 PM Post #23 of 30
  The Gadget Show (Channel 5 UK) Series 24, Episode 6, turntables.
 
https://www.my5.tv/the-gadget-show/season-24/episode-6
 
Presenter Jon Bentley is joined by Radio 1 DJ, Adele Roberts as the do a blind listening test to three turntables from Pro-ject (low price) Clearaudio (medium) and Linn (high). Both can tell which is which in terms of sound quality and they agree the Clearaudio (it is a £1000 turntable) is the best buy, the much more expensive Linn is not dramatically better.

 
 
Once again a turntable is a transducer.  I don't think there's much argument that they are the most noticeable difference in the recording->playback chain.  So this test demonstrates a couple of principles that aren't much debated; transducers have the biggest influence by far,  and the law of diminishing returns.
 
Thanks for posting the tests.
 
Dec 17, 2016 at 11:36 AM Post #24 of 30
  The Gadget Show (Channel 5 UK) Series 24, Episode 6, turntables.
 
https://www.my5.tv/the-gadget-show/season-24/episode-6
 
Presenter Jon Bentley is joined by Radio 1 DJ, Adele Roberts as the do a blind listening test to three turntables from Pro-ject (low price) Clearaudio (medium) and Linn (high). Both can tell which is which in terms of sound quality and they agree the Clearaudio (it is a £1000 turntable) is the best buy, the much more expensive Linn is not dramatically better.

 
Well, duh...they're electromechanical transducers, all of which are so flawed (like speakers) as to be easily distinguishable.
 
Jan 25, 2018 at 2:35 PM Post #25 of 30
OP updated, test added and broken links sorted.
 
Jan 28, 2018 at 10:47 AM Post #26 of 30
Re. the Carver Challenge: It strikes me that one needs to take with a large block of rock salt anything printed in a magazine that would allow this nincompoopery to be published: "I had once upon a time picked up the differences between ½" of steel lead from a capacitor to a crossover as opposed to ½" of copper lead—and these two amplifiers had much bigger differences than ½" of wire."

What a line of horse feathers.
 
Jan 28, 2018 at 1:53 PM Post #27 of 30
Did Bob Carver say that?
 
Jan 28, 2018 at 1:57 PM Post #29 of 30
I would take what he says with a lump of salt then.
 
Jun 15, 2021 at 11:05 AM Post #30 of 30
Thread updated, links checked, one broken and a test added. A cable test, which is an apparent pass, with Nordost Valhalla, the most expensive cable, beating cables from Chord, Stereovox, Audience, Siltech and QED.
 

Users who are viewing this thread

Back
Top