Posted by
Quote:
Originally Posted by
khaos974 
So why not prove it can be heard in a blind test? With your own equipment, at home, with your friend/significant other swapping the cables with the help of a coin to achieve randomness, and with that person giving you absolutely no cue of the cable being tested.
You can even test the same same several days before swapping. It's a sound approach to the problem since audio exists to be heard and experienced, not to be measured.
Reply by eucariote
X2. If you take 15-20 trials, it will be enough for a robust statistical analysis that avoids type 2 errors (false negatives). If the differences can indeed be discerned on the basis of hearing alone, you should be able to achieve a statistically significant result with ease. Post your results and I'll be happy to provide a T and P value to your test results.
I'll add another X2 to khaos974's post. These simple, in-your-own-environment blind tests, with the help of a friend who does not / cannot tip you, is the way to go. Merchants often let you return, so try lots of things (or sell the losers).
I do A/B "which do you prefer, if either", not A/B/X. (You can also do "same or different?", but I prefer "which do you prefer" for lots of reasons I won't go in to here). And I tell my friend/wife to mix it up, adding in false comparisons. Flip a penny and a dime, Heads=A, Tails = B on both coins. Penny is first sample up, dime is second sample. So I listen to AA, AB. BA. BB with equal probability of one-fourth. The actual statistical analysis is complex, and is muddied by response bias and lack-of-independence between trials.
(The simple Yes/No binomial p values suggested by eucariote will not really be right either, for the same reasons, but it hardly matters).
The formal statistics are not worth doing in these one-subject tests on yourself. One of my professors, head of the department where I got my PhD in statistics, LJ (Jimmy) Savage, once said famously "the best statistical test is interoccular traumatic -- the results hit you between the eyes". And trust me, you won't need 15 or 20 tests. Your friend will know very very quickly whether you can hear any difference reliably between A and B, whether there is any real preference here. And when you look at the results, so will you. I typically tell my friend to stop after six trials (you can always do more if it is inconclusive). And we laugh -- I get it all wrong. Can't tell the $1000 SPDIF cable from the $1.99 Rat Shack yellow video one.