ABX Reliability - Page 2

Quote:

Originally Posted by Slaughter 

Can someone provide some real information on how ABX proves anything related to making selections in purchasing A/V equipment?

Well, if you still want to argue that it's a flawed test for differentiating between audible differences, the least it could do is prove that the differences are frighteningly subtle and not worth the money for some.

The Seiveking test to me shows that if you make a huge effort, suspend any enjoyment in what you are doing and concentrate like hell, you may see a difference. But what is the point in that? It has proved that there may be tiny differences that really do not matter and are actually counterproductive because you no longer get any enjoyment out of looking at nice colours.

Originally Posted by Slaughter 

Eucariote - Yes, it was a good example of perception, but again, it proves that our memory sucks. And this is this is the basis for a scientific experiment? If you are strictly testing memory duration of the human brain, then ABX might be useful.

 

Can someone provide some real information on how ABX proves anything related to making selections in purchasing A/V equipment?

Well, for starters, a cable ABX test presents a situation that makes hearing audible differences as easy as possible - in other words, it minimizes those so-called issues with "memory", by minimizing the time spent between listening to two different samples. If you can't manage it then, what does that say about the odds of you hearing any differences in less controlled circumstances? Yes, it's a good way to maximize ROI - that's kind of the point, in fact. To not spend money on things to don't make a difference, so you can spend the money on things that do.

Here is another argument against ABX testing. It is a genius argument. It says that because so many ABX tests result in no difference being heard in the sound, then the tests are invalid because there is a difference in the sound. I use the same argument every time something or someone proves me wrong. I say that I am not wrong and the proof must instead be wrong. That way I am always right, even when I am wrong........

http://www.avguide.com/forums/blind-listening-tests-are-flawed-editorial?page=2

Quote:

Originally Posted by Prog Rock Man 

Here is another argument against ABX testing. It is a genius argument. It says that because so many ABX tests result in no difference being heard in the sound, then the tests are invalid because there is a difference in the sound. I use the same argument every time something or someone proves me wrong. I say that I am not wrong and the proof must instead be wrong. That way I am always right, even when I am wrong........

 

http://www.avguide.com/forums/blind-listening-tests-are-flawed-editorial?page=2

I believe this defense is worth double points in high school debate contests.

Quote:

Originally Posted by Prog Rock Man 

Here is another argument against ABX testing. It is a genius argument. It says that because so many ABX tests result in no difference being heard in the sound, then the tests are invalid because there is a difference in the sound. I use the same argument every time something or someone proves me wrong. I say that I am not wrong and the proof must instead be wrong. That way I am always right, even when I am wrong........

 

http://www.avguide.com/forums/blind-listening-tests-are-flawed-editorial?page=2

I think the OP's argument is pretty similar to this and does make sense.

If a testing method only gives you ONE result even when measured differences are entered like the picture test, maybe it's time to think about how the testing method may not lend itself to  honest results given you are testing the persons short term memory in a highly confusing scenario and not the actual equipment. If all you get is null results and you really can't do anything with those results what is the point?

If I buy a cable, and it sounds better in my system, in an ABX test I get a null result, but yet I put the cable back in my system and hear the same positive results I heard before the ABX test what am I supposed to do with the null results? Am I supposed to then buy cheaper cable, notice the downgrade in sound and then just deal with it because ABX almost always just produces null results? If my perception of improved sound in my system happens before and after the ABX and is persistent there after how is that placebo and if it is do I care?

So we have a test that just produces null results, and  with those results we still aren't going to do anything with them. So what is the point again?

Seems more like a parlor trick to me, hey look even when measured differences show up in the test you still can't pick it out and get it right woo hoo.
 

Swanlee, I think that the answer is to say you preferred cable 2 to cable 1 because it looks nicer and gives you a nicer feeling about your kit. If you only get that nicer feeling by buying more expensive or a specific brand, fine. Just don't say it sounds better than other cables and try to use pseudoscience evidence to back that up. (When I say you I am not saying you do that, my answer is more of a general you than specific to you).

I am convinced that my DIY cables are the best in the world, they give me enormous pride and satisfaction. I love showing them off. They sound no different to any other cable I have owned.

Quote:

Originally Posted by Prog Rock Man 

Swanlee, I think that the answer is to say you preferred cable 2 to cable 1 because it looks nicer and gives you a nicer feeling about your kit. If you only get that nicer feeling by buying more expensive or a specific brand, fine. Just don't say it sounds better than other cables and try to use pseudoscience evidence to back that up. (When I say you I am not saying you do that, my answer is more of a general you than specific to you).

 

I am convinced that my DIY cables are the best in the world, they give me enormous pride and satisfaction. I love showing them off. They sound no different to any other cable I have owned.

Great but the ABX still had zero value and in the end was a waste of time as I obviously am not going to swap cables to ones I DON'T like the sound of in my home just because of some ABX test.  I have also switched out equipment and cables with less expensive and uglier choices that in my setup sounded better. Not all of us  upgrade with more expensive prettier equipment some times a better made cheaper product will sound better but in an ABX test I'd get a null result which would have no bearing on my decision.

If I always get null results and those null results have no impact on my decision it is a waste of time.

Heck just look at my sig I recently replaced my 300$ zune and 300$ xm5 amp with an SFLO:2 that only cost 150$ and has a much less pretty interface. I did this because it sounded better right off that bat, I'm sure I'd get null results in an ABX test, but do I care? Nope it would not provide me with anything worthwhile.
 

Swanlee, why do you think some cables sound better than others? 

I use the technique for a living and believe me there are positive results.  Pick up any scientific journal - almost all empirical studies use dbt and a form of abx- and most studies got published because they found a significant effect.  The journal I linked before, for example, contains at least a dozen statistically significant abx human sensory discrimination results per issue.

Consistent negative results are universally interpreted as a lack of effect, because the drug/cable/whatever doesn't work.   And the nice thing about the technique is that it is objective and so the results are repeatable when the tests are done again.  

Quote:

Originally Posted by swanlee 

 

 

 

I think the OP's argument is pretty similar to this and does make sense.

 

If a testing method only gives you ONE result even when measured differences are entered like the picture test, maybe it's time to think about how the testing method may not lend itself to  honest results given you are testing the  person short term memory and not the actual equipment. If all you get is null results and you really can't do anything with those results what is the point?

 

If I buy a cable, and it sounds better in my system, in an ABX test I get a null result,  but yet I put the cable back  in my system and hear the same positive results I heard before the ABX test what am I supposed to do with the null results? Am I  supposed to then buy cheaper cable, notice the downgrade in sound and then just deal with it because ABX almost always just produces null results? If my perception of improved sound in my system happens before and after the ABX  and is persistent there after how is that placebo and if it is do I care?

 

So we have a test that just produces null results, and  with those results we still aren't going to do anything with them. So what is the point again?
 

Quote:

Originally Posted by Slaughter 

Eucariote - Yes, it was a good example of perception, but again, it proves that our memory sucks. And this is this is the basis for a scientific experiment? If you are strictly testing memory duration of the human brain, then ABX might be useful.

Okay, I can't help myself.    Are you really now saying that someone can't pick out differences between two televisions when looking back and forth because memory is too faulty?

Short term memory might have a hard time with this one (10-15 secs), but sensory memory (under 2 secs) is almost as good as the original image/sound.

http://en.wikipedia.org/wiki/Sensory_memory