An experiment in lossy vs lossless A/B testing
Feb 8, 2013 at 6:33 PM Thread Starter Post #1 of 51
devhen

devhen

Headphoneus Supremus
Joined
May 16, 2012
Posts
2,282
Likes
100
Everyone is encouraged to join in. Grab the two WAV clips in the next post and use foobar2000's ABX Comparator component to see if you can consistently match them up. Then post your ABX log and your guess as to which file is the lossless copy. Take your time, the more tests you can include in your log the better.
 
foobar2000 ABX Comparator component: http://www.foobar2000.org/components/view/foo_abx
 
Feb 8, 2013 at 6:47 PM Post #3 of 51
Excellent, thank you! Taking the plunge! Can you go into more detail about the test?
Quote:
chewy4 said:
A: http://www.mediafire.com/download.php?wodrs539uh534ih
B: http://www.mediafire.com/download.php?yn3fo363trk6kwb
Click to expand...

 
Feb 8, 2013 at 6:49 PM Post #4 of 51
Uh oh mate, they're not volume-matched. Clear difference!
Quote:
chewy4 said:
A: http://www.mediafire.com/download.php?wodrs539uh534ih
B: http://www.mediafire.com/download.php?yn3fo363trk6kwb
Click to expand...

 
Feb 8, 2013 at 6:51 PM Post #5 of 51
Thanks chewy. I've put way too much time into this crap already today and I have to finish my work now. But I will be putting significant time and effort into this over this weekend and I'll be watching this thread. Thanks again for the files. Looking forward to the experimenting.
 
Feb 8, 2013 at 6:53 PM Post #7 of 51
A has track gain of -8.28 in its replaygain tag, but B has no such info. Maybe I should just strip the RG tag?
Quote:
chewy4 said:
Huh? They are on my end. -8.99dB gain for both.
Click to expand...

 
Feb 8, 2013 at 6:59 PM Post #9 of 51
I don't use ReplayGain and when I run the foobar ABX component I don't check the ReplayGain checkbox, will that suffice?
 
Feb 8, 2013 at 7:02 PM Post #10 of 51
Quote:
devhen said:
I don't use ReplayGain and when I run the foobar ABX component I don't check the ReplayGain checkbox, will that suffice?
Click to expand...

Yeah for these it should. I would be worried about it messing up if you did have it checked since apparently the gain is different when calculated by foobar, and it might just grab the gain from the tag for the one file and use foobar's calculation for the other. But the new A that I just uploaded should be fine either way.
 
Feb 8, 2013 at 7:23 PM Post #15 of 51
Wowwwwww hard test! Did 7 trials. Probably not enough but my head was bogglin'. Let me know if I should do more (later). Also, I hid the results as I was doing it.
 
 
foo_abx 1.3.4 report
foobar2000 v1.1.18
2013/02/08 18:58:46
 
File A: C:\Users\AP\Downloads\A1.wav
File B: C:\Users\AP\Downloads\B1.wav
 
18:58:46 : Test started.
19:11:49 : 01/01  50.0%
19:14:00 : 01/02  75.0%
19:15:18 : 02/03  50.0%
19:15:56 : 03/04  31.3%
19:16:57 : 04/05  18.8%
19:18:23 : 04/06  34.4%
19:21:00 : 05/07  22.7%
19:21:07 : Test finished.
 
 ---------- 
Total: 5/7 (22.7%)
 
 
You must log in or register to reply here.

Users who are viewing this thread

Total: 3 (members: 0, guests: 3)
Back
Top