When I saw the Tidal listening test, I was really annoyed by the poor reporting of results (i.e. the lack of stats).
I went and built an 'alternative' test which uses an ABX-style format to test *exactly the same samples*.
You can do the test here: http://abx.digitalfeed.net
You can choose to do 5, 10, or 20 trials of each track, and if you do 10 or 20 trials it will give you per-track results as well as overall results (as p < .01, p < .05, etc. I haven't included specific p value display).
There can be a bit of glitching when switching between A, B and X. Unfortunately thats just a limitation of the Web Audio API (or the way I'm using it). It's worth reading the instructions - there are hotkeys for everything so you don't need to be clicking buttons with your mouse (and so can have your eyes closed and concentrate)
I just knocked this up over a couple of evenings, so feedback would be awesome.
Also, FF and Chrome only. Sorry, Web Audio API support isn't good enough in other browsers.
As I said, these are the same samples so if they were out of sync on the original test they will be on here too. I would love to re-create the samples to avoid that, but I don't know what encoders they used. Depending on how people like this test, I'll probably make a different version which uses files I've encoded to known parameters.
Finally: if anyone has a good article on Signal Detection Theory and how to use it for ABX, let me know. I'm using basic frequentist statistics at the moment because I can't find my old lecture notes on SDT.
Disclosure: I'm using google analytics and putting final results in the URL so I can see how people are doing overall, but that's all the logging I do.