Quote:
Originally Posted by boomana 
Define "better."
|
No need to

The only important measure in hypthesis testing is the distribution of results (here,
choice responses).
Hypothesis testing begins with the assumption that a drug, cable, etc has no effect (the null hypothesis). The positive hypothesis is a statement about how the results will not be random "drug x will lead to reduced mortality rates" or "I can reliably discern between cheap and audiophile cables".
The criterion for rejecting the null hypothesis and accepting the positive hypothesis is just a demonstation of nonrandom results. In the case of cables, the subject can use any criteria, quality, etc. that may be available to their conscious (and as some on this forum stress) nonconscious experience to make choices that demonstrate a real effect.
If the result is nonrandom (p<.05), then the tester can design the next test to elaborate on its reasons "drug x reduces blood pressure", etc.