Quote:
Originally Posted by Ed Seedhouse 
....And is thus largely worthless since it has no controls. Scientific evidence, on the other hand, requires proper controls.
....
Only if you entirely misunderstand the scientific method. Most of scientific investigation involves the careful and painstaking analysis of observations made with very careful controls. The "empirical" observations you refer to have no controls whatsoever.
....
And since they are entirely uncontroled observations they are not useful evidence at all.
....
The "evidence" you refer to is not really "evidence". "Evidence" like that would also lead us to the belief in flying saucers, ghosts, and faeries. All of the latter have just as much good reliable evidence for them as "burn in', namely none.
|
Ed,
It seems to me that the core of the disagreement here is in defining what constitutes "useful" evidence of burn-in (or lack thereof).
As a general matter, I think we can all agree that naked eye (or in this case, naked ear) observations constitute empirical evidence. For example: even absent a ruler, we should all be able to agree that an ipod mini is smaller than an ipod classic based solely on visual observation. But with respect to listening impressions and the burn in debate, certain questions remain: (1) is the evidence direct/indirect; (2) as qualitative data, is it trustworthy; and (3) what conclusions does the evidence entail (or merely, possibly support?).
I will also note that from a legal standpoint, such user testimony undoubtedly constitutes "competent evidence" in the sense that it is descriptive of the personal experience of the witness. Although indirect, I think it would clearly be "relevant" with respect to burn-in. Whether or not it is persuasive is a separate matter.
From the above quote, you seem to be indicating that you object to treating even a large sample of user impressions as scientific evidence, based on lack of controls, and I assume, the non-quantifiable nature of the data? Does this mean you reject the scientific value of all qualitative surveys - or do you simply disagree with the conclusion?
I think the truth of the matter is that there is some evidence (albeit indirect) on both sides - and there is just a sharp schism as to which evidence we tend to find convincing.
You have cited, as "relevant" evidence against burn-in, articles addressing the minimal measurable results of burning in
certain speakers. The IE8 burn-in advocates (myself included) reject the value of your evidence because the articles did not test or address the IE8's specifically. (And I would imagine that you concede different transducers could conceivably change at different rates and/or magnitudes over time - although you would deny that these changes, however small, would have any real impact on sound quality.)
By contrast, the burn-in crowd believes that their observational evidence is relevant because they/I believe the perceived change in sound likely results from subtle changes in the hardware (rather than in perception of the hardware). Critical to this interpretation of the observational evidence is the fact that most of us who have listened to the IE8's disliked them out of the box, set them aside, and perceived change many hours later. (Akin to eating a familiar dish in a restaurant that tastes different on a subsequent visit.) For me at least, it seems hard to believe that we somehow adjusted to the sound on a subjective level despite the fact that we were not actually acclimating over any duration of time. Rather, the change was perceived after hours and hours of non-listening.
So it boils down to a simple judgment call. What is the logical presumption in light of the aforementioned imperfect evidence? Are we allowed to accept a philosophy whereby inductive arguments and indirect evidence have value resulting in an opinion on the matter? Or are we forced to adopt burn-in agnosticism until measurable results confirm or deny a theory?