Cut the blind testing crap
Aug 21, 2011 at 8:16 PM Post #31 of 162


Quote:
To say it won't make a difference functionality, you have to know what you are going to use the stick for.
 
 

 
It still doesn't change anything. And to bring this full circle, the measurements are reality, not perception. Even if I perceive the stick to be smaller, its not. Its really that simple. 
 
 
 
Aug 21, 2011 at 9:14 PM Post #33 of 162


Quote:
 
And to bring this full circle, the measurements are reality, not perception.
 
 




Measurements are parameterized models of reality, not reality. The words we use to describe perception are a kind of model of reality, not reality. You need to study inferential statistics.
 
 
Aug 21, 2011 at 9:43 PM Post #34 of 162
"So you are saying you would happily use a small branch to prop up a bridge, because it measured to the needed length?"
 
Well last time I checked, branches don't change thickness, the "model" of this branch could be 2 feet long by 6 feet in diameter. That 6 foot diameter won't spontaneously change.
 
Aug 21, 2011 at 9:49 PM Post #35 of 162


Quote:
"So you are saying you would happily use a small branch to prop up a bridge, because it measured to the needed length?"
 
Well last time I checked, branches don't change thickness, the "model" of this branch could be 2 feet long by 6 feet in diameter. That 6 foot diameter won't spontaneously change.



You are veering way off the point. The point is that to know if you have an adequate model, you need to know what you are using the item for.
 
 
Aug 21, 2011 at 9:57 PM Post #36 of 162
Audio gear - use, reproducing audio recordings to sound as close to what the sound engineer intended as possible. Now that we've established what we should be using the item for, can we start engineering tests to measure how well it does that?
 
 
Aug 21, 2011 at 10:05 PM Post #37 of 162
 
Quote:
With some luck I'll have dragged a few of the more "sciency" head-fi'ers in with the title for this post.
 
I want to propose a project to the more scientifically inclined crowd on head-fi, the "absolute fidelity index" project, as I'm calling it for now. I'm kind of frustrated that when I'm looking for a new pair of headphones, I need to read highly subjective reviews on what various people think of the sound quality of the headphones, in order to determine which one is probably the best at a given price range. This shouldn't need to be the case, there are objective ways to measure the absolute fidelity of a piece of audio equipment, there is nothing in sound that can't be measured. What I'm proposing, as most of you have probably already guessed, is that we objectively measure, with a percentage, how close the electrical impulses or sound waves produced by a piece of audio gear are. I'd like a few people to respond agreeing that they'd be interested in participating before I type out the full description of how we'd be doing this. Anybody have some good meters and the time to figure out how close the sound reproduced by a pair of cans replicates the electrical impulses from an amp?


Feel free to direct me to an inner-ear microphone and equipment that can measure every aspect of sound, because AFAIK nothing of the sort exists and probably won't for several more decades.
 
 
 
Aug 21, 2011 at 10:18 PM Post #38 of 162


Quote:
 

Feel free to direct me to an inner-ear microphone and equipment that can measure every aspect of sound, because AFAIK nothing of the sort exists and probably won't for several more decades.
 
 


When I say that everything can be measured, I mean that there is no magical "energy" produced by a transducer. Its all compressions and rarefactions in the air which are tangible, measurable, things. There is no black magic behind soundstage or clarity or coloration, all of it is derived from the waveform produced by the driver. Audio equipment can be very, very, accurately objectively described if you have decent gear and you know how to compensate for the distortion introduced by your testing gear. But yes, your right, there probably is no in ear mic right now that can get a good enough recording that you can carefully break down the recording, analyze it, and supply an objective description of the sound of the headphones. 
 
 
Aug 21, 2011 at 10:38 PM Post #40 of 162
Measurements are parameterized models of reality, not reality. The words we use to describe perception are a kind of model of reality, not reality. You need to study inferential statistics.
 


This is still wrong. even though measurements are used to parameterize models, they are not themselves the model. You can argue that the model is mistaken, or poorly applied, but that doesn't change the fact that the wavelength of yellow light measures 570–590 nm or that the standard concert A measure 440 Hz.

I have studied inferential stats and done both stochastic and deterministic community ecological models, btw. The main influence a model has on measurements is that what you think is true about a system will lead you to measure somethings and not others. You can be very wrong about what you've chosen as an accurate or complete model. And if you're arguing that people are looking at the wrong thing when considering audio equipment, fine. But then leave off about measurement itself being flawed.
 
Aug 21, 2011 at 11:15 PM Post #41 of 162


Quote:
Measurements are parameterized models of reality, not reality. The words we use to describe perception are a kind of model of reality, not reality. You need to study inferential statistics.
 


However, in engineering, an end-point analysis is done before the product design is even considered.  For the most part, this is going to go in a couple of different directions depending on the audio preferences involved (tubes vs. ss amps, for example).  However, you would be able to define the parameters for the end-point analysis, saying things like, "I want to design an amp with <0.01% THD because DBTs have determined that it is less than the audible threshold."  At that point the measurement for THD & THD + N becomes a validation of your analyzed end point.
 
Fact is, non-linear and linear distortion make up 99% of what we hear, so performing a THD+N plot and an IMD plot will tell you 99% about the distortion products of the sound.  FR graphs are idealized, however, within the context with which they are built, they tell you a great deal about how a person could perceive the relative levels of the sound.  (Probably better would be to take a page from Nyquist/Lyapunov criterian and perform time-invariate analysis in the S-plane, but that's a different story).
 
In short, we know a great deal about what we need to do to make a product sound good based off of the measurements, because we can logically define those endpoints (based on earlier studies performed).  We actually know a great deal about how/what humans perceive in a sound wave.
 
Aug 22, 2011 at 1:17 AM Post #43 of 162


Quote:
But then leave off about measurement itself being flawed.

Measurement is not "flawed", it's just not reality.
 
People often look at measurements out of context. You have to look at the whole picture to see my point.
 
You say that concert A measures as 440. Once I wrote some software to measure the frequency of a sine wave. It's all models. It's about fitting a model, and in the presence of noise. Maybe the pitch you are measuring is fluctuating, but your answer has to be a single number. Clearly you can see your measurement is a parameterized model, not the full richness of reality. Maybe the harmonics don't line up exactly. As soon as you say, "I measured the pitch as 440" you are talking about your model fit and you have fundamentally shifted from reality to a model.
 
I'm not saying that's bad. But then you have to ask what you are using this model for. Why do you care what the pitch is? Until you answer that, there is no way to say if your model is adequate.
 
 

 
 
 
 
Aug 22, 2011 at 12:40 PM Post #44 of 162
Measurement is not "flawed", it's just not reality.
 
People often look at measurements out of context. You have to look at the whole picture to see my point.
 
You say that concert A measures as 440. Once I wrote some software to measure the frequency of a sine wave. It's all models. It's about fitting a model, and in the presence of noise. Maybe the pitch you are measuring is fluctuating, but your answer has to be a single number. Clearly you can see your measurement is a parameterized model, not the full richness of reality. Maybe the harmonics don't line up exactly. As soon as you say, "I measured the pitch as 440" you are talking about your model fit and you have fundamentally shifted from reality to a model.
 
I'm not saying that's bad. But then you have to ask what you are using this model for. Why do you care what the pitch is? Until you answer that, there is no way to say if your model is adequate.
 
 

 
 
 


If I measure something and it fluctuates, then that has to be part of how I report the measurements. It would be something like " I recorded X for Y minutes at Z intervals. Over that time period the average X was Q units, with a standard deviation of P."

See, not hard at all. There's no reason a measurement is done once or to think there's a single answer. I don't know why you keep insisting about the measurement being a model fit. Take the concert A for example, the definition of that has changed over time. You care what the pitch is so that people play in tune. That's not a model of reality, that's a decision about how to set a consistent reference point. It's 440 now, but it's been different things in the past. That doesn't mean that if you could time travel and measure it, that the earlier ones are wrong, just a difference in the local consensus.

Your exercise of writing a program to measure the frequency of a sine wave is specifically about a model, but I don't get why you don't understand that all measurements aren't.

What is this immeasurable reality you're referring to? Are we having a philosophical difference of opinion? (Which is where these things seem to end up in every thread.)

 
Aug 22, 2011 at 12:54 PM Post #45 of 162


Quote:
If I measure something and it fluctuates, then that has to be part of how I report the measurements. It would be something like " I recorded X for Y minutes at Z intervals. Over that time period the average X was Q units, with a standard deviation of P."
 


Reporting the answer as "average Q" and "standard deviation P" is a model. You use inferential statistics to compute those numbers, and the math involved is a model fit.
 
Measuring the wavelength of one cycle is a model too, because noise, bias, and measurement error will be present. It's not as simple as checking the zero crossings and thinking you've pinned down reality.
 
You don't HAVE to report the fluctuations. It depends on how you plan to USE the measurement. All measurements are in a context---the context of how they are used. A measurement outside a use-context is meaningless.
 
EDIT: I accidentally created some confusing when I said "Maybe you have to give a single number"-- I don't mean you always have to give a single number-- but sometimes you do. For instance, if you are writing software to run a kind of tuner device that musicians use to check their pitch, and the device has a single display, you have to give a single number. If you are programming a police-radar-speed-gun thingy, you have to give a single number.
 
Quote:
See, not hard at all.

 
I didn't say it's hard. I said that measurements are parameterized models.
 
Quote:
Your exercise of writing a program to measure the frequency of a sine wave is specifically about a model, but I don't get why you don't understand that all measurements aren't.

If you made the effort to write a program to measure something, anything at all, I guarantee you that you will find out that you are fitting a model.
 
 

Users who are viewing this thread

Back
Top