The Objectivist Audio Forum
post-4595845
Post #106 of 180

stewtheking

Headphoneus Supremus
Joined
May 6, 2005
Messages
2,671
Reaction score
27
Joined
May 6, 2005
Posts
2,671
Likes
27
Quote:

Originally Posted by Publius /img/forum/go_quote.gif
Tell ya what. Why don't you have the new objectivist forum merely be a link to HydrogenAudio? Everybody who wants to discuss their latest fuse-rolling exploits can still post here. Everybody who wants their audio questions answered correctly can head over there.


It's this kind of ridiculous statement that inflames the argument further. If you don't have something more intelligent to add, why fan the flames of an already rather tense thread?
 
     Share This Post       
post-4595861
Post #107 of 180

digger945

Headphoneus Supremus
Joined
Mar 31, 2008
Messages
2,917
Reaction score
14
Joined
Mar 31, 2008
Posts
2,917
Likes
14
Quote:

Originally Posted by upstateguy /img/forum/go_quote.gif
It seems to me that the scientific approach of accurate measurement and testing should easily override hearsay, opinion and the recollections of dim auditory memory.

USG



I agree!
 
     Share This Post       
post-4595897
Post #108 of 180

Publius

500+ Head-Fier
Joined
Nov 23, 2003
Messages
723
Reaction score
13
Joined
Nov 23, 2003
Posts
723
Likes
13
Sorry, sorry. I couldn't resist.

Still, the question presents itself: there's already a forum out there that does the whole skeptic thing really well. It also prohibits subjective discussion.

There is another forum out there called "Propellerhead Plaza" on Audio Asylum. It allows all manners of discussion. It's also a troll-infested hellhole, and nothing of substance ever gets discussed there nowadays, simply because the bickering is so intense.

I'd argue that for this sort of forum to ever work out at all, the mods are going to have to go down the HA route rather than the AA route. That is, you'll need to set up a different moderation system entirely for that one forum. Otherwise bigshot's fears will be mostly realized.
 
     Share This Post       
post-4595927
Post #109 of 180

upstateguy

Headphoneus Supremus
Joined
Dec 20, 2004
Messages
4,067
Reaction score
161
Joined
Dec 20, 2004
Posts
4,067
Likes
161
Hey Guys

I would like to make a suggestion.

Try not to answer the trolls at all.

You know who they are and the futility of engaging them.

You are but one, and the cyber-bullies are many.

My advice is to Ignore Them.

USG
 
     Share This Post       
post-4595977
Post #110 of 180

MD1032

Headphoneus Supremus
Joined
Aug 10, 2003
Messages
5,977
Reaction score
17
Joined
Aug 10, 2003
Posts
5,977
Likes
17
Statement withdrawn.
 
     Share This Post       
post-4596713
Post #111 of 180

acidbasement

1000+ Head-Fier
Joined
Jan 29, 2007
Messages
1,292
Reaction score
16
Joined
Jan 29, 2007
Posts
1,292
Likes
16
Quote:

Originally Posted by JadeEast /img/forum/go_quote.gif
I really liked this post and would love if you could expand on this particular statement. I am wondering if you are speaking about Popper's falsification.


Yes, I was referring to falsification. Falsifiability - Wikipedia, the free encyclopedia

In the context of this discussion, one cannot prove by performing blind tests that two pieces of equipment are functionally identical. The closest thing would be to show that there is no statistically significant difference between actual blind test results and random or uniform results. If there is only a small group of people taking part in the blind test (a likely scenario at most audio meets given the niche/cult nature of the hobby), statistical power - our ability to detect a significant difference between actual test results and random/uniform results - may very well be too low to make a negative result meaningful in the slightest. For this reason, I would not trust anyone who tried to quash my curiosity about a product by simply citing a DBT, especially if they didn't know any details about the DBT aside from the result.

Now this has me thinking. Would anyone who is stats-inclined (wavoman perhaps?) have time to do a power analysis to show how large a group of test subjects we would need to have 80% statistical power to detect a significant difference between two pieces of equipment?

This thread is indeed fun if you ignore the trolls.
 
     Share This Post       
post-4596845
Post #112 of 180

wavoman

Headphoneus Supremus
Joined
Jan 19, 2008
Messages
1,873
Reaction score
43
Joined
Jan 19, 2008
Posts
1,873
Likes
43
Quote:

Originally Posted by Zanth /img/forum/go_quote.gif
...During a DBT, one might feel uncomfortable, nearly on trial, being tested to "hear" or "not hear" certain things. In the comfort of one's own home, at one's leisure, if one is able to listen at different times of the day, then differences may be more readily apparent...


My proposals specifically avoid this problem. The subject (the only one blinded) is a Head-Fi member, and we are at a meet, A/B testing two alternative pieces of equipment (cables, amps, whatever) that he does not own and has no vested interest it. After careful balancing of levels, he listens to pairs of the same musical passage, and declares "No Difference" / "Difference, but no Preference" / "Pefer A to B" / Prefer "B to A".

Many pairs are played for him, and the answers recorded. We repeat this with different passages, and different HPs if we are not testing HPs. And many different people.

The experiment turns on the tricks: ringers are introduced, some comparisons are false on purpose, etc. The idea is these trials benchmark the subjects ability to listen objectively in the setting at hand.

The results are recorded without the subject's name. No results are announced until after. No one is embarrased, since we have tested enough different people to make the results anonymous. No one is on trial.

It would actually be great fun and we would learn things.
 
     Share This Post       
post-4596873
Post #113 of 180

wavoman

Headphoneus Supremus
Joined
Jan 19, 2008
Messages
1,873
Reaction score
43
Joined
Jan 19, 2008
Posts
1,873
Likes
43
Quote:

Originally Posted by acidbasement /img/forum/go_quote.gif
Science is generally based on presence/absence of statistical significance given variability in responses displayed by a group of experimental subjects. Audio, and especially headphone audio, is an individual thing, and when n=1 all the statistics in the world based on a perfectly randomly drawn group of test subjects with a whole bunch of controls don't change what you experience personally...


Yes, but "sample size one" experiments done over a universe and pooled correctly (not simply averaged) are perfectly valid. Each person acts as a "block", to use the correct statistical term (if you are a statistician, think "paried t-test" vs "regular t-test"). As long as each subject is given a pair, we can do plenty of stats even though there is tremendous variability across subjects. (Look up "sample size one" in your books).
 
     Share This Post       
post-4596935
Post #114 of 180

wavoman

Headphoneus Supremus
Joined
Jan 19, 2008
Messages
1,873
Reaction score
43
Joined
Jan 19, 2008
Posts
1,873
Likes
43
Quote:

Originally Posted by acidbasement /img/forum/go_quote.gif
...statistical power - our ability to detect a significant difference between actual test results and random/uniform results - may very well be too low to make a negative result meaningful in the slightest.... Now this has me thinking. Would anyone who is stats-inclined (wavoman perhaps?) have time to do a power analysis to show how large a group of test subjects we would need to have 80% statistical power to detect a significant difference between two pieces of equipment?


Well you have to make a bunch of assumptions about the magnitute of the difference and the chance that a random person hearing it actually detects it, but I ran lots of values and, very roughly, to have 80% power, i.e., 80% chance of detecting the difference with 95% certainty that it really IS a difference, you need about 15 subjects.

Allocating 30 minutes to each test, we can do this in one full one day at a meet, taking 15 volunteers who feel they have "golden ears". I would love to take a top-of-the-line digital system, and play the same passage using MP3's of various bit rates, then full redbook 16/44.1, then 24/192 LPCM. This mimics a test the pros did and published. They claimed no one could hear the difference between redbook and hi-res LPCM.

I bet we can. Would love to know.
 
     Share This Post       
post-4596997
Post #115 of 180

acidbasement

1000+ Head-Fier
Joined
Jan 29, 2007
Messages
1,292
Reaction score
16
Joined
Jan 29, 2007
Posts
1,292
Likes
16
^ That was quick! Good on ya.
 
     Share This Post       
post-4597969
Post #116 of 180

oicdn

Headphoneus Supremus
Joined
Aug 28, 2006
Messages
3,381
Reaction score
11
Joined
Aug 28, 2006
Posts
3,381
Likes
11
I noticed that forum "coming soon" is no longer there...
 
     Share This Post       
post-4598671
Post #117 of 180

bigshot

Headphoneus Supremus
Joined
Nov 16, 2004
Messages
20,745
Reaction score
3,092
Location
Hollywood USA
Joined
Nov 16, 2004
Location
Hollywood USA
Posts
20,745
Likes
3,092
Website
www.facebook.com
The problem here has nothing to do with objectivism and subjectivism. It has to do with people's reactions to being challenged in their beliefs. Some people respond with a reasoned response to support their position. Some people get mad and lash out with insults.

The solution to this problem is to encourage discussion and discourage ad hominem attacks. Certain folks should work on developing a sense of humor too.

I really don't have much interest in discussing the ins and outs of conducting double blind tests. There are plenty of tests and studies out there already. We don't need to conduct them ourselves. What we need to do is focus on sharing the most efficient and effective ways to achieve great sound. That's what we are all here for.

See ya
Steve
 
     Share This Post       
post-4598849
Post #118 of 180

oicdn

Headphoneus Supremus
Joined
Aug 28, 2006
Messages
3,381
Reaction score
11
Joined
Aug 28, 2006
Posts
3,381
Likes
11
Quote:

Originally Posted by bigshot /img/forum/go_quote.gif
The problem here has nothing to do with objectivism and subjectivism. It has to do with people's reactions to being challenged in their beliefs. Some people respond with a reasoned response to support their position. Some people get mad and lash out with insults.

The solution to this problem is to encourage discussion and discourage ad hominem attacks. Certain folks should work on developing a sense of humor too.

I really don't have much interest in discussing the ins and outs of conducting double blind tests. There are plenty of tests and studies out there already. We don't need to conduct them ourselves. What we need to do is focus on sharing the most efficient and effective ways to achieve great sound. That's what we are all here for.

See ya
Steve



Probably one of the best posts here!!!
 
     Share This Post       
post-4599051
Post #119 of 180

upstateguy

Headphoneus Supremus
Joined
Dec 20, 2004
Messages
4,067
Reaction score
161
Joined
Dec 20, 2004
Posts
4,067
Likes
161
Quote:

Originally Posted by bigshot /img/forum/go_quote.gif
The problem here has nothing to do with objectivism and subjectivism. It has to do with people's reactions to being challenged in their beliefs. Some people respond with a reasoned response to support their position. Some people get mad and lash out with insults.

The solution to this problem is to encourage discussion and discourage ad hominem attacks. Certain folks should work on developing a sense of humor too.

I really don't have much interest in discussing the ins and outs of conducting double blind tests. There are plenty of tests and studies out there already. We don't need to conduct them ourselves. What we need to do is focus on sharing the most efficient and effective ways to achieve great sound. That's what we are all here for.

See ya
Steve




 
     Share This Post       
post-4599265
Post #120 of 180

upstateguy

Headphoneus Supremus
Joined
Dec 20, 2004
Messages
4,067
Reaction score
161
Joined
Dec 20, 2004
Posts
4,067
Likes
161
Quote:

Originally Posted by bigshot /img/forum/go_quote.gif
The problem here has nothing to do with objectivism and subjectivism. It has to do with people's reactions to being challenged in their beliefs. Some people respond with a reasoned response to support their position. Some people get mad and lash out with insults.

The solution to this problem is to encourage discussion and discourage ad hominem attacks. Certain folks should work on developing a sense of humor too.

I really don't have much interest in discussing the ins and outs of conducting double blind tests. There are plenty of tests and studies out there already. We don't need to conduct them ourselves. What we need to do is focus on sharing the most efficient and effective ways to achieve great sound. That's what we are all here for.

See ya
Steve



Just a thought...

While you are absolutely right that there are plenty of tests and studies out there, conducting some of them ourselves, like Wavoman wants to do, moves the prevailing views of our fact based forum into the Verifiable and Reproducible arena.

Really glad to have you aboard.


USG
 
     Share This Post       

Users Who Are Viewing This Thread (Users: 0, Guests: 1)

Top