Evidence that subjective, sighted reviews fail
Oct 8, 2013 at 9:25 AM Post #16 of 71
IEMs: go to rinchoi.blogspot.com and look up the ASG-2, Earsonics SM64 and anything made by Heir. As for reviews, look them up on head-fi, you won't find a single reviewer badmouthing them except for a handful of objective lunatics getting rotten eggs thrown at them everywhere they go :wink:
 
HiBy Stay updated on HiBy at their facebook, website or email (icons below). Stay updated on HiBy at their sponsor profile on Head-Fi.
 
https://www.facebook.com/hibycom https://store.hiby.com/ service@hiby.com
Oct 8, 2013 at 9:29 AM Post #17 of 71
Well, I kinda agree! In my book that's a fail.


Again, a fail at what exactly?

If the purpose of a sighted/subjective review is for someone to simply relate their sighted/subjective experience with a given piece of gear, then what can it possibly be failing at?

se
 
Oct 8, 2013 at 11:59 AM Post #18 of 71
Again, a fail at what exactly?

If the purpose of a sighted/subjective review is for someone to simply relate their sighted/subjective experience with a given piece of gear, then what can it possibly be failing at?

se

 
One issue with magazine reviews is that the reviewers are representing themselves (or being represented by their editors) as expert listeners. The implication is that they are better and more capable of determining the "quality" of the item being tested. Yes it is just their opinion but we are supposed to think that they have a certain expertise, funnily enough when Harman tested listeners they found that HiFi salespersons were actually better than professional reviewers, were more capable at detecting the more objectively capable speakers. 
 
Oct 8, 2013 at 12:17 PM Post #19 of 71
If the purpose of a sighted/subjective review is for someone to simply relate their sighted/subjective experience with a given piece of gear, then what can it possibly be failing at?

Conforming to reality due to biases?
 
But reviewers somehow have to convey that their reviews are not heavily biased else they'd be more or less useless and I'd argue that most reader will read reviews in that light. I'd also argue that they read those unsubstantiated claims ("best DAC for years to come" etc.) as more than just claims.
 
Oct 8, 2013 at 12:21 PM Post #20 of 71
IEMs: go to rinchoi.blogspot.com and look up the ASG-2, Earsonics SM64 and anything made by Heir. As for reviews, look them up on head-fi, you won't find a single reviewer badmouthing them except for a handful of objective lunatics getting rotten eggs thrown at them everywhere they go
wink.gif

Thanks. Couldn't the aurisonics (?) asg-2 though.
 
Will add those I could find to the first post.
 
Oct 8, 2013 at 4:24 PM Post #21 of 71
Conforming to reality due to biases.


But we're talking about subjective reviews. What the hell does conforming to reality have to do with it? Conforming to reality is decidedly objective.

I'm sorry, but your premise makes no sense. You're saying that subjectivity fails because it's not objective. But by that token, one could just as well say that objectivity fails because it's not subjective.

It's nonsense.

se
 
Oct 8, 2013 at 4:51 PM Post #22 of 71
But we're talking about subjective reviews. What the hell does conforming to reality have to do with it? Conforming to reality is decidedly objective.

So subjective reviews can be completely fictitious, purely invented nonsense? Are subjective reviews of real things not supposed to be a description of the experience of these real things? I always thought that when someone did a review on a component on a forum he wanted to convey his experience of the real thing to others, not some made up stuff.
 
Let's take one of the IEMs from above for example. 20 dB dip at ~3 kHz but reviewers say it is a "giant slayer" with treble having "nice details" and being "well balanced". That's nonsense.
 
I'm sorry, but your premise makes no sense. You're saying that subjectivity fails because it's not objective. But by that token, one could just as well say that objectivity fails because it's not subjective.

No, there's nothing wrong with subjective tests per se (already mentioned in #3). I'm saying those reviews fail because they're nonsense. Nonsense because they're interminably biased with no basis in reality, there are no attempts of controlling variables, no attempts of a proper test setup.
Just sitting down and putting one's oar in it seems.
 
 
PS: We're not talking about the meaning of someone's dreams here.
 
Oct 8, 2013 at 6:42 PM Post #24 of 71
I give up.

That was quick.
biggrin.gif
 
 
So are you saying that experiences can be off but because they're subjective it's all dandy even if they're completely off (and by the linked reviews that seems to be more the rule than the exception)?
 
A: "The moon is made of cheese!"
B: "You belong in an asylum."
A: "No, that's just my subjective review of the moon."
B: "Oh, in that case it's fine."
 
Oct 8, 2013 at 8:18 PM Post #25 of 71
I don't think sighted tests are entirely subjective at all. A direct A/B matched comparison can give you a very good idea of the general lay of the land. The only time a blind test is really needed is if two sounds are so close it's hard to tell them apart. That rarely matters in home audio.
 
Oct 8, 2013 at 8:40 PM Post #26 of 71
  Thanks. Couldn't the aurisonics (?) asg-2 though.
 
Will add those I could find to the first post.

 
I was going to point you to rinchoi's review but did a double take when I looked at your updated OP.  I think you need more different sources, and rinchoi gets enough eggs thrown at his face as it is 
biggrin.gif
Then again, I suspect the objective performance of these phones is good enough reason why more major, more commercial measurement-based review sites like headphone.com haven't got a hand on them
biggrin.gif

 
HiBy Stay updated on HiBy at their facebook, website or email (icons below). Stay updated on HiBy at their sponsor profile on Head-Fi.
 
https://www.facebook.com/hibycom https://store.hiby.com/ service@hiby.com
Oct 8, 2013 at 9:08 PM Post #27 of 71
I consider myself an objective person so I'll tell my story. A long time ago a guy like me bought an etymotic mc5, which in theory has the most flat, highly developed, controlled decay, undistorted sound ever created... Then I got the w4r with one of the most awful graphs I ever seen in my life. Needless to say the result. Both were not my style however the w4r has something difficult to explain that makes the sound pleasing. Do you think any test can show me what I heard?

In theory the frequency response differs greatly from what I consider optimal...
 
Oct 8, 2013 at 9:46 PM Post #28 of 71
I think subjectivity is fine, but where most of us falter is clarifying the fact that the assertion is subjective.
 
For example:
 
-- The moon is made of cheese
 
as compared to:
 
-- In my opinion, the moon is made of cheese.
 
 
This makes a huge difference, the first one seems like a universal truth, while the other one seems like an individual opinion, meaning you may be open to changing it based on better evidence.
 
 
As you might have seen in the media, most good publications follow either of the two styles:
 
-- Just report the facts, and let the readers make up their mind. BBC is a good example.
-- Admit upfront that the statement is the newspaper's stand on the issue. The Economist does that often.
 
I don't think either of them are wrong, the idea is to know what a claim is as opposed to a fact.
 
Oct 9, 2013 at 12:16 AM Post #29 of 71
  That was quick.
biggrin.gif
 

 
Just don't have the time to bang my head against a wall that I used to.
 
 So are you saying that experiences can be off but because they're subjective it's all dandy even if they're completely off (and by the linked reviews that seems to be more the rule than the exception)?

 
"Off" from what? In the context of someone relating their subjective experience, how can it be "off" unless you're going to accuse that someone of lying about what their subjective experience was? One's subjective experience is what it is. And in my opinion the only thing that counts for anything at the end of the day. I don't understand why you insist on imposing objectivism into a context where it is utterly irrelevant.
 
 A: "The moon is made of cheese!"

 
That's a decidedly objective claim. Do you even know the difference between subjective and objective?
 
se
 
Oct 9, 2013 at 12:28 AM Post #30 of 71
Just don't have the time to bang my head against a wall that I used to.


"Off" from what? In the context of someone relating their subjective experience, how can it be "off" unless you're going to accuse that someone of lying about what their subjective experience was? One's subjective experience is what it is. And in my opinion the only thing that counts for anything at the end of the day. I don't understand why you insist on imposing objectivism into a context where it is utterly irrelevant.


That's a decidedly objective claim. Do you even know the difference between subjective and objective?

se


Apparently there were claims made about the objective performance of the Wadia in the subjective reviews (I say "apparently" because I haven't bothered to look closely at them at all)

The other contention was that looking at an item's shiny exterior and shiny price tag may bias one's impressions of the item. While one might say that such biased impressions are still valid subjective impressions one might also say that those are silly reasons for liking an item that should be filtered out.
 
HiBy Stay updated on HiBy at their facebook, website or email (icons below). Stay updated on HiBy at their sponsor profile on Head-Fi.
 
https://www.facebook.com/hibycom https://store.hiby.com/ service@hiby.com

Users who are viewing this thread

Back
Top