Bias from reading reviews?
Dec 6, 2011 at 3:07 AM Thread Starter Post #1 of 11

Blue Boat

Banned member koolkat.
Joined
Oct 21, 2011
Posts
626
Likes
17
I don't know if such a topic exists or has already been debated. Please delete if so. 
 
What do you think?
 
Say a well-regarded reviewer gives an average-measuring headphone glowing reviews, will reading it introduce a bias so heavy (?) that it affects your own judgement of how good or bad the headphone sounds? We have all heard or read about how expectation bias plays a part in influencing your reviews of amplifiers, cables, but what about headphones? 
 
 
 
 
 
Dec 6, 2011 at 5:44 AM Post #2 of 11
A five star award from What Hifi will boost sales. Then you get flavour of the month products such as Silver High Breed cables and ATM-50 headphones on forums which must also boost sales.
 
I am sure there are studies into such effects, time for some research......
bigsmile_face.gif

 
Dec 6, 2011 at 5:50 AM Post #3 of 11
Here is a start and it is not what I was expecting
 
http://blog.mikezhang.com/files/gamereviews.pdf
 
"Our research provides a potential positive reconciliation of the mixed results from previous
studies. For instance, Chevalier and Mayzlin (2006) examine book sales at Amazon.com and
find that online reviews influence book sales, while Chen et al. (2004), using a similar data set
from Amazon.com, find the opposite. Similarly, in the context of the movie industry, Zhang
and Dellarocas (2006) find that online reviews influence box-office sales but Duan et al. (2008)
find the opposite. Researchers have not been able to reconcile the stark differences in results
and have instead attributed them to methodological shortcomings. For example, Duan et al.
(2008) point out that the mixed finding could result from the fact that researchers conduct
their analyses in a cross-sectional context and do not control for unobserved differences in
product quality. Our study suggests that data sets with a different mix of product types,
even for the same product category, could lead to different conclusions."
 
So a good review from a respected source is no gurantee of success. There are other factors including, importantly the quality of the actual product. So a good review of a medium product will not necessarily guarantee better sales.
 
Dec 6, 2011 at 6:09 AM Post #4 of 11
Nah, I'm not talking better sales. 
 
I'm talking about the actual quality of the product itself.
 
If someone well-respected posted a very good review of an average product, will the expectation bias affect how you evaluate the product or is it negligible? Say, the Vmoda M-80. I just read a short one-liner from a fellow Head-Fier about how good the M80s were. According to him, Jude also gave positive remarks.
 
So how much of this is actually his hearing, and how much of it is bias? If the reviewer said that they sounded a lot like Beats (which are very much hated around here), would that fellow head-fier heard differently? Or would it not affect the results at all? In hindsight, maybe I should've posted this in a psychology board, rather than Head-Fi's Sound Science section. 
 
 
 
Dec 6, 2011 at 6:30 AM Post #5 of 11
Well the quality of the product is a constant and there is a lot of evidence to show how a product's reviews affects people's perception of it.
 
Dec 10, 2011 at 4:49 PM Post #6 of 11
[edited for brevity]
 
Dec 11, 2011 at 2:20 PM Post #7 of 11
Just my 2 cents. Whenever I review anything, I never set any expectations. I listen to what I a hearing and then review it.
 
Dec 11, 2011 at 2:31 PM Post #9 of 11

 
Quote:
You don't think you're setting expectations, anyway. The danger of this sort of thing is it works subconsciously.



Alright, I'll agree with you there. But I surely don't do this. "Hey, that Apex Peak looks might fine, it must be awesome".
 
It does work subconsciously, and while I have had a few "bummers", it doesn't take away from the fact that you always have to be honest. If something sucks, even if it's expensive, super high end, and I get it as a free sample, then I will say it absolutely sucks.
 
Dec 11, 2011 at 2:50 PM Post #10 of 11
Of course there's a bias, and no, it's not going to be the dominating effect when there's very strong evidence to the contrary.
 
The question being asked was about the severity of the effect.
 
Dec 11, 2011 at 3:19 PM Post #11 of 11


Quote:
Of course there's a bias, and no, it's not going to be the dominating effect when there's very strong evidence to the contrary.
 
The question being asked was about the severity of the effect.


Like graphs/charts?
 
What if the measurements have not been published yet? 
 
Would the bias from reading a glowing review have much effect on your own perception of the audio gear in question? 
 
(Like in FOTM threads)
 

Users who are viewing this thread

Back
Top