A Pragmatic Take on Listener Limitations and Bias
Hey all, I just thought I'd drop an update to where my paradigm currently sits when it comes to audio. Like previous posts, I do touch on more controversial topics, so feel free to agree or disagree; I’m no stranger to unpopular opinions! Heck, I would say I’m the bearer of quite a lot of them in my reviews. Most of this is stream-of-consciousness, but I do hope this lends some more transparency to where I'm coming from in my reviews.
On Listening Limitations:
Aural memory is highly failable; I consider myself no exception to this. If I’m drawing a comparison between two IEMs that I am very familiar with, then yes, I am comfortable making more nitty-gritty comparisons. But for the vast majority of IEMs I hear? Admittedly, I’m not going to remember what it sounds like even a week later. I frequently draw upon existing write-ups and notes that I have when asked to compare IEMs. And no matter the comparison, I also
always pull up their respective frequency response graphs to refresh my memory and to make sure I’m not making erroneous comments.
Now, frequency response is one thing, but how big are the technical differences that reviewers and listeners talk about? Well, I hate to disappoint, but they're not as large as some people might think. At least not for me. Believe me, I’d like to tell someone with certainty, “Hey, IEM X is (insert percentage here) more technical than IEM Y”. But it doesn’t really stack up like that for a couple of reasons:
- There's a litany of derivatives (layering, imaging, dynamics, etc.) of sound that fall under technicalities. It’s difficult to quantify them under an umbrella term.
- Diminishing returns are real. Once you start kicking around a grand or so, I really struggle to say if some IEMs are “better” than other IEMs in terms of technical performance. Of course, this is assuming a certain threshold.
To illustrate, between IEMs like the VE Erlkonig, EE Odin, and the qdc Anole VX? I'd struggle to say which is more technical. Same goes for something like the Andro 2020 versus the IER-M9. Sure, the technical discrepancy between something like the Andromeda 2020 and the U12t is fairly pronounced to my ears, but
only because I’ve spent countless hours with them. I’ve handed them to my dad for a listen before, and he could barely tell the difference. When people say they hear “huge” differences in technical performance between some of these IEMs, frankly, I struggle to relate. And that’s fine! After all, it’s not my place to say what someone else is hearing, but rather to tell you what
I hear.
This is a good segue into gut instinct. There will be times that a particular moment in a track strikes a chord with me or, on the contrary, sticks out like a sore thumb. But try as I may to pin-point what it is specifically, I can't. Being able to capitalize and explore moments like these, to get comfortable being uncomfortable, is crucial in my opinion. Of course, there is the risk of this running too equivocal; however, I think these moments can be the distinction between a "great" and a "top-tier" IEM.
And then there's the litany of stuff that I have to concentrate to hear; admittedly, stuff that I get the feeling a lot of people just take a shot in the dark at. Transients are a good instance. When I talk about stuff like “upwards-compressed” attack, “cleaner” decay, coherency, and just micro-dynamics in general, I really have to focus. Even then, a lot of the time I would hesitate to attest with 100% certainty to what I am hearing. And stuff like sources? Sure, I definitely hear differences, but currently, I'm just not confident enough to depict them specifically. Cables? Let’s not even go there.
Maybe I just don’t have enough experience with this stuff, or maybe I can’t hear them altogether. I don’t know. At the same time though, there is the dilemma of being obligated to report what I hear as a reviewer. People expect me to hear these differences. Having to tell them that, well, I
don’t, kind of sucks.
On Bias and Subjectivity:
To return to the whole “huge” differences thing, burn-in is an interesting phenomenon. The way I see it, if you hear it or believe in it, then it does exist in your subjective reality and vice versa. Myself? I would say that,
yes, I believe in it, although I’m inclined to say it’s mostly the product of psychoacoustics. I’ve experienced burn-in with a grand total of
one IEM - the Moondrop KXXS - and that was back when I first started out. My totally unscientific theory is that because I swap between IEMs so frequently, my brain “equalizes” to new sounds faster than normal. So despite no shortage of testament you’ll see to the contrary, for me at least, it is most closely a
negative phenomenon. The more time I have to spend with an IEM, the more I’ll be able to scrutinize it and find flaws. Like so, if you look at my initial impressions, you will see that they almost universally lean more positive than the final review. Be careful what you wish for!
On a related note, this plays into expectation bias. If you think you will hear something, then you’re predisposed to hear it and vice versa. I read reviews just like anyone else. In fact, I probably read more reviews than most people! The vast majority of it is because I'm a fat binge-reader; I don’t agree with most of the reviews that I read. I just enjoy reading people’s opinions and appreciating the work that goes into some of this stuff. But for the few reviewers I respect? Yeah, you bet their opinion is influencing mine; it’s likewise going to affect the outcome of my review to some extent.
This is also why I crack up at most so-called “objective” reviews. Even if you focus predominantly on measurements (like a certain audio forum prides themselves on), the presentation of this information and the conclusions drawn from it are still subject to bias. And let's say your review
only consisted of objective data. You have to wonder, does that
really constitute a review at that point? I'm largely inclined to say no. You can see that, as usual, I think striking somewhere in the middle between the objective and the subjective is most ideal. Admittedly, I do lean more objective when it comes to the likes of cables and audiophile-grade rocks. But if there's one thing that I think most people will agree on, it's that these items should be the last concern in your chain; the cherry on top.
The Takeaway:
I’m human. I don’t have golden ears. My hearing and ability to discern sonic nuance is probably no better than your average listener; I’ve just had the opportunity to hear way more IEMs. And even worse? I’m still a filthy fence-sitter. Trust me, I know all of this better than anybody. But if there’s a pitch amidst the litany of self deprecation, it‘s that for these same reasons, you can rest assured that I'm not in the business of setting up unrealistic expectations. I tell you what you
need to hear, not what you
want to hear, and I wouldn't have it any other way.