[Methodology] How do you test your headphones?
Sep 5, 2012 at 4:20 PM Post #16 of 26
Quote:
For testing & comparing headphones by ear, there are two quintessential requirements:
a) the possibiltiy to switch quickly between different headphones, and
 

 
I think it's also important to soak in a headphone's sound signature for a while, get very familiar with the sound before switching. When A/Bing my highest end stuff, they are both incredible listens, but the other can always sound weird after the one before it, no matter the order. So taking notes while doing an extended-listen A/B is important for me. Some stuff is apparent right away after the switch, some stuff shows up 5 minutes after that, and so on. 
 
Edit: Another thing I do is if I have headphones of a relatively same impedance, I'll use a Y-splitter so I can change quickly if needed. 
 
Sep 5, 2012 at 4:27 PM Post #17 of 26
Cool. I just ordered an SPL meter. I had no idea they were so cheap and never checked. Not only will this be neat for comparisons but probably good for avoiding destroying my hearing..
 
Sep 5, 2012 at 4:31 PM Post #18 of 26
Quote:
Originally Posted by SoundFreaq /img/forum/go_quote.gif
 
So taking notes while doing an extended-listen A/B is important for me. Some stuff is apparent right away after the switch, some stuff shows up 5 minutes after that, and so on. 
 

When taking notes do you record basic impressions on particular tracks or use some kind of rating system? I've been toying around with making a rating system keyed off my most neutral pair. I figured choosing a reference pair for all others to be rated against was a better way then noting simple descriptions.
 
Best Regards 
 
Sep 5, 2012 at 4:38 PM Post #19 of 26
Extended listening impressions are always better. I will be doing this process again soon, as my collection needs some serious paring down. I have a playlist of "reference " songs, I know them well, and I like them enough to listen to them repeatedly. But I will do my testing on different rigs: from portable for the mid-fi closed cans, SE for the mid-fi open ones, and balanced for the big boys. Unamped DAPs for most IEMs and some closed cans.
 
Sep 5, 2012 at 4:52 PM Post #20 of 26
Quote:
Originally Posted by SoundFreaq /img/forum/go_quote.gif

So taking notes while doing an extended-listen A/B is important for me. Some stuff is apparent right away after the switch, some stuff shows up 5 minutes after that, and so on.

 
That's an excellent suggestion, I'll try to take some notes next time I'm comparing something. Haven't thought of that, to be honest .
And I agree that some aspects of a certain headphones' sound require prolonged listening to really notice them. Also, this hobby requires some experience until you really know what qualities you're looking for in a pair of headphones, at least for me it took quite a while until I realised what the important aspects of "sound quality" are. Now after having tried a number of headphones over time, I now feel confident with evaluating headphones over a relatively short amount of time as I know quite well what things I need to look out for.
Of course this is a very individual matter and so there's no right or wrong - letting one's own ears decide is always the best course.
 
About the SPL meters, they're invaluable. I've made a few interesting discoveries, for example that I always tended to listen at a considerably higher volume level when using amplifier X, which resulted in a perception of improved sound quality over amplifier Y. After level matching, the differences suddenly melted away to a few nuances.
 
Sep 5, 2012 at 4:55 PM Post #21 of 26
Quote:
When taking notes do you record basic impressions on particular tracks or use some kind of rating system? I've been toying around with making a rating system keyed off my most neutral pair. I figured choosing a reference pair for all others to be rated against was a better way then noting simple descriptions.
 
Best Regards 

 
Quote:
I have a playlist of "reference " songs, I know them well, and I like them enough to listen to them repeatedly. 

 
I also have a set of songs that I am very familiar with and like that I use that showcase lots of different musical situations. For example, Orchestral shows soundstage and separation well, as well as bass reverb from cellos and bass, while being mostly mid-centric with the rest of the recording. I have tracks that show different things.
 
My list is comprised of Classical (orchestral/Piano/Violin), Vocal (acoustic, and electronic + Vocal like Bjork), electronic, Classic Rock, Ambient, Jazz...
 
I like to make general observations, and don't use a rating system. I feel that is a bit too subjective to me for it to be accurate. Especially across a whole headphone collection. A lot of it is subjective based on mood, what I'm listening to, and the headphones I have been listening to. I can think the ES5 sounds lush in the midrange, or thick and congested depending on what I just came from. Too subjective.
 
However, when comparing just two, I have rated as such:
http://www.head-fi.org/t/539898/review-future-sonics-mg6pro-ear-monitors-dynamic-driver-custom-fit-in-ear-monitors/735#post_8281680
 
Sep 9, 2012 at 12:11 AM Post #22 of 26
I just received my el cheapo SPL meter today, and have been playing around with it with awesome results. First I took measurements of everything/room in the house (the frig is a noisy person) and that was fun. Then I got to business making a headphone mod for the SPL meter.
 
I used an old CDR disc and glued a rubber washer around the hole in the center. Then I stuck the (non-muffed) mic end of the SPL meter through the washer's hole. With this setup I could press the disc firmly against the headphone's earpad to simulate the sound pressure my ear would get when wearing the headphones. Now I can get really close output levels from my different headphones for comparison.
 
This did make a big difference. For example, going from my 600ohm DT880 to my 300ohm HD600, I was getting a much louder sample from the HD600 even when I thought I was making them pretty even. When I compared the two at the same levels the differences became a lot more clear! The DT880, which was falling behind in my non-metered comparisons, was really impressing me at the same levels. The clarity and detail the DT880 produced at the same decibel level just stomped the HD600 (to my surprise). The HD600 needed a good 5-10 decibel boost to open up like Beyers. Even then it suffered from slightly more hiss coming from my HTA-1.
 
This was just round one with the SPL meter, but totally worth it so far. I recommend others look into adding this element to your headphone shoot-outs. Thanks for this suggestion!
 
Best Regards
 
Sep 9, 2012 at 1:01 AM Post #23 of 26
Didn't see this thread had more replies. Sorry for the late replies.

How much discomfort would you endure for a great sounding headphone? I haven't really been judging them on comfort too much but its definitely worth consideration. I've been tolerating an irritating DT880 premium headband for a while because they sound so good. Maybe it's a more important factor than I originally thought.

Best Regards  


If it isn't comfortable to me, I don't keep it. If it's too clampy, jagged, gives me a headache, etc. Just like buying shoes - if they don't fit comfortable like slippers, don't buy them. That said, "comfortable to me" is fairly variable - I think the RS-1 are among the most comfortable headphones made, and the Ultrasone PRO2900 were absolutely headache inducing for example. But both sounded quite nice; I do miss the PRO2900, but I don't miss the headache. :xf_eek:

I think the PRO2900 and ESP/10 are the only two headphones I've seriously considered "living with" but in both cases I've thought better of it - I enjoy the RS-1 and ESP/950 (respectively) more, and they're both VERY comfortable by contrast.

Now, there's certainly a large gradient of comfort - the MDR-F1 for example are like wearing a cloud. The RS-1 you certainly "feel" or "notice" but they aren't painful. The PRO2900 would give me a headache after a few hours, but something like the Beats Pro are instantly painful when put on (they just don't fit me well; I'm sure others have different views on comfort even with all of the models I've listed).

A problem with getting rid of headphones you're uncertain about is that quite likely you'll come to wish you hadn't. So I try not to do it unless I really need to (= been going over the budget).


This is a good point, and goes back to the "time" thing. If you get a pair of cans that you're on the fence about after a day or two of owning them, give them some more time. Don't just dump them - be absolutely certain you're unhappy before you move past them. Now of course if you hate them out of the box and know they're unfixable, sure, move on and save yourself the time. But if they're "growing on you" slowly, give them the chance. This is how the K701 and I ultimately got along - the first month or so I was really not that into them, but I found them very comfortable so I'd sit and listen to them and be kind of unimpressed. Eventually I just ended up really liking them. I don't attribute it to burn-in so much as getting used to their quirks, and appreciating the comfort.

I think it's also important to soak in a headphone's sound signature for a while, get very familiar with the sound before switching.


+1. :beerchug:

If you read through my RS-1/ESP/950 comparison you can sort of get a feel for this in writing. There is no clear-cut winner between the two, and while they're both very resolving, fast, and excellent sounding, they are very different. But right out of the box none of that is immediately apparent - in a quick 5 minute A/B probably all you'd notice is that the RS-1 are brighter. Now depending on your beliefs about sound quality, or preconceived notions, or whatever, that might lead you to hate the RS-1 or declare the RS-1 the more accurate/detailed/fast/etc of the two. Neither is really a fair shake imho.

When taking notes do you record basic impressions on particular tracks or use some kind of rating system? I've been toying around with making a rating system keyed off my most neutral pair. I figured choosing a reference pair for all others to be rated against was a better way then noting simple descriptions.

Best Regards 


I will sometimes compare against my "known quantity" headphones, but I don't have a specific pair that I think is the standard of the world. For example if I'm hearing a bassy headphone for the first time, I will sometimes want to reach for the RS-1 and compare them, to see if I am listening to a much bassier or much boomier or what have you set (because I have a good feeling, imho, of what the RS-1 does down low). But I don't look at it that the RS-1 is sitting on pole, and everyone else is trying to catch up. This is just an example, pick whatever headphones you want for these kinds of comparisons. I don't really worry much about "neutral" either - but that's just me.

Regarding notes or rating systems - no, I don't have anything like that (I don't really take notes in general for things in life, and I'm not a fan of list making). Sure I have some sort of internal quale of what is "good" and what is "bad" but it's kind of contextual. For example if headphone A is "better" but headphone B does something I like or want at the moment (more comfy, more isolation, more bass, whatever you like); it's all variable. I don't tend to keep headphones that sound "bad" though - I just don't see myself ever longing for a sound signature that I disagree with (like say, the HFI-2400; this isn't to say the HFI-2400 are a bad headphone, they just aren't for me). Basically be your own judge of quality, and do what makes sense.

I just received my el cheapo SPL meter today, and have been playing around with it with awesome results. First I took measurements of everything/room in the house (the frig is a noisy person) and that was fun. Then I got to business making a headphone mod for the SPL meter.

I used an old CDR disc and glued a rubber washer around the hole in the center. Then I stuck the (non-muffed) mic end of the SPL meter through the washer's hole. With this setup I could press the disc firmly against the headphone's earpad to simulate the sound pressure my ear would get when wearing the headphones. Now I can get really close output levels from my different headphones for comparison.

This did make a big difference. For example, going from my 600ohm DT880 to my 300ohm HD600, I was getting a much louder sample from the HD600 even when I thought I was making them pretty even. When I compared the two at the same levels the differences became a lot more clear! The DT880, which was falling behind in my non-metered comparisons, was really impressing me at the same levels. The clarity and detail the DT880 produced at the same decibel level just stomped the HD600 (to my surprise). The HD600 needed a good 5-10 decibel boost to open up like Beyers. Even then it suffered from slightly more hiss coming from my HTA-1.

This was just round one with the SPL meter, but totally worth it so far. I recommend others look into adding this element to your headphone shoot-outs. Thanks for this suggestion!

Best Regards


I do think a meter can be useful, certainly, but I'm not married to exact level matching. As an example - I like listening to v-curve/hifi-smile headphones at a lower level (which is kind of what the intention is) than I do "flat" or monitor-style headphones. I know that in a level-matched environment, the monitor-style headphones would be dull or lifeless in comparison, and the v-curves would be boomy and/or harsh. But with listening habits in mind, they both come out smelling like roses. My point here isn't to disparage measurement, it's just to keep the end-game in mind. Level-matching IS the ideal way to do A/B comparisons, but at the end of the day I'm not interested in which one I will preference in an unbiased way, I'm interested in "will I enjoy this product in the manner in which I intend to use it and/or will it function in the manner in which I intend to use it?" If that makes sense.

Also these might be useful for you to look over:
http://trace.wisc.edu/docs/2004-About-dB/
http://www.animations.physics.unsw.edu.au/jw/dB.htm
http://www.physics.mcgill.ca/~guymoore/ph224/notes/lecture11.pdf
 
Sep 9, 2012 at 1:21 AM Post #24 of 26
I'm still struggling with the comfort issue. I find most headphones uncomfortable after a while with the exception of the Audio Technica ADXXX wing design and the HD600/650. Certain headphones, like the DT880, hurt my head, but I can't get rid of such great sounding cans. I've been resorting to ridiculous cushion mods that annoy me but make it bearable. My wife says I just need more hair up there...bah, easy for her to say.
 
Quote:
My point here isn't to disparage measurement, it's just to keep the end-game in mind. Level-matching IS the ideal way to do A/B comparisons, but at the end of the day I'm not interested in which one I will preference in an unbiased way, I'm interested in "will I enjoy this product in the manner in which I intend to use it and/or will it function in the manner in which I intend to use it?" If that makes sense.
 

I found this to be an excellent point. I will certainly keep it in mind while evaluating. Thanks!
 
Best Regards
 
Sep 9, 2012 at 1:27 AM Post #25 of 26
I'm still struggling with the comfort issue. I find most headphones uncomfortable after a while with the exception of the Audio Technica ADXXX wing design and the HD600/650. Certain headphones, like the DT880, hurt my head, but I can't get rid of such great sounding cans. I've been resorting to ridiculous cushion mods that annoy me but make it bearable. My wife says I just need more hair up there...bah, easy for her to say.

I found this to be an excellent point. I will certainly keep it in mind while evaluating. Thanks!

Best Regards


I think it's fair to say that most all headphones are going to be uncomfortable versus wearing nothing. But there's certainly a gradient between "I can wear this all day" and "get it off" imho. :xf_eek:

The irony is, I consider the AD "wing design" to be in the "get it off NOW!" category. :ph34r: (the single 3D Wing headphone that I've tried, it felt like I was trying squish my entire head into a hat designed for a child - I really did not like it one bit, it's turned me off to trying any other 3D Wing headphones, although I've been told that there are variations within AT headphones and I might've just found a specific "version" or "type" of that headband that doesn't work, I don't know, the sound on the pair I was trying was pretty ho-hum (especially for the price) so I haven't really bothered exploring further).

If the DT880 are painful to wear, I'd probably dump them, but that's me. I'm not sure what to suggest in their place though (ignoring that I dislike Beyerdynamic in general and want to say that the KPH7 is a better headphone than anything Beyer has ever made :veryevil:; I don't think there's any really good equivalent/analog to them - Ultrasone and Grado are both bright but are also both very unique, AKG is a bit more plastic/dead, and Sony doesn't make white-hot bright cans anymore). I don't know - I consider comfort part of the listening experience. :xf_eek:
 
Sep 9, 2012 at 6:16 AM Post #26 of 26
Quote:
Basically the short answer is: time.

 
+1  ...and patience.
 
Quote:
Extended listening impressions are always better. I will be doing this process again soon, as my collection needs some serious paring down. I have a playlist of "reference " songs, I know them well, and I like them enough to listen to them repeatedly. But I will do my testing on different rigs: from portable for the mid-fi closed cans, SE for the mid-fi open ones, and balanced for the big boys. Unamped DAPs for most IEMs and some closed cans.

 
I cannot stress this enough.  Having a set of reference tracks (at the best quality possible) is key for me.  Moving from headphone-to-heaphone, amp-to-amp, etc., my tracks are just about the only control point I have.
 

Users who are viewing this thread

Back
Top