• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

ASR Getting Into Measuring Headphones!

bobbooo

Major Contributor
Joined
Aug 30, 2019
Messages
1,479
Likes
2,079
They basically took 31 different headphones, measured the FR of each on a GRAS 45, and then REPLICATED each FR curve using EQ and on a single pair of AKG K712 headphones. Each listener "listened" to 8 headphones "virtually" through that K712. The FR match between actual and "virtual/replicated" headphone was only +/- 1dB up to 12khz, and above 12khz, they didn't aggressively EQ. The did validation testing and only found a correlation of 0.85 between actual and virtual ratings.

Honestly, I think it's pretty remarkable that only matching 60% of the frequency response with a +/-1 dB accuracy produced as high a correlation as that, and just goes to show how frequency response makes up the vast majority and most important part of audible differences between headphones, how frequencies above 12 kHz are of much less importantance than below, and how relatively undiscerning the human ear actually is (even those of highly trained listeners), contrary to the outlandish claims of some 'audiophiles' that the human ear is a better acoustic measurement instrument than state of the art man-made equipment.
 
Last edited:

DualTriode

Addicted to Fun and Learning
Joined
Oct 24, 2019
Messages
893
Likes
593
@amirm,

What about the APx555 fan noise?

Closed loop the AP can do magic.

Using microphones I do not think that the AP can tell the difference between fan noise and distortion.

Just for grins I took the headphones off the 45CA, turned off the amplifiers and inserted a foam ear plug in the 45CA Left Ear.

Using the optional AP Acoustic Response software the attached is the THD Level plot.

My impression is that a way of isolating the AP fan noise is required.

Thanks DT
THD Level.png
 

or965

Member
Joined
May 22, 2018
Messages
35
Likes
24
@amirm There a chance to send you earphones and you will measure them as you offer with amplifiers ?
I can send you a kz as16 and CCA ca16. Maybe I can even buy new earphones and send them directly to you, this way there will be only a return shipping cost .I think that this way you will able to measure more earphones without buying them yourself or to loan them from the company .
 

tinytea

Member
Joined
Dec 15, 2020
Messages
25
Likes
16
Wow super incredible.

I'm a relatively new lurker of this site and really respect all the SCIENCE that has and is being done here measuring Amps and DACs and also other audio equipment.

Very cool to see that headphones and earphones are getting the same treatment!
 

Daaadou

Member
Joined
Jun 29, 2020
Messages
90
Likes
72
Location
Paris, France
I do agree, thanks for the great work, I'm looking for some headphones to listen to music at night and was highly interested to read these tests of the sennheiser HD800S and audeze LCX... Think I will wait for the next one and wish for one you'll recommend "out of the box" :D
 

laurelkurt

Active Member
Forum Donor
Joined
Dec 7, 2019
Messages
130
Likes
59
Location
Rochester, NY
The heading says it all: we are going to be officially measuring, reviewing and characterizing earphones and headphones (likely more of the latter than the former). Some of you know the evaluation process I went through this summer of the BK 5128 Head and Torso headphone measurement system. The company was wonderful to work with but alas, lack of research using that new system made interpreting the results very difficult. And then there was the cost for which you could buy a luxury car! Post that I evaluated the GRAS 45CA which has been used in research and results were much more encouraging and the cost much lower. So a couple of months ago I decided to put in the order for one and here it is!

View attachment 97136

The fixture is incredibly heavy but that is goodness as it won't move when you try to adjust the headphone. Because the fixture is not a manikin, I actually find it a lot easier to try different positions to get better alignment of the headphone. The unit is stereo so I am able to quickly compare one channel to the other for alignment purposes and also for driver matching.

There are many variations of 45CA. The one I have purchases is the 45CA-10. Options on it are anthropometric pinna (human looking ear), model KB5010, which you can see more clearly here:

View attachment 97138

The old pinna were rigid unlike a real ear. That caused headphones that sat on the ear to sit proud, completely messing up their low frequency response. The pinna as supplied is quite soft -- much like a babies ear. My own ears are more rigid (as they should be for someone as King of Audio!!!). So some variation always remains but at least we are closer.

The other option is the high-frequency ear simulator/coupler (microphone) model RA0402. Traditional couplers were of "711" type and had too much resonance in higher frequencies. The RA0402 has a more muted response in that region. This would avoid the temptation to try to pull those peaks down post measurements as they were likely not matching real ear response. That said, the correction is somewhat arbitrary to so confidence remains low in higher treble region (due to this and reflections inside the cup).

External constant current is needed to drive the microphone pre-amplifiers built into the system. So I had to purchase a GRAS 12AX 4-channel power supply and amplifier (though I will be using it as a 0 dB buffer). The microphones are pre-polarized meaning you don't need a high voltage power supply to drive then as you used to.

The retail cost is around $15,000 so this was another significant investment in our toolset to quantify performance of audio products.

I know some of you think headphone measurements have already been done and other think they are inaccurate so whey bother. I had to resolve both of these issues in my mind before deciding to spend this money so let me give you my justification for proceeding.

1. Measurements have been done. This is indeed true for the most part. It is impressive how the headphone community has embraced measurements to such a degree compared to speakers which was hardly touched as far as proper measurements. Part of this is due to lower cost of measurement gear but still, the effort to measure literally hundreds of not thousands of headphones was not free.

While the data is great, having so many versions of it is not so. There are a number of different fixtures uses resulting in different measurements. Super experienced headphone users know how to wade through these and get the information they need. But it is not for everyone.

Then there is our method of doing things. You could have found electronic and speaker measurements elsewhere but we have managed to not only catch up but leave behind many other sites that do this type of work. There is a "style," method and even attitude that goes into my reviews that is unique and works for both me and the readership. This combination does not exist elsewhere as it is unique by nature of it. Indeed the few headphone reviews I have done created a ton of interest. Importantly for me, they quantified the performance of the headphones I tested beyond what I had read elsewhere. Maybe that is my issue but again, how to clearly communicate what a piece of audio is about is what I specialize in. And will bring the same to headphones.

2. Why bother to measure headphones as data is inaccurate. This is what led me last year to invest in speaker measurements than headphones. The research about speakers is far more conclusive and measurements a ton more standardized. But something changed when I got the GRA 45C evaluation system. I measured, saw the deficiencies, applied judicious EQ that resulted in incredible sonic improvement in these headphones. This demonstrated that the objective data is indeed highly instructive. And that just a bit of EQ transforms the performance of any headphone, making them not only more accurate but far more enjoyable. As I type this, I am listening to AEON Flow closed headphone post EQ and it sounds so nice. In some respects, it is outperforming some of the best speakers I have tested!

Yes, you have to be careful how you approach the measurement data. I am not a fan of hugging a target curve to the max and spitting out 10 EQ bands to apply to them. The measurement data is not that reliable to enable this. But a softer approach works and works wonderfully.

A bonus of measuring headphones relative to speakers is speed. I am able to characterize the frequency response of a headphone in 5 seconds. Same process takes hours with speakers and lugging around heavy boxes around.

Ultimately I thought I had no choice but to test and review headphones. They are part and parcel of my own music listening and countless audiophiles. We have to treat them as well as we do other audio products, Leaving their testing to others did not make sense leaving a hole in our arsenal of bringing the best sound to everyone.

The main barrier was of course the cost. The capital investments in this effort have long gone the crazy land even when I purchased my Audio Precision analyzer let alone the Klippel speaker measurement system. I don't know when I am going to recoup those dollars. So investing even more did not at all seem logical. But I just decided to hell with it and proceed. Asked my wife what she thought and she could tell in my eyes there was not a "no" in what I was expecting from her. :)

As with our other measurements, there will be some growing pains as we develop and mature our measurement suite for headphones. I will as always carry a hard line in listening to complaints. :) But I will internalize some and will make them more perfect as time goes. I ask you to leave negativity behind and work constructively to get more data under our belt about this super important transducer. Last thing I need is dealing with food fights on this subject in addition to new workload of testing headphones.

So there it is. I am poorer financially but am confident I will be far richer emotionally to bring more data to our collective audio life.

P.S. I picked up the 45CA in person from Audio Precision headquarters since they are the sister company to GRAS. Alas, half way down the check engine line came on in our Mercedes Sprinter RV. :( Read the code and it is two emissions (NOx) sensors going bad. Hear huge horror stories about how expensive such repairs are at Mercedes. Have a call into them to see if they are covered under emissions warranty (the van is 4.5 years old with only 18,000 miles). I got home only to see a message from them that the power supply had just arrived and was not in the box I picked up! So I had to wait a week for that to arrive. Not a good start but hopefully things will change from here on.

------------

Any donations are appreciated using: https://www.audiosciencereview.com/forum/index.php?threads/how-to-support-audio-science-review.8150/
 
OP
amirm

amirm

Founder/Admin
Staff Member
CFO (Chief Fun Officer)
Joined
Feb 13, 2016
Messages
44,368
Likes
234,392
Location
Seattle Area
@amirm There a chance to send you earphones and you will measure them as you offer with amplifiers ?
I can send you a kz as16 and CCA ca16. Maybe I can even buy new earphones and send them directly to you, this way there will be only a return shipping cost .I think that this way you will able to measure more earphones without buying them yourself or to loan them from the company .
It will be a similar process but let's wait a bit on that. I want to make sure I have a proper protocol for IEMs before accepting more.
 
OP
amirm

amirm

Founder/Admin
Staff Member
CFO (Chief Fun Officer)
Joined
Feb 13, 2016
Messages
44,368
Likes
234,392
Location
Seattle Area
@amirm,

What about the APx555 fan noise?
It is an annoyance to be sure. For now, set the playback level high enough that it dominates the AP noise. Also, I have my AP inside of an enclosure which quiets it down some. I also have isolation under my Gras 45CA which helped with low frequency transmission through the fixture itself.

I will probably build a quiet box in the future for it but it makes the workflow much slower. Right now I have the headphones right next to me and can make quick adjustments. With a large soundbox it would have to be somewhere else, slowing down the process.
 

Kchuenmusic

Member
Joined
Jan 14, 2021
Messages
5
Likes
2
Would love to see the ZMF Verite closed to get measured, heavily considering to buy a pair. They’re the most highly regarded closed back out there.

Actually interested in any ZMF headphones being measured and let’s see if they fare better than the Abyss and Focal.
 

Hayabusa

Addicted to Fun and Learning
Joined
Oct 12, 2019
Messages
787
Likes
519
Location
Abu Dhabi
There are many variations of 45CA. The one I have purchases is the 45CA-10. Options on it are anthropometric pinna (human looking ear), model KB5010, which you can see more clearly here:

View attachment 97138


Any donations are appreciated using: https://www.audiosciencereview.com/forum/index.php?threads/how-to-support-audio-science-review.8150/

Hi Amir, I was just thinking about thia experiment: It would be nice to see what the transfer function of the 45CA-10 is if the source would be from a set of speakers setup in a typical stereo setup/listening distance.
This could be done by using the speakers as source and then measure the difference between the FR with the 45CA-10 and a calibrated mic at the same position.
This should give some kind of inverse version of the Harman curve isn't it?
 

Music1969

Major Contributor
Joined
Feb 19, 2018
Messages
4,636
Likes
2,809
The heading says it all: we are going to be officially measuring, reviewing and characterizing earphones and headphones (likely more of the latter than the former). Some of you know the evaluation process I went through this summer of the BK 5128 Head and Torso headphone measurement system. The company was wonderful to work with but alas, lack of research using that new system made interpreting the results very difficult. And then there was the cost for which you could buy a luxury car! Post that I evaluated the GRAS 45CA which has been used in Harman research (with respect to frequency response preference) and results were much more encouraging and the cost much lower. So a couple of months ago I decided to put in the order for one and here it is!

View attachment 97136

The fixture is incredibly heavy but that is goodness as it won't move when you try to adjust the headphone. Because the fixture is not a manikin, I actually find it a lot easier to try different positions to get better alignment of the headphone. The unit is stereo so I am able to quickly compare one channel to the other for alignment purposes and also for driver matching.

There are many variations of 45CA. The one I have purchases is the 45CA-10. Options on it are anthropometric pinna (human looking ear), model KB5010, which you can see more clearly here:

View attachment 97138

The old pinna were rigid unlike a real ear. That caused headphones that sat on the ear to sit proud, completely messing up their low frequency response. The pinna as supplied is quite soft -- much like a babies ear. My own ears are more rigid (as they should be for someone as King of Audio!!!). So some variation always remains but at least we are closer.

The other option is the high-frequency ear simulator/coupler (microphone) model RA0402. Traditional couplers were of "711" type and had too much resonance in higher frequencies. The RA0402 has a more muted response in that region. This would avoid the temptation to try to pull those peaks down post measurements as they were likely not matching real ear response. That said, the correction is somewhat arbitrary to so confidence remains low in higher treble region (due to this and reflections inside the cup).

External constant current is needed to drive the microphone pre-amplifiers built into the system. So I had to purchase a GRAS 12AX 4-channel power supply and amplifier (though I will be using it as a 0 dB buffer). The microphones are pre-polarized meaning you don't need a high voltage power supply to drive then as you used to.

The retail cost is around $15,000 so this was another significant investment in our toolset to quantify performance of audio products.

I know some of you think headphone measurements have already been done and other think they are inaccurate so whey bother. I had to resolve both of these issues in my mind before deciding to spend this money so let me give you my justification for proceeding.

1. Measurements have been done. This is indeed true for the most part. It is impressive how the headphone community has embraced measurements to such a degree compared to speakers which was hardly touched as far as proper measurements. Part of this is due to lower cost of measurement gear but still, the effort to measure literally hundreds of not thousands of headphones was not free.

While the data is great, having so many versions of it is not so. There are a number of different fixtures uses resulting in different measurements. Super experienced headphone users know how to wade through these and get the information they need. But it is not for everyone.

Then there is our method of doing things. You could have found electronic and speaker measurements elsewhere but we have managed to not only catch up but leave behind many other sites that do this type of work. There is a "style," method and even attitude that goes into my reviews that is unique and works for both me and the readership. This combination does not exist elsewhere as it is unique by nature of it. Indeed the few headphone reviews I have done created a ton of interest. Importantly for me, they quantified the performance of the headphones I tested beyond what I had read elsewhere. Maybe that is my issue but again, how to clearly communicate what a piece of audio is about is what I specialize in. And will bring the same to headphones.

2. Why bother to measure headphones as data is inaccurate. This is what led me last year to invest in speaker measurements than headphones. The research about speakers is far more conclusive and measurements a ton more standardized. But something changed when I got the GRA 45C evaluation system. I measured, saw the deficiencies relative to Harman Target Curve, applied judicious EQ that resulted in incredible sonic improvement in these headphones. This demonstrated that the objective data is indeed highly instructive. And that just a bit of EQ transforms the performance of any headphone, making them not only more accurate but far more enjoyable. As I type this, I am listening to AEON Flow closed headphone post EQ and it sounds so nice. In some respects, it is outperforming some of the best speakers I have tested!

Yes, you have to be careful how you approach the measurement data. I am not a fan of hugging a target curve to the max and spitting out 10 EQ bands to apply to them. The measurement data is not that reliable to enable this. But a softer approach works and works wonderfully.

A bonus of measuring headphones relative to speakers is speed. I am able to characterize the frequency response of a headphone in 5 seconds. Same process takes hours with speakers and lugging around heavy boxes around.

Ultimately I thought I had no choice but to test and review headphones. They are part and parcel of my own music listening and countless audiophiles. We have to treat them as well as we do other audio products, Leaving their testing to others did not make sense leaving a hole in our arsenal of bringing the best sound to everyone.

The main barrier was of course the cost. The capital investments in this effort have long gone the crazy land even when I purchased my Audio Precision analyzer let alone the Klippel speaker measurement system. I don't know when I am going to recoup those dollars. So investing even more did not at all seem logical. But I just decided to hell with it and proceed. Asked my wife what she thought and she could tell in my eyes there was not a "no" in what I was expecting from her. :)

As with our other measurements, there will be some growing pains as we develop and mature our measurement suite for headphones. I will as always carry a hard line in listening to complaints. :) But I will internalize some and will make them more perfect as time goes. I ask you to leave negativity behind and work constructively to get more data under our belt about this super important transducer. Last thing I need is dealing with food fights on this subject in addition to new workload of testing headphones.

So there it is. I am poorer financially but am confident I will be far richer emotionally to bring more data to our collective audio life.

P.S. I picked up the 45CA in person from Audio Precision headquarters since they are the sister company to GRAS. Alas, half way down the check engine line came on in our Mercedes Sprinter RV. :( Read the code and it is two emissions (NOx) sensors going bad. Hear huge horror stories about how expensive such repairs are at Mercedes. Have a call into them to see if they are covered under emissions warranty (the van is 4.5 years old with only 18,000 miles). I got home only to see a message from them that the power supply had just arrived and was not in the box I picked up! So I had to wait a week for that to arrive. Not a good start but hopefully things will change from here on.

------------

Any donations are appreciated using: https://www.audiosciencereview.com/forum/index.php?threads/how-to-support-audio-science-review.8150/

Hi @amirm ,

I assume the mics are deep inside the fake ear here?

That's why we see the "hump" in many measurements for neutral headphones, in the 1-5 kHz region ?

cc @solderdude
 

DualTriode

Addicted to Fun and Learning
Joined
Oct 24, 2019
Messages
893
Likes
593
Hi Amir, I was just thinking about thia experiment: It would be nice to see what the transfer function of the 45CA-10 is if the source would be from a set of speakers setup in a typical stereo setup/listening distance.
This could be done by using the speakers as source and then measure the difference between the FR with the 45CA-10 and a calibrated mic at the same position.
This should give some kind of inverse version of the Harman curve isn't it?
Hello,

This is exactly what Harman's, Sean Olive PhD, did as documented in the AES papers.

It is exactly the Harman Curve.


Hi @amirm ,

I assume the mics are deep inside the fake ear here?

That's why we see the "hump" in many measurements for neutral headphones, in the 1-5 kHz region ?

cc @solderdude

The microphones are located where the ear drums would be if it were your head.

Thanks DT
 

Robbo99999

Master Contributor
Forum Donor
Joined
Jan 23, 2020
Messages
6,874
Likes
6,672
Location
UK
Hello,

This is exactly what Harman's, Sean Olive PhD, did as documented in the AES papers.

It is exactly the Harman Curve.




The microphones are located where the ear drums would be if it were your head.

Thanks DT
Well it woudn't be the 45CA-10, as that's the version without the head. Harman used the Kemar (dummy head) version, which would have allowed some of the HRTF to have been transferred from the head to reflect in the measurements that were made at the dummy head eardrum. Harman also used a slightly different pinna to any that you can really buy today, so that wasn't quite the same........the pinna that Amir/Oratory use I think is a good likeness to the one used by Harman, but I don't know by how much....I do know the original pinna used by Harman wasn't very flexible (pliability), but I suppose shape is more important when it comes to the creation of the Target Curve.

Also, it's only the Harman Headphone 2013 Curve that has the bass levels & treble levels that would be seen as a direct measurement of a "Harman Curve Speaker" in a room, as the Harman Headphone 2018 Curve has added bass and treble beyond that.

But yep, your response is certainly along the right lines generally to @Hayabusa
 

Dunring

Major Contributor
Forum Donor
Joined
Feb 7, 2021
Messages
1,214
Likes
1,280
Location
Florida
The test unit just needs a few Mr. Potatohead accessories to give it some personality!
 

solderdude

Grand Contributor
Joined
Jul 21, 2018
Messages
15,891
Likes
35,912
Location
The Neitherlands
Hi @amirm ,

I assume the mics are deep inside the fake ear here?

That's why we see the "hump" in many measurements for neutral headphones, in the 1-5 kHz region ?

cc @solderdude

That is a combination of factors.
Concha (the small 'cup' in the pinna surrounding the ear canal entrance), the pinna flange (the outer ear part) and ear canal and ear drum.
ear-resonance-1024x683.png

Torso and neck as well as headshape is not relevant when measuring headphones but has to be taken into account when it concerns mimicking the tonal balance of speakers.

When measuring on-ear the pinna flange effect is 'bypassed' but when looking for a target it has to be taken into account and on-ear headphones thus should have a small 'boost' in that range to give someone the same tonal balance as an over-ear. The difference is very small though so there are no separate 'targets' or compensations for on-ear.

When measuring IEM and earbuds the concha is also 'bypassed' hence an IEM target has less 'hump' at around 6kHz. Basically only the ear canal and ear-drum are being 'used' but to get the tonal balance of speakers 'right' the other effects still have to be incorporated in the FR of the IEM itself.
Add to that insertion depth and the nozzle 'shortening' the ear canal which changes the red trace (shifts it and changes amplitude) but again, when this change is incorporated in the design we still get a good 'tonal balance equivalent' of speakers in a room (Harman) or speakers in anechoic conditions (without the Harman bass boost and slightly different in the upper midrange/treble.

The black total ear gain curve above thus is only valid for measuring sounds coming from a distance. For headphones and IEMS that 'curve' should be kind of matched to get a similar 'tone' as if one is listening to speakers. So for that reason a speaker 'correction curve', 'headphone curve' and 'IEM/earbud' correction curves have to be different in order to get to the same 'target' response (the black line) of sounds in front of you.
Harman adds bass to that 'target' for perceptional reasons.

Now... the plot above is only an 'average' and valid for an angle of sound coming from a 45 degree angle ONLY.
It differs a bit from person to person as well as sounds coming from a different angle.
With headphones sounds come from the sides and that has to be compensated for as well. The plot above for sounds coming from the front or sides thus differs a bit.
The concha, pinna flange react differently coming from the sides as coming from the front changing the 'tone' and phase which helps the brain locate sounds.

Long story short.. The 'hump' between 1-5kHz in raw plots taken with HATS or using a pinna + earcanal simulator is indeed responsible for the hump and test fixture dependent.
So... there is no single 'correction' (including target or not) for all different HATS but each HATS/test fixture has its own depending on the used components inside.

For this reason I prefer to see 'corrected' frequency response plots as these are more intuitive and look like 'speaker' plots. The individual 'corrections' per test fixture have been 'removed' from those plots and closely resemble how the headphone is perceived.

So.. the plot below. In Amirs case this plot is the result of raw measurement + correction (that what has been altered by the ear which has to be 'undone' again) + Harman target (boosted bass mainly)
index.php


This is how Harman lovers (those that like a bit of bass boost, thus about 60% of the population) perceive the tonal balance. Without the Harman target there would be more bass and a slightly different tonal balance.
 

DualTriode

Addicted to Fun and Learning
Joined
Oct 24, 2019
Messages
893
Likes
593
Well it woudn't be the 45CA-10, as that's the version without the head. Harman used the Kemar (dummy head) version, which would have allowed some of the HRTF to have been transferred from the head to reflect in the measurements that were made at the dummy head eardrum. Harman also used a slightly different pinna to any that you can really buy today, so that wasn't quite the same........the pinna that Amir/Oratory use I think is a good likeness to the one used by Harman, but I don't know by how much....I do know the original pinna used by Harman wasn't very flexible (pliability), but I suppose shape is more important when it comes to the creation of the Target Curve.

Also, it's only the Harman Headphone 2013 Curve that has the bass levels & treble levels that would be seen as a direct measurement of a "Harman Curve Speaker" in a room, as the Harman Headphone 2018 Curve has added bass and treble beyond that.

But yep, your response is certainly along the right lines generally to @Hayabusa

Please read the Harman AES papers.

What is measured at the microphones of the 45CA is the direct result of measurements and human subjects listening to "ideal" speakers in a "ideal" listening room.

Sure there are details in between and as you say it was not @amirm 's or my 45CA test fixture sitting in that room.

However what the 45CA microphones target is the Harmon Curve.

As I said, read the Harman AES papers for the details.

There is no "yes but"

Thanks DT

Note:
This was typed 11 hours ago. Now I press the reply button.
Oops
 
Top Bottom