9 Comments

When people who own gear priced in the thousands of dollars encounter similar gear priced in the hundreds of dollars, human nature practically forces them to disparage the cheap stuff. So I wasn’t surprised to see a few professionals disparaging the new miniDSP EARS headphone measurement jig on social media. I chimed in myself, predicting that the EARS might be part of an ongoing “crisis in headphone measurement.”

The EARS costs just $199 USD. The next-least-expensive headphone measurement rig I’ve seen, the G.R.A.S. 43AG I own, runs somewhere around $7500 if you get the latest options. (That’s my educated guess; G.R.A.S. doesn’t publish prices.) The G.R.A.S. 43AG conforms to IEC 60268-7, the current international standard for headphone measurements, while the EARS doesn’t seem to conform to any standard.

But does it really matter? I know a few headphone designers who dispute the utility of the standardized headphone measurement gear now in use. They prefer simpler, home-grown measurement setups, often a standard measurement microphone installed in a flat plate.

EARSThe G.R.A.S. Model 43AG (left) and miniDSP EARS (right) setups

The miniDSP EARS is intended primarily for use with miniDSP’s HA-DSP, which has an internal digital signal processor that can be used for EQing headphones to a desired response, but I have to think the company knew that use of the EARS might go far beyond that. While the EARS manual cautions users to “Please note that EARS is not an industry-standard measurement head,” miniDSP states on the website that “EARS brings headphone measurement capability to ‘the masses’.” So they’re not exactly positioning the EARS as a substitute for standardized gear, but as I expected, at least a couple of headphone reviewers have already bought the EARS and started using it for measurements in reviews.

There’s no question that the 43AG has much more engineering and manufacturing cost built into it. It incorporates an ear simulator engineered with IEC-compliant resonating chambers that mimic the acoustical properties of the average human ear, and it uses simulated pinnae modeled on a couple of different average human earlobe shapes. The EARS, on the other hand, is just a couple of inexpensive electret condenser microphone capsules attached to molded pinnae that, while obviously similar to human earlobes, have a thick, meaty, stiff feel, as if they were modeled on the earlobes of heavyweight boxers who’ve spent too many years in the ring. It has no simulated ear canals, just straight tubes molded into the pinnae, and there’s no way to affix an industry-standard calibrator to set and check levels. (The microphones themselves are calibrated, so you can set levels, although you can’t easily check them against a reference.)

EARS on-earThe stiff, thick simulated pinnae on the EARS make it difficult to get a good seal with on-ear headphones such as the AKG N60 NCs.

One advantage over the 43AG is that the EARS incorporates simulated left and right ears, whereas the 43AG can measure only one side at a time, using simulated left and right pinnae that fit into the fixture. An industry-standard ear simulator with left and right ears starts at about $12,000.

So . . . $200 versus $7500? Could the 43AG really be worth nearly 40 times the price of the EARS? The only way I could know for sure was to buy the EARS and try it for myself.

EARS in-ear setupAn Acoustic Research AR-E010 earphone mounted in the EARS

Using your EARS

The EARS has USB output only, so it’s designed to connect to computers, and thus to work with measurement software such as Room EQ Wizard and TrueRTA. Interfacing it with a typical outboard audio analyzer, such as the Audiomatica Clio 10 FW I use, requires passing the EARS signal through the computer and sending it out to the analyzer through the computer’s analog outputs, or through a USB interface. I was able to get this to work, but it introduced latency and seemed to add some noise, so I decided to stick with Room EQ Wizard for my EARS evaluation. In fact, the instructions in the EARS manual -- a thoughtful and informed document that’s far more useful than the perfunctory documentation accompanying some pro-level measurement gear -- assume you will use REW, and explain in detail how to configure REW for the EARS.

The microphones inside each EARS pinna are individually calibrated, and you can download the files for free. You can get the straight microphone calibration files, or calibration files with compensation curves included. Here’s what’s offered:

HEQ: This allows users to EQ headphones for subjectively flat response, although the target curve for that flat response is not specified, and the manual stresses that the user must choose an EQ curve based on what sounds right to them.

HPN: Same as above, but with a somewhat different target curve.

IDF: Diffuse-field compensation for earphones. This uses the industry-standard (although recently disputed) diffuse-field compensation curve for earphones.

RAW: Microphone calibration curves only, with no compensation.

For my tests with headphones, I mostly used the RAW calibration curves only, because my goal was to test the fixture, not the compensation curves. (Any compensation curve can be used with any software and any fixture.) If you’d like to see more extensive testing of the target curves used with the HA-DSP amp and a variety of headphones and earphones, let me know in the comments section below. I did use the IDF calibration, along with the RAW calibration, to test earphones.

How the curves compare

I decided to try the EARS with four different types of headphones: a standard over-ear model (Sony MDR-7506); a large, high-end over-ear model (HiFiMan HE1000 V2); an earphone (Campfire Comet); and an on-ear model (AKG N60 NC). I measured each of them using the EARS and my G.R.A.S. Model 43AG (using G.R.A.S.’s RA0402 ear simulator and KB5000 simulated pinna). In every case, I did as I always do, running multiple frequency response tests until I settled on what seems to be the most typical response of the headphones on that test fixture.

MDR-7506

I first tried the EARS with Sony’s MDR-7506 headphones, because they’re something of an industry standard and their response is close to the so-called Harman curve, which is gaining acceptance as a suitable target response for over-ear headphones. When I ran my first measurement of the MDR-7506es with the EARS, I thought “yep, looks like 7506es” -- and that’s a good thing, because even though the graphs of Room EQ Wizard and the Clio 10 FW look different, the basic characteristics of the MDR-7506es’ response were evident.

There were some differences, though. The EARS show a much stronger peak (roughly +8dB) at 4.5kHz, relative to the Model 43AG. Also, the EARS show 1 to 2dB more average output in the treble, and 4 to 8dB more average output in the bass -- but those differences are extremely sensitive to the position of the headphone on the test fixture, especially in the bass. I could have gotten similar disparities simply by moving the headphone around on the Model 43AG.

HE1000

I then switched to the HiFiMan HE1000 V2s, mostly because I wanted to see how larger headphones would work on the EARS. In the above graph, we can see that the differences between the EARS and the Model 43AG were similar in ways to the differences we saw with the MDR-7506es. With the EARS, there’s strong peak centered at 4.2kHz, while the Model 43AG shows a dip. (These narrow, high-Q peaks and dips are very position-dependent.) Again we see an increase in average bass response with the EARS (although the magnitude of the increase is much smaller this time), but we also see a reduction in average upper-midrange/lower-treble response with the EARS, typically -3 to -4dB between 1.4 and 3.5kHz.

N60 NC

With on-ear headphones such as the AKG N60 NCs, the stiffness and thickness of the EARS’ simulated pinnae starts to become a problem. The curves are mostly close, although again we see stronger measured treble response in the 4 to 6kHz region with the EARS. Where we see the big difference is in the bass response, which is highly dependent on the seal of the headphones’ earpads on the simulated pinnae. The N60 NCs can’t seal as well with the stiff pinnae on the EARS, so the measurement shows a feeble bass response that’s down 20dB relative to the measurement with the Model 43AG. I tried pushing against the headphones’ earpiece with my hand to get a more realistic bass response measurement, but it helped only a little. (The squiggles you see in the yellow trace are noise, probably caused by vibrations from my hand.)

Incidentally, the measurement with the Model 43AG was taken without using the fixture’s spring-loaded clamping mechanism. With most on-ears, I measure by experimenting to get the best possible seal, then applying the clamping mechanism to seat the earpads firmly on the simulated pinna, then flipping the clamp back up. This seems to give me the result that most accurately reflects the perceived bass response of most of the on-ear headphones I’ve measured.

Comet

The acoustic interface between the EARS and earphones such as the Campfire Comets is even more questionable. Not only are the simulated pinnae unnaturally stiff, but they terminate in a straight, round hole measuring about 6mm in diameter and 12mm deep. This is an extremely crude simulation (if it even deserves that designation) of a human ear canal, so the fit of earphones won’t be natural.

To be fair, though, the fit of earphones in the KB0065 pinna originally included with the Model 43AG wasn’t natural, either -- it, too, terminated in a round hole, although the round hole covered an RA0045 ear simulator, which mimics the acoustical response of the average human ear. Until the new KB5000 anthropomorphic pinna was released last year, I had to measure earphones using the RA0045 and a conical, stainless-steel coupler, which, while it made it simple to get a good seal with most earphones, also didn’t present a realistic simulation of the shape of a human ear canal. And while the KB5000 is a wonderfully useful upgrade to the Model 43AG, you can buy about four EARS setups for the price of one KB5000.

I measured the Campfire Comets using EARS with the IDF compensation curve and without. Not surprisingly, the IDF measurement looks far different from the uncompensated Model 43AG measurement. However, by using the EARS with microphone compensation only, and excluding the diffuse-field compensation, I got a curve that somewhat resembles the Model 43AG curve, although it shows substantially less average bass and treble energy.

Judging the EARS

The differences in measured frequency response curves between the EARS and the Model 43AG are significant. So, though, are the differences between the Model 43AG with the KB0065 and KB5000 pinnae, which you can see from the headphone measurements we’ve published in the last year. Most of the other manufacturers of headphone-measurement gear have introduced their own anthropomorphic pinnae, and also introduced new ear simulators (such as the G.R.A.S. RA0402 I now use) that provide more useful results at frequencies higher than 8kHz. These are all welcome improvements, but they produce different measured results than we got with the older gear. The fact is, with headphones and earphones, we don’t have a clear reference for what constitutes a “correct” measurement.

With speakers, we do have a clear reference for accurate measurements: a calibrated anechoic chamber, something most large audio manufacturers possess, which is used for the speaker measurements on the SoundStage! sites. If a measurement that purports to capture the frequency response of the speaker alone (not the response of the speaker in a room) deviates from anechoic response measurements, it’s wrong. If a speaker’s anechoic response shows significant deviation from flat on-axis and gradually, smoothly rolled-off off-axis response, we know that speaker will have audible colorations. It doesn’t take much expertise to evaluate these curves; if it deviates much from flat, there’s an issue.

With headphones, we can’t be so sure. Even industry-standard fixtures produce frequency response measurements with large peaks and dips that can be interpreted only with considerable expertise, and through comparisons with other headphones or a standardized target curve, such as diffuse-field or the Harman curve. Even after measuring headphones and earphones for seven years now, I’m careful about judging them from the response curves.

What worries me is that many of the people who spend $199 for an EARS (which for audio enthusiasts counts as an impulse buy) won’t be so careful. I’ve already seen one EARS-owning reviewer state on Facebook that “there are no standards” for headphone measurement, even though those standards have been in place for decades. I know from 29 years of experience in editing audio product reviews that extremely few reviewers dig deep into the research that’s been done on the product categories they’re reviewing. Are the same people who buy the EARS going to take the time to read the IEC 60268-7 document that stands as the current reference for headphone testing -- especially considering that the current $281 price for a PDF of that document is more than the price of the EARS? I doubt it.

Personally, I can’t get much use out of something like the EARS, and no serious reviewer can, either. If we want to have enough credibility to raise concerns when we find anomalies in our measurements, we must be able to compare our results with those of manufacturers and researchers. To be a part of the “measurement community” -- audio professionals around the world who develop and conduct audio measurements, regularly attend technical conventions and seminars, and collaborate frequently, even with competitors -- we have to have measurement gear built to professional standards.

Considering the unpredictability of the results with the EARS with earphones and on-ear headphones, I certainly wouldn’t judge the performance of those products based on measurements taken with the EARS.

With over-ear headphones, though, I’d be more forgiving. A careful, diligent reviewer who takes the time to understand what the measurements mean could, I think, produce useful frequency response measurements of over-ear headphones using the EARS -- provided they present a comparison of those measurements with measurements of other headphones (especially well-known references such as the Sony MDR-7506es, or maybe the Sennheiser HD 650s) taken under the same conditions. To me, it’s akin to making in-room speaker measurements -- it’s never as useful or as accurate as doing anechoic or quasi-anechoic measurements, but if you know what you’re doing, you can get meaningful measurements with just a couple hundred dollars’ worth of gear.

As I see it, the “killer app” for the EARS is for over-ear headphone DIYers who physically modify their headphones in pursuit of better sound. With the EARS, they can easily (and, I think, accurately) gauge the results of their modifications relative to the unmodified version, thus saving themselves many hours of trial and error, and almost certainly achieving better end results.

The EARS would also be useful for gauging the effects of EQ changes when using the HA-DSP or other EQ-equipped devices or software. Of course, whether or not those EQ changes are a good idea ultimately has to be determined through listening, but maybe by using the EARS, you can figure out what kind of response you like and derive EQ curves that replicate that response with other headphones you own.

Only time will tell how people use (and abuse) the EARS, but overall, I think it’s a positive development. The evaluation of consumer audio products is a field that’s packed with opinions but mostly bereft of science and technical understanding. Despite the EARS’ flaws and deviations from professional standards, I’m optimistic that they’ll make it possible for headphone enthusiasts to attain a richer understanding of their hobby -- and there’s no way that can’t be a good thing.

. . . Brent Butterworth
This email address is being protected from spambots. You need JavaScript enabled to view it.

Say something here...
You are a guest ( Sign Up ? )
or post as a guest
People in conversation:
Loading comment... The comment will be refreshed after 00:00.
  • This commment is unpublished.
    · 2 years ago
    Very informative, easy to read article. It's gotten hard to find reviews of any kind that are critical and detailed yet objective and fair/ that point out the author's biases where necessary.
    Those last paragraphs showed nicely that you didn't lose sight of the product's (presumably^^) intended purpose.
    So many professionals with access to professional gear just pick lower tier products apart and forget to circle back and answer the initial and most important question(s): Does it do what it says on the box and is it reasonably priced for what it's actually capable of. What can you really use it for and who should buy it?

    I just ordered an EARS so I can tinker with my small collection of midrange headphones. Within the closed bubble of my headphone collection and listening environment absolute numbers matter very little, but being able to easily make measurements that I can trust to be accurate relative to a baseline I measured myself with the same equippement ... that's pretty convenient and a total game changer for me.
  • This commment is unpublished.
    · 4 years ago
    Great Article! It helped me to make a purchase choice. I actually need to compare headphone amplifiers for an installation. For me this will work

    Thank you
  • This commment is unpublished.
    · 5 years ago
    I'd use the Behringer ECM8000 to test the closed headphones. Its as good enough rather than using nothing to see roughly what the frequency is even using a bit of blu-tac, as well.
    • This commment is unpublished.
      · 5 years ago
      Mounted in a plate, a standard measurement microphone can deliver useful results for comparison purposes, but those measurements won't be comparable to measurements made using professional gear. Fine for headphone tweaking, I think.
  • This commment is unpublished.
    · 5 years ago
    I believe a pair of Behringer ECM8000 and entry level field recorder would have a similar audio quality to let's say "GRAS 45CC" model. Why would waste money on a more expensive gear?
    • This commment is unpublished.
      · 5 years ago
      Neither of those would work for headphone measurements; the ECM8000 is a decent microphone, but how would you interface it with the headphone, and how could the field recorder analyze the audio signal? Tyll Hertsens probably wrote more about headphone measurements than anyone, and certainly did more headphone measurements than any other journalist. His work is freely available on InnerFidelity.com. I recommend it: https://www.innerfidelity.com/headphone-measurements-explained
  • This commment is unpublished.
    · 6 years ago
    I bought an EARS along with an HA-DSP and have ben able to use them to create EQ curves to improve the sound of three headphones: the Focal Elex, the Hifiman HE-400i and the Audio Technica M50x

    I try to only EQ those areas that seem as the EARS is measuring properly. By comparing my measurements to others online, I can see where there are similarities, and those are the areas I try to focus on.

    With the Elex and 400i, the bass measurements seem to be fairly consistent between the EARS and what I see online. I have been able to EQ them have much better sounding bass by gradually increasing the bass to more closely resemble the Harman Target.

    It is more difficult to get consistent measurements with the M50x. I suspect it is because they are closed-back and smaller. However, after much trial and error I have been able to get areas to look close to what I see online and have been able to EQ them to sound better (for example, reducing the mid-bass hump in these headphones).

    So many people online like to talk about the differences that an amp or a DAC can make. But these devices so rarely produce any measurable differences and I seriously doubt most could pick these things out in a blind test. This combo from mniDSP is one of the first electronic products that can be used to actually make a difference. I feel like these products are such a great step in the right direction towards allowing audio enthusiasts to tweak and actually improve their sound.
  • This commment is unpublished.
    · 6 years ago
    How does the EARS do though for measuring headphones and then applying an inverse EQ correction as to improve the sound quality of the headphone? Strangely, this wasn't really mentioned in the review!
    • This commment is unpublished.
      · 6 years ago
      With over-ear headphones, that should work fine, as long as your target curve is compensated for the EARS. The best thing would be to measure the headphones you want to mimic using the EARS, then measure the headphones you want to EQ to derive the correction curve. For example, if you want Harman curve, measure a headphone that's close to Harman curve (such as Sony MDR-7506 or AKG N700NC), then EQ the other headphones to match that response. I wouldn't do it with over-ear or in-ear models, because the EARS doesn't do a good job of measuring those.
  • This commment is unpublished.
    · 6 years ago
    I know it really doesn't matter much online, but at least now I'm not upset with you Mr. Brent. This article is objective about what gear like the EARs can do, the FR leaves no room for subjective BS. Even so I still think measurements made by amateurs can if compared internally be of some use for readers.

    The objective measurements from Soundstage are important now that we "lost" Tyll from Innerfidelity. I really really dislike the new subjective editor of the place.

    Also I'm sorry for being so "hard" on my blog post, but your first article triggered me in a way very few did until now.
    After this last article I must admit I was probably wrong about your stance on amateur measurements. It must be hard for a professional having amateurs attacking a defacto industry standart, it shouldn't be like that.

    Have my best wishes.
    • This commment is unpublished.
      · 6 years ago
      Thanks, Rafael, but I wasn't offended or upset. I have gotten a lot of criticism from a lot of people on the web and I thought yours was polite and well-reasoned. I generally encourage amateurs to do measurements, and when I see those measurements, it makes me embarrassed that so few "pros" do them. I just want to make sure they use their gear wisely and understand the measurements they're doing. I did an big article years ago on how amateurs can do meaningful speaker measurements. Scroll down on this page to "Speaker Measurements 101": http://www.brentbutterworth.com/writing.html
  • This commment is unpublished.
    · 6 years ago
    Great info, Brent! Nice to see a comparison...

    Personally, I am torn on the concept of an ear simulator. I know for those who 'want exactly what we hear' in a measurement, then the GRAS unit is about the best. But IMHO, for engineering development and comparative measurements as changes are made (or different models are checked), I'd want something like the 45CA - with as little pinna and ear canal structure as possible. Something to really measure flat (no high-Q resonant tubes or chambers) so that we can see in fine detail the acoustic result of small changes.

    I wonder if the EARS can be had without the simulated ear? Just a flat diaphragm, with the microphone as far forward as possible?
  • This commment is unpublished.
    · 6 years ago
    Thank you for your honest commentary. True Fact: To design quality products, you must test with quality products ~ it goes hand in hand. Quality does not come cheap!


    At GRAS, our passion is to advance the science of acoustic discovery.

Latest Comments

Doug Schneider 3 days ago Ollo Audio S5X 1.1 Headphones
@TylerCOne of our video guys, Jorden, actually has a pair. Be interesting to get his ...
@Alan LofftDid this get solved for you? I did notify David Chesky about your post.
TylerC 3 days ago Ollo Audio S5X 1.1 Headphones
Do you still recommend these? I see a pair on the used market. Thanks in ...
@Josh slootDo you recommend them as headphones? I looked at them.
Doug Schneider 3 days ago Meze Audio 105 AER Headphones
@TylerCVery good question!
Doug Schneider 3 days ago Beyerdynamic DT 770 Studio Headphones
@Josh slootCare to explain that usage of them more? Are you saying you used them as ...
TylerC 3 days ago Meze Audio 105 AER Headphones
I am wondering if anyone else found these dark sounding. I don't like bright headphones. ...
I struggled with this exact thought when I was buying headphones a couple years back. ...
Hi Brent and David, I ordered your new headphone test album back on the Halloween ...
Man I ran a set of these headphones as A Bluetooth speaker and they go ...