Thanks for replying.
It serves a few functions:
1. Sub-bass handling. I have a track that clearly reveals if deep bass is distorted, not played, etc. Interpreting this from distortion graphs is hard as just about every speaker has a lot of bass distortion. It is easier to just listen to this track and try to do the perceptual analysis from THD.
2. Using EQ to determine audibility of frequency response errors. To the extent it does, then it provides a simple method for owners to fix their speakers using those filters.
These two are great and make sense to have measurements for
3. Dynamic playback ability. I power speakers with a very high power amplifier. I then push them hard. Best speakers handle that with ease until my ears give up.
Others, start to complain in a very audible way. I should probably get more strict here with SPL meters and such but as a general test, it works.
This is like compression + SPL capability. Do you generally consider compression to be much less important and that is why you don’t measure for it?
4. For me personally to keep learning the correlation between frequency response measurements and subjective experience.
5. Providing a "wet thumb in the air" assessment of whether I like what I am hearing.
Wouldn’t these be improved (less biased) without seeing measurements?
I also understand that you have lots of other stuff going on and doing 2 separate listening sessions separated by measurements (which I think I remember you saying we’re done quite far from the listening room) is very time consuming for you and provides us, in your mind, with no additional value. From that perspective I can understand why you don’t do it. I can see the benefits of measurements in the first 2 points, as well.
I think this whole disagreement in method probably comes down to the underlying philosophy between people (Erin and Amir specifically) of what subjective analysis provides the most utility to the viewer.
(Note that the following is just a guess) I think both methods have unique qualities that cater to the different audiences with ultimate differences in goals. Erin’s content is posted in an environment (YouTube) where most viewers know little about audio science and people who click on his videos may not believe in, or know about audio science. By starting with subjective experience, he appeals to these viewers and provides a quite clear bridge for how subjective audio experiences can be more or less explained with measurements. To this end, I think Erin has done well in providing an easy bridge from subjectivity to objectivity.
On ASR, I get the feeling that the assumption is that people should have some background understanding in audio science, and the review methodology reflects this, providing subjective analysis that suits different goals.
Of course, I still believe that a mixed method between Amir and Erin is best, but obviously this is hugely time committal, (and I’m starting to repeat myself at this point). Am I off in my assessment here?