I like the idea of learning to listen and training.Only one (potential) taker so far in @Resolve ? Ok I'll open this up to not just headphone reviewers - @hardisj , @Gene DellaSala , @joentell , @napilopez , @John Atkinson , @Kal Rubinson , willing to give it a try?
I think hearing capabilities play a role as does our ability to accurately specify what we are hearing.
Yet another factor is be able to separate our personal preferences/biases from what's objective. How good are we at self-assessment?
Even after all of that, it is still difficult to communicate one's experience into words. In some ways, objective data is easier because you can just present it, and if you understand what you see, then good. But that's almost never the case. Some people will need help understanding what the data means and how it will translate to a real-world experience. That's where some subjectivity can also come into play when one has to pick and choose which data to focus on and which information carries more weight than what.
In the end, we are humans, not robots. I wouldn't "expect" someone to take my subjective opinions as a "useful data point". I would just think they would see it as a subjective opinion the way I see your suggestion as just a suggestion and nothing more. The subjective weight they would give to my opinion would be based on their trust in me, which is also subjective.
The only way that could be measured objectively might be to see how accurately I've assessed products in the past, but even that requires some translation. I would give myself an 80% accuracy score maybe. B grade. I watched an old review of mine today and thought I was too easy on the product, and would've said something different now. I would give myself an A for effort though. ;-) I'm trying my best.
I also want people to know that the expectations viewers have for us is not the expectations we set for ourselves. I started my channel just to "Show & Tell" stuff I thought was cool. I didn't call myself "New Consumer Reports" or anything like that. I don't know that it's fair to expect all reviewers to be like Audio Science Review. That's why I'm happy this place is here, and Amir is doing what he does. I understand there's some responsibility that goes along with the growth of my channel, but that doesn't mean I should have to change the entire purpose of my channel because of relative success.