• Welcome to ASR. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Are there any reviewers (YouTube, blogs) who solely relies on blind A/B tests?

kandamrgam

Member
Joined
Dec 21, 2024
Messages
96
Likes
38
I follow a bunch of reviewers on YouTube for assessing headphones, dacs and amps. But I am tired of these subjective comparisons which are sometimes quite ridiculous. Are there anyone out there who exclusively relies on blind AB or ABX testing to compare different products?

I know ASR exists on YouTube but I am not looking for just measurements. I also need subjective experiences but made rationally based on blind tests..

If not on YouTube, websites/blogs are also fine.
 
Last edited:
Some tips. First I'll just say that the below tips doesn't exclusively rely on blind AB or ABX testing BUT sometimes blind tests are performed. Many objective measurements appear in their videos.

Erin's Audio Corner. Mostly about speakers, sometimes interwoven with amplifiers. Measurements and subjective listening impressions. Sometimes Erin does blind tests, with amplifiers:


_______
Audio Masterclass by and with David Mellor. His blind test of DAC's is discussed in the thread linked below. David Mellor has a combined objective and subjective approach:
Screenshot_2025-10-06_164221.jpg


_________
Audioholics, a lot about home theater which doesn't interest me BUT also a lot about speakers AND subwoofers. Both objective measurements and subjective impressions. They also cover other things related to audio/hifi:

 
Last edited:
I just ignore and avoid the subjective stuff... Most "audiophile" resources are useless.

I'm all for it but the problem is, proper controlled listening tests are VERY time consuming. And you really need a listening panel or a series of listeners because some people can hear things that others can't. And when there is an audible difference, different listeners will have different preferences. More listeners also gives more reliable statistics.

It's more common in university or corporate research than as part of a review.

I'm sure Amir has done proper controlled listening tests. He has a video about it. But of it's not part of his routine reviews. It would eat-up too much time and it would only confirm what he hears in his sighted listening and backs-up with measurements.

It's often pointless since most electronics are better than human hearing. And the most common defect-weakness is analog noise and if the noise is audible you don't need blind-controlled listening.

With headphones and speakers, controlled blind listening can be useful but not ABX, because there is almost always a difference and you can easily identify X. Headphones also feel different and have different weight so if you have lots of experience with lots of different manufacturers you might be able to identify the manufacturer, if not the exact model.

A publication like Stereophile with a staff and a budget could do informal listening panels and I think it would be useful for each member of the panel to record their impressions before any measurements, and of course without knowing what they are listening to. But that would take courage and humility. ;) I only mention Stereophile because I know they have a staff to make a listening panel... Bind listening isn't "their thing". ;)
 
I’ve looked extensively and can’t find any definitive blind tests for products . I’ve come to the conclusion that the nature of the beast is that you can’t trust anyone as everyone has different perspectives and inherent biases. You can only listen as much as you can with your taste in music with your other components as far as possible and try to be honest with yourself. Only you are ultimately paying and listening to the product so only you can decide. Reviews can only give you an idea of what you might like to try.
 
There is No Theme Reviews channel on YouTube. He doesn't do blind tests per se, but doesn't give subjective opinions at all. His "sound review" part is very short, sometimes nothing at all.

There is this thread I came across https://archimago.blogspot.com/2024/05/part-i-high-end-dac-blind-listening.html, comparing apple dongle with a 3k and a 20k DAC. TLDR is people generally preferred 3k and 20k DAC over apple dongle, but there is no preference for 20k DAC over 3k one (no audible difference basically). I would be more interested in comparing expensive DACs with basic 100 dollar Topping/SMSL DACs.
 
I’ve looked extensively and can’t find any definitive blind tests for products . I’ve come to the conclusion that the nature of the beast is that you can’t trust anyone as everyone has different perspectives and inherent biases. You can only listen as much as you can with your taste in music with your other components as far as possible and try to be honest with yourself. Only you are ultimately paying and listening to the product so only you can decide. Reviews can only give you an idea of what you might like to try.
This is why measurements are so essential (hence: this forum)
 
Sure but independent blind tests would be better as ultimately we listen and that would be the ultimate proof. Dealers and manufacturers don’t have the incentive and reviewers don’t have the equipment and resources so we are left listening for ourself.
 
Sure but independent blind tests would be better as ultimately we listen and that would be the ultimate proof. Dealers and manufacturers don’t have the incentive and reviewers don’t have the equipment and resources so we are left listening for ourself.
of course, just too costly and difficult to be common
 
Back
Top Bottom