Audiophile objections to blind testing - an attempt from a layman

[MRC01]

... You're correct that lack of audio memory is a difficulty in these tests, but "fast switching" is a solution that works. If you can flip back and forth between two audio devices quickly in a blind test, people can identify even small audible differences.

The fact that fast switching is necessary shows that audio memory captures a limited amount of detail, and those limits shrink quickly over time. Adding a delay as small as a few milliseconds measurably reduces test sensitivity, yet most people would say that a few milliseconds seems to qualify as "fast".

Certainly, fast switching is better than slow switching. But how fast is fast enough? This leads one to wonder whether the Y-intercept of that function is zero, or slightly above zero. In other words, even an instantaneous switch still relies on memory, comparing what you are hearing now (perception) to what you were hearing before (memory).

For example, by contrast, tactile comparisons can be done entirely perceptually without requiring an act of memory. You can touch object A and B with different fingers or hands comparing them simultaneously.

I'm not suggesting that blind testing is not useful. Clearly, it is! And it may be the best tool that we have. But it has its limitations, meaning one can't assume the sensitivity of the test fully equals the sensitivity of perception. Blind testing reveals the sensitivity of perception that can be demonstrated through short-term memory with statistical significance, which may be slightly less sensitive than perception itself. The fact that such short delays do reduce sensitivity, suggests this may be the case.

 

[kemmler3D]

Blind testing reveals the sensitivity of perception that can be demonstrated through short-term memory with statistical significance, which may be slightly less sensitive than perception itself. The fact that such short delays do reduce sensitivity, suggests this may be the case.

I think this is a good take - I think instantaneous switching is (luckily) feasible in many cases and it's clearly desirable. I suppose the length of the switch opens a corresponding gap of doubt.

By the same token, I'd say from long experience messing with DAWs (where instant switching is built-in and extremely common) that if you can't tell a difference with instant switching, you can stop worrying about there being a difference at all.

I also wonder if having more listening training and audio vocabulary can help with the memory thing. I feel like I have a good memory for how certain things sounded, even years later. But what I'm probably doing is labeling my reactions, like "bloated bass around 150hz" and then mentally re-creating what "bloated bass around 150hz" sounds like - I don't think I'm literally remembering the sound of that device.

Or maybe that doesn't help, maybe it just increases confidence in wrong assessments...

 

[jonrock]

Interesting topic and insights.
These 2 ABX posts come to mind regarding these matters, someone may find them useful.

https://gearspace.com/board/high-end/622491-antelope-trinity-10m-vs-internal-clock-comparison.html?highlight=Ev33+clock

Clock comparison by Eric Valentine, Greg Wells and others chime in.
The opinions before knowing the results and the outcome itself are gold.

https://gearspace.com/board/so-much-gear-so-little-time/1313339-heres-hardware-vs-plugin-shootout-ya.html

Charlie Clouser dares to do a Hardware vs Software showdown, Post number 13 shows Clouser's own opinion on the matter.

For the moment I am refraining from posting my own opinion because I am going to put myself through a litmus test:
- I am producing my own project/band which comprises instrumentals and sung songs (I do not sing, that is the job of my fantastic singer), we have shot a videoclip for our 1st single and it is close to go out in a matter of days/weeks
- the whole month of May I am traveling and will do all of my production away from my usual setup, we have already tracked some voices for 2 songs that I intend to complete in said month, as we have people from showbiz/radios/tv/etc very interested and we have to seize this opportunity
- I will travel with a powerful laptop, an RME soundcard, a small keyboard and (drumroll): Truthear Gate, Salnotes Zero, Crinacle Zero 2, Tangzu HBB Heyday.
I am only taking 2 from this lot with me and I have not yet decided which, so if anybody has something to say I am all ears
- I am excited to see how far I can take it solely with the IEMs and when I get back home, my usual setup will reveal the truth
- If completely finished with the IEMs, the songs will provide a fantastic ABX test for anyone to discern (or guess) how they were produced and mixed, if people are interested I would post them in various forums