Yours is a common misconception, to think that cognitive bias is mainly relevant to barely audible differences, and that when the differences are clearly audible, sighted listening is suddenly all about the sound waves.
It isn’t. Pure and simple.
Yes, absolutely! As I've often pointed out in the "subjectivist" forums:
Look, if people can imagine they've been anally probed by aliens, don't you think an audiophile can imagine less "midrange glare" with a new AC cable? Or that one expensive speaker sounds better than a cheaper one? People truly don't often grapple with the power of bias. It's not only a factor for teeny differences.
That said, there IS still a difference between justifying our inferences in sighted conditions when we know sonic differences DO exist in the type of gear being evaluated, vs areas in which they may not (subtle differences), or do not exist.
As I have often pointed out "bias" can't explain everything, and we have to keep in mind that while we can cite examples of bias, we can also cite innumerable examples of our perception "getting it right." You should never lose sight of either of those facts when deciding on a reasonable conclusion in any given circumstance.
To wit:
Put the same people in a room with unknown gear A and B, which definitely have sufficient difference to be easily detectable, and compare their assessments sighted vs controlled, and their sighted choices will be consistent with their cognitive biases, and their controlled listening choices will be consistent with what the measurements tell us they would likely choose.
Again...this is overstating the case. In no case is our perception perfect, so we are not going to hear as accurately as equipment. But we can ask: "Is someone, generally speaking, perceiving some TRUE sonic characteristics of a loudspeaker?"
For instance, a while back I had a chance to listen to some Audio Note speakers. I'd heard a couple of AN demos in shows that left me very impressed, and I'd auditioned a set of AN speakers that I also quite liked. It's rare to encounter the speaker brand so I was excited that a local shop happened to have a new pair set up that I could listen to with some of my demo tracks.
So if we are talking about what would be "constant with my cognitive bias" - I was very favourably disposed towards the brand, expected to enjoy the sound, and I also found the particular speakers quite attractive. So I had nothing but positive expectations.
But what I heard shocked me. It was terrible. Absolutely terrible. I'd never heard AN speakers sound like that. The frequency response was obviously scatter-shot, emphasized, steely, sharp highs, a very obvious peak, and clearly suck outs in lower mids - all voices were hollow sounding, female vocal tracks I knew like the back of my hand were thin, hollow and overly sibilant etc. I could not stand listening to them for more than 20 minutes. Whether it was a poor speaker design in this case or a room placement issue with nodes/frequency suck outs, or a combo...it was bad.
This does not seem predicted by the claim I would hear the sound as "consistent with my cognitive biases."
Now, of course, there are other ways in which we can perceive things inaccurately, other than what would be predicted by an expectation biases. Just by the way we use our attention we can hear things differently...things that can surprise us, seem contrary to our bias. (Which is what I have to constantly explain to subjectivists who say "but I didn't EXPECT the slightly cheaper cable to sound better than the ultra expensive cable, therefore what I heard was true, not bias!" No...you can still imagine things just due to how you alter your attention).
So even if my impression of the AN speakers wasn't an expectation bias, it's still possible at least it was some other form of misconception.
However, we have to balance against that other facts. We know speakers sound different. We know that frequency response errors are audible. We know that speakers often interact with rooms in a way that causes changes to the sound character, especially frequency response (suck outs, peaks, room nodes, reflections, etc).
You can't ignore one set of facts (we can perceive speaker response deviations) to only assume the other (our perception can be in error due to bias).
So here's one plausible explanation:
1. I had favourable expectations towards the loudspeakers, but in this case the sound REALLY DID exhibit an exaggerated frequency response problem that I heard, and that explains why my expectations were confounded, and why I could not listen to them for very long.
Or:
2. My impressions were purely some form of bias effect (as yet un-described); the "sound waves" were actually quite different from what I perceived.
I hold that the first explanation in this case is quite plausible and I'm justified in going with my impressions unless I get better evidence my impressions were implausible. I could be wrong, but that caveat is built in to any sighted listening inferences.
The point being, though, that without knowing the measurements of THAT speaker in THAT room in THAT set up, you can't ASSUME my description is inaccurate, and therefore simply down to a bias effect. We need to be wary of bias, and acknowledge it as a possible variable, and when we are seeking high justified confidence, we want to remove that as a variable. But we can't always just assume "it's just a bias effect causing the perception" as the default
truth or best explanation in all sighted listening.