As usual, you vastly overstate the actual results of the Toole-Olive listening tests.
Far from it: I do my best to fairly represent what Toole and Olive have themselves said about their listening tests.
You are the one who seems to on a campaign of misrepresenting their tests to draw your personal convenient conclusions that just happen to be pretty much the opposite of what Toole and Olive have themselves concluded on the overall topic, ie integrating numerous test results and various experiments, by themselves and others, to a general conclusion on a topic. You don't like that conclusion, so you are on a campaign to white-ant their views, for example by cherry-picking one graph below and completely twisting a desired conclusion from it, as I have discussed below the graph.
It has crossed my mind to wonder why you whould choose the "anti-science / weaponise science against itself" approach, given that you are after all a PhD in Physics at Stanford with 40+ years of experience as a professor at an R1 university and you have authored many research papers. My
normal experience of highly regarded scientists is that they are personally modest and would never dream of stomping all over the findings of scientists in a field which is not their field. But I guess they are not all so self-effacing.
Here is a key figure from Toole's book (p.385, 2008 edition):
View attachment 465273
As can be plainly seen, the results of blind vs sighted listening are very similar in terms of relative ranking, with only the ranking of the "small sub/sat system" changing significantly (from a tie with "US competitor" when heard blind to not as good when heard sighted, but both ranked below the two European speakers when heard both blind and sighted).
So: while the data shows that there is a visual bias effect (that varies with both the situation and the person), your claim that it "dominates" judgment of the actual sound is not supported by data.
...and here is Toole's own text around the above graph that you say refutes claims that sighted listening is not about the sound waves:
"
A widespread belief among audio professionals is that they are immune to the influences of brand, price, appearance, and so on. They persist in conducting listening evaluations with the contending products in full view.
... Holt commented as follows:
As far as the real world is concerned, high-end audio lost its credibility during the 1980s, when it flatly refused to submit to the kind of basic honesty controls (double-blind testing, for example) that had legitimized every other serious scientific endeavor since Pascal. [This refusal] is a source of endless derisive amusement among rational people and of perpetual embarrassment for me, because I am associated by so many people with the mess my disciples made of spreading my gospel.
...In general, though, what listeners saw changed what (they thought) they heard."
And Toole's own summary of that section of the book (my bold):
"
Summarizing, it is clear that knowing the identities of the loudspeakers under test can change subjective ratings.
- They can change the ratings to correspond to presumed capabilities of the product, based on price, size, or reputation.
- So strong is that attachment of “perceived” sound quality to the identity of the product that in sighted tests, listeners substantially ignored easily audible problems associated with loudspeaker location in the room and interactions with different programs."
and,
"
These findings mean that if one wishes to obtain candid opinions about how a loudspeaker sounds, the tests must be done blind."
How much clearer can he be? And yet
your lesson from it was your post above????
As any third party reading this can see (I am not confident that you can), Toole's extensively contextual commentary around that graph leads to the diametrically opposite conclusion to the one you attempted. Whereas my summary, which you say is vasty overstated, is actually very accurate.
I don't know why you are doing this. After all, you
posted exactly the same misinterpretation of exactly the same graph in 2022, and I
corrected it with Toole's own commentary of his own graph. To which you
replied, "I ignored the words, looked only at the graph". I must say I admire the confidence of a non-participant observer who contradicts the researcher's own interpretation of his own data, based on one graph. Not only that, but the graph itself actually supports Toole's argument (what a surprise). After all, two of the three large speakers were visually identical, and their ranking relative to one another was exactly the same sighted vs unsighted. Whereas the score of each speaker, sighted, changed a lot from unsighted, going way up for the large expensive
home brand speaker, up a bit for the large expensive home nation but competition brand speaker, and down for the small cheap speaker.
Or maybe I do know why you are doing this. Back in
2021 you expressed the view, "
Of course it's possible to tell good sound from bad sound by listening alone." And you meant
sighted listening, because you backed it up with sighted listening anecdotes and the conclusion, "
I believe this experience was real." If you still stand by those conclusions, and you still stand by the use of sighted listening anecdotes as evidence that sighted listening is trustworthy, then you will do things like this, looking for little slivers of data from which you can extract a personal interpretation to support your intuitive/anecdotal assumption.... even if means insisting that a top researcher cannot interpret his own graphs, and that when I correctly summarise that researcher's conclusions, I am "vastly overstating" him.