I think you are a little bit in black&white.
Maybe so, but whether I am or not depends on the strength of the evidence that Toole's finding is weak. OTOH what you do next, instead of tabling such evidence, is to engage in philosophical truisms that are the hallmark of people who
hope a finding is weak, so they trot out truisms about the nature of the scientific method that they think justifies them picking and choosing from the hard work of real scientists, using little more than intuition and hope that common sense is all they need.
While nobody disputes most of the foundational work of Toole, on lateral reflections there are also different views, by people that are competent and have done their research.
By ' people who have done their research', you could mean audio researchers, or you could mean lay people who have looked up the internet. Big difference.
If they are genuine audio researchers of high credibility, odds are that Toole is well familiar with their work, and has assimilated their work into his general conclusions. If his working conclusion is different to theirs, it will be because he has balanced their work within a wider context and concluded that it has issues or is outweighed.
It is a mistake to view Toole as just another researcher A who has different opinions to researcher B, so we get to 'pick one' based on our layman's grasp, or lack thereof. Toole is an absolute doyen of audio research, and the level of his perspective and overview is probably matched by only a very few of his peers.
So, if you or others here want to challenge his conclusions, you had better have something a lot more material than trite truisms about science.
Psychoacoustics si developing science, let;s see what expanded version of Toole’s book brings up as new research and knowledge.
Certainly looking forward to
The Fourth Edition. But don't get your hopes up that it will
finally confirm that he was wrong in earlier editions in all the areas that you (and other ASR readers) found difficult to believe (usually because it contradicts your
sighted listening experiences or favourite pieces of gear).
If Toole was about to release a book that states that comb filtering off room surfaces has negative perceptual consequences and needs to be minimised for that reason, then he wouldn't have been reiterating the opposite in all the years since the 3rd edition. But he has been.
You know, even more famous scientists are making mistakes and correcting their older findings. Einstein’s core theories (Special and General Relativity) are still valid. However, his views on cosmology, quantum mechanics, and unification have either been proven wrong or are now seen as incomplete.
Again with the wishful thinking. Two points here. Firstly, that is theoretical science, whereas we are talking about experimental science. Data from experiments remains data over time, and it is hard to justify treating it as temporary in the same way as an early theory. Secondly, there are absolute frontiers of science where data is incredibly hard to gather (quantum, cosmos, etc) and theories are being formed while we are still learning ways to get to the data, and these theories are much more fluid than relatively well known domains where data is quite easy to gather and very unlikely to be disproven.
I certainly am certain that many here on ASR have much more knowledge about audios than I do and although I have a strong scientific background in my education I’m not an audio engineer. What I do know is that often times that findings from scientific research can be over generalized.
They can also be over trivialised: you only have to look in threads about products that seem to be overrated by their fans, and how they act when audio science fails to praise their product as much as they do. As far as I can tell, we are in one such thread right now.
People will form opinion based on research that does not actually apply to their circumstances and only applies to the specifics of the study.
That is why I prefer to simply state what a particularly-high-level expert has concluded from his overview of
all the available research. That is what I call a safe bet. It is not cast in concrete forever, but the chances of it changing materially in the future are low for a well-understood field like sound waves and DBT listening tests, and the chances of there being a better working conclusion
as of today are very low.
Two sets of research that is widely available that almost seems contradictory is the often quoted Floyd Toole research and that of Dr. Choueiri. Using their research the end user could get to very satisfactory audio systems through almost entirely different ideas.
There is no contradiction in the research: I am not aware of Toole denying the reality and effectiveness of binaural audio playback. If we had significant catalogues of popular and significant music being commercially recorded in binaural and released in binaural, then it becomes a 'very satisfactory audio system' and a legitimate sound reproduction technological option. But we simply don't. Until that happens, then a single-ended (playback only) binaural system is limited to the role of a sound effect generator. Like it as much as you want and call it very satisfactory, but it is not
sound reproduction. And one look at the title of Toole's books makes it clear that he cannot base his solutions on it in today's audio production industry.
cheers