[to Matt] ...To be fair, I do agree with you that we shouldn't necessarily dismiss everything Fremer says, but the way I see it is that we can listen to someone who's right about the facts perhaps 90-95 % of the time, or we can listen to someone who's right about the facts perhaps 20 % of the time (Fremer). So why would we listen to someone who's only right 20 % of the time?
And also, why would we want to listen to someone who's never willing to admit that he could be wrong - especially when he's wrong so often?
Agreed. If someone conducts reviews of gear exclusively using a proven-broken method, it is no service to the reader even if
some of their conclusions would have been the same using a valid method. Question: Which ones? Answer: Unknown. Conclusion: Thanks a lot.
The way the stereophool press goes about their business of reviewing audio gear, by intertwining it with music reviews of the music they played on the gear, is misdirection. First we find ourselves reading about the attributes of the music itself in terms of how the reviewer responded to it, using language appropriate to an art review, as a kind of a segue into what the gear 'does' with music of such attributes. The reader is led by the nose to think that, since it seems fine to review music that way, it is fine for gear too.
Remember, a gear audition is intended to be a
test, aka an
experiment, to determine the sonic attributes of the sound waves themselves when a piece of gear (device under test) is used in the audio gear chain in place of either a reference device or a competitive device in the marketplace.
Since it is an
experiment of sorts, it should be
experimentally valid. And yet, the experimental method used in audiophool reviews is demonstrably inappropriate if we want data that has a usable level of statistical confidence. The fact that
some pieces of that data would correspond to data gained via a valid experiment is irrelevant, because the only way to find out which pieces correspond with reality is
to conduct a valid experiment and compare, and since that is never ever happening in any one review of any one piece of gear, we simply don't know which data from the sighted listening test are really in the sound waves,
so it is worthless.
I find it hard to believe that some people here are
so biased in favour of a demonstrably invalid test, despite having it clearly explained to them multiple times over a period of years that the data does not support their ideas at all. And yet they persist in not learning, in dismissing quality evidence, and reiterating specious evidence-free argumentation using multiple debating tricks. These people can be debating champions, but remember, a debating champion is a person who is truly skilled at persuading people to accept their arguments, irrespective of whether the position they have been given to debate is true or untrue, right or wrong. All that matters is winning.
In a forum like this, where all we want to do is expose truths, a debating champion is an absolute menace. An obfuscator. A fog machine. And one of their basic tricks is to appear in the minds of the audience as always fair, always balanced, always reasonable.... so they can win. So my advice to readers is to
watch out for the endlessly argumentative member who tries to twist actual experimental evidence by independent researchers, and instead promotes personal anecdotes, quotes others making personal anecdotes, bed-time stories, and personal 'experiments' that seem to contradict independent experiments by third parties, and logical-sounding 'hypotheticals'. I suggest you push once or twice for real data, and if all you get is more of the same, walk away. Don't be seduced by intelligence being used to persuade instead of tabling evidence.
However, with speakers specifically, I think it's a type of product that we go listen to and see if we like them and then afterwards make a purchase, perhaps with the aid of seeing measurements. Of course, reading subjective reviews might whet our appetite.
I will admit that I would be much more likely to trust one of Fremer's subjective reviews of speakers than of amplifiers, cables, CD players, etc. We already know that the audible difference between speakers is much greater than that of CD players, amplifiers, cables, etc., hence it is also more likely that he will describe an actual difference rather than an imagined one.
Agreed, it does indeed look that way at first glance, but the available evidence is that the audibility of the sonic differences between speakers does not generally help us to suddenly be judging the sound waves themselves sighted. It just means that it is easier to be deceived. A bit like an AI's answer to a question: there are almost certainly going to be some truths in the answer,
and we know that, but the only way to find out which parts of the answer are true vs untrue is to go and fact-check them all. Which is not exactly helpful to the notion of relying on the AI to answer our questions.
[to Matt] Yes, biased people can also perceive real, audible differences, and yes, no one is immune to bias, but Fremer seems to think he is, and that's the point I was making - that people who believe in blind testing do so because they acknowledge that the visual aspect may influence them; Fremer refuses to acknowledge that he could possibly be influenced by anything else than the sound (not even volume level), and he will do mental gymnastics to his death to avoid acknowledging that he was possible mistaken.
I am aware that this is essentially an ad hominem argument, but that's the issue I have with Fremer, and I think it's the issue that most others here have with him as well - that he's so incredibly conceited and arrogant and adamant that he's right about absolutely everything he claims, when he's in fact wrong very frequently (but not always).
If he's wrong frequently, how do we know when to trust his statements and when not to?
Wouldn't it be much easier to trust someone who's right 90-95 % of the time?
I don't really mind that he is arrogant and conceited and has anger issues. The main thing is that I can see he is biased to such a degree that he frequently states untruths as fact. That is enough in itself.
... imagine that it was a biologist or a construction engineer who were wrong 80 % of the time. Would we listen to them? Or ask that engineer to build a house for us? Or have the biologist diagnose an illness for us?
Society has a very low tolerance of pharmacists dispensing wrong prescriptions, too.
Fortunately our hobby doesn't have the same level of consequences. But in a forum dedicated to finding audio truths, obfuscators can be dismissed out of hand.
cheers