Here is the evidence:
At Benchmark we ran an ABX test using a 1 kHz low-level tone. We compared a class AB amplifier to the Benchmark AHB2. The test level was 0.01 watt, producing an SPL of 67 dB at the listening position. The measured distortion produced by the class AB amplifier was reproduced at a level of 14 dB SPL. In contrast, the measured distortion produced by the AHB2 was well below 0 dBSPL (actual level was calculated at -21 dBSPL). Input voltages to the speaker terminals were set to 0.2828 Vrms using a precision volt meter.
Given these well-controlled conditions it was very easy to hear the difference between the two amplifiers in a fully-blind random ABX test. I scored 100% correct on every ABX test sequence I ran. Other listeners achieved similar results.
You can read the entire writeup here:
"Power Amplifiers - A "First Watt" ABX Test"
Given the results of this test, there is no question that power amplifiers can sound different even when they have respectable specifications at high output levels. This specific test shows that we should pay more attention to the 0.01 watt THD.
Thanks for this John.
IMHO the article needs to include measured frequency responses of the specific sample amplifiers used for this test, when connected to the speaker used for the test, measured at the speaker terminals. This helps to eliminate the risk that there is an audible difference in the frequency responses when connected to the specific speakers and cables as a system. (Of course if your test, as apparent from your article, was only of a 1 kHz test tone, then the FR measurements I described are not needed. But to only test with a single test tone is not good enough - see below.)
The article also needs to include 'baseline' ABX tests with no signal present, demonstrating that the amplifiers cannot be detected from their idle noise output alone. Because you haven't eliminated the possibility that they can be told apart based on idle noise.
Finally and most importantly, I don't see any evidence that you passed an ABX test when
playing music at 0.01 watts approximating 67 dB SPL. Audio research is littered with examples of artefacts that are audible with specific test tones, but inaudible when playing music. You have not conducted the 'test of truth' when the amp is being used for its intended purpose. This is especially disappointing because your article repeatedly describes in theory the effect
when playing music, but neglects to 'put it to the test'. "Musical details", "between the transient peaks", "change the harmonic character of musical voices", "add a fatiguing harshness". Many ambit claims, none of them tested.
Even your tone test, to be consistent with your article's references to music-playing between peaks, should have the 0.01 watt test tone interspersed by kick drum samples at 25-65 watts (per your article) and say, 110 bpm. Let's see if the ABX is "easy to pass 25/25" now. In contradiction to your ambit claims, I suspect that the ear 'turns the gain down' in these conditions and is less discriminating of the 'musical detail' level between the peaks.
Even then, it still is not good enough, if you want to claim that the effects are audible (not only audible, but
preferable...try that test), then you need to demonstrate it with typical music recordings....and backed up with measured frequency responses as per my first paragraph.
You need to re-test and re-write, if you want to do more than mislead (by drawing musical conclusions from test signal results).
cheers