I noticed there were some back-and-forth about the legitimacy of hearing differences between some digital sources.
For me, digital is a solved problem, I use a benchmark DAC, and I don’t think about ”sonic differences between CD players/DACs.”
However, as I’ve mentioned before, I had some experience in the late 90s perceiving what seemed to be some obvious differences between some CDPs and a DAC. I’d been able to borrow various gear from friends or dealers and at one point I had the Meridian 508.20 CDP, a Museatex Bidat DAC (which had a volume control), and the good quality Sony CDP my wife and I had been using up to that point.
I was surprised at what seemed to be very distinct Sonic differences between each of them. But since it was general in my position, I shouldn’t hear a differences between competently designed digital gear, and understanding the possibility of bias effects, I did a blind test and I was able to easily identify each of them.
To get some criticism and feedback I presented the feedback and results online to a place where a number of engineers and “objectivists” hung out. Anybody here who goes back far enough might recognize names like Arny Kruger, Howard Festler, Stewart Pinkerton, and I believe our own J.J. was there as well.
I received some excellent feedback and constructive criticism as to how I could tighten up the test (which included switching from matching volume level using a RadioShack metre, to using a voltmeter to measure the speaker terminals to match output).
I redid my tests and presented those results again to the gang.
I’m just going to copy and paste my old post describing my attempts at the blind test and the results.
It might be mildly entertaining for some to read about an audiophile attempting blind testing at home, and also why it’s not exactly an easy thing to pull off. And of course I leave opinions of the test results up to the reader:
—————————-
—————————-
I wrote the original post entitled "My BLIND TESTof CD Players -
here’s the results…."
That post detailed my experience in hearing differences between my
Museatex DAC and my Meridian 508.20 in a blindtest that I
constructed. Many helpful types pointed out to me that the Radio
Shack meter I used was not the proper device to employ if I wanted to
match output levels with real accuracy. "Get thee a voltmeter and do
it right" they said. And so I went forth, and lo, I did find a
voltmeter.
I borrowed a voltmeter from the tech department at work (I work at a
large sound editing/mixing facility).
The sound technicians showed me how to work it, and best deploy it,
for my test.
I had been working up a sweat imagining having to beg my spouse to
help me in another audio-nerd test. In a stroke of luck, my
father-in-law happened to be around to help me do these tests. He’s a
classical music nut and owns a beautiful-sounding music system. He is
also a hard-nosed engineer, and does not bother listening to
components that should sound the same (re: amps, CD players etc.) -
his late 80’s CD player and amp are doing just fine, thank you.
Luckily he’s more sympathetic to the cause of good sound, and I was
able to squeeze many more test scenarios out of this session than in
the first one.
Right then. The test.
I chose a comfortable volume at which to listen, and used the
voltmeter to measure the level at the speaker terminals. My speakers
measured a few tenths-of-a-volt different in level, so I used my
pre-amp’s balance control slightly to even them out. I set both the
Meridian and the Museatex DAC to 1.72 volts. As in the previous test,
they measured the same, and I could not perceive a volume difference
between the two units.
The method we used was the same as the last test (as this was deemed
acceptable by the critics). He did not know which DAC was connected
to which inputs. I told him not to simply switch between the two
sources constantly, but to make the switching unpredictable and
‘random.’ A sans music pre-test showed that, with a few ‘fake’ switch
movements of the source selector in between source selections, I could
not reliably guess which source had been selected. I was blind-folded
and we did not talk to each other during the test, except when I said
"switch." My FIL (father-in-law), kept track of my correct and
incorrect answers.
Here’s the score for TEST A:
Meridian vs Museatex
Out of 18 trials
Incorrect Guesses: 1
Correct Guesses: 17
For some reason I guessed the first sound I heard as the Meridian, but
it was the Museatex. As soon as I heard the next choice I immediately
recognized IT as being the Meridian and knew I’d made a mistake, but
the incorrect guess was ‘on record.’
These units simply sounded different. All the differences I’d
mentioned in my first post were easily heard in this test as well:
The Meridian’s clearer, sharper sound, better image focus, higher
highs, excellent separation of instruments etc. The Museatex’s
bigger, lusher sound and deeper, wider soundstaging, it’s smoother
sound, and a dead giveaway being it’s bigger, deeper bass.
Interestingly, the Museatex displayed more of the original acoustics
of the recording - reverb trails and all - than the Meridian. I’d
have guessed the reverse - that the Meridian with it’s ‘extended’
treble energy would evince the acoustics more, but this was not the
case. (I’d noted this long before in my subjective comparisons).
Again, not HUGE differences, but distinct and detectable.
I’ve always felt that I perceived the differences between these units
even when I’m listening from another room. Aha, another test! I knew
that I’d hooked the Meridian to the CD input and the Museatex to the
Auxiliary input. So I listened from another room, about twenty feet
from the opening of the listening room.
My FIL manned the selector and I shouted my guesses as to which input
he’d selected.
Results of TEST B:
(Out of 10 trials)
Incorrect Guesses: none
Correct Guesses: 10
Again, as mentioned in my last post, the Museatex sounded smoother,
fuller, with bigger bass, but the Meridian sounded cleaner, brighter
and tonally more convincing. I’ve always felt that if I’m paying big
bucks for a source whose attributes disappear unless I’m sitting
facing the speakers, then it’s not worth my money. I listen too often
from various rooms adjacent to my listening/living room.
Next, I brought out my wife’s Sony CDP-295 CD player. It’s
approximately seven years old, and in excellent condition. I wanted
to test it against the Meridian and the Mietner because it is held by
many people that an expensive high-end CD player will not improve on
the sonic performance of a well-made mid-level Sony player (which this
is). Unfortunately, the Sony’s output level was SLIGHTLY lower than
the Meridian/Museatex. Since the Sony had no separate volume control,
we had to match the outputs using the pre-amp volume and mark beside
the volume pot how much my FIL had to turn it to match outputs (very
little). I realize this is not as perfect a set-up as the
Mietner/Meridian test, but my FIL was very good at getting within a
couple of 10ths of a volt using the pot marks (on our test tone).
Anyway, I’ll give you the test results:
(I started lowering the trial numbers, so as not to wear out my FIL’s
patience, plus it was more cumbersome: my FIL had to open and close
both CD trays at once so I didn’t know which unit was receiving the
CD. There was a CD in each machine - so that I always heard the sound
of two drawers opening and two CDs being removed, but I couldn’t tell
if a switch was happening.)
Results of TEST C
Meridian vs Sony
(out of 6 trials)
Incorrect Guesses: 0
Correct guesses: 6
Again, very easy. The Sony sounded flat, more electronic, less
detailed, less spacious, less real. The drum hi-hat on the Sony
sounded more like white noise bursts, whereas on the Meridian, the
drumstick and texture of the high-hat was more audible and natural.
The Meridian simply exceeded the Sony in all those areas that we would
deem ‘higher fidelity.’ When distant string lines entered behind the
singer, on the Sony
they were ‘colorless,’ flat, thin - I would not confidently tell if
they were synthetic, sampled or real strings.
On the Meridian the strings were better separated in the mix, with
tone and texture that immediately said ‘real strings.’ Subtle, but to
me, significant.
Next we tried the ‘Listening from the other room’ test. Here’s the
results:
TEST D
Meridian/Sony
(out of 12 trials)
Incorrect Guesses: 0
Correct Guesses: 12
‘nuf said.
Next up: Sony VS Museatex.
I figured this one would be the hardest, because there wasn’t anything
like the Meridian’s extended treble to cue me - both the Sony and the
Museatex seemed to have the same rolled off treble (relative to the
Meridian). However, once I heard the difference between them (even
level-matched) I could tell each apart.
Sony vs Museatex
(out of 8 trials)
Incorrect Guesses: 1
Correct Guesses: 7
Same thing as the first test - heard the Sony first and thought "
rolled off treble, must be the Museatex." But after hearing the
Museatex I recognized it and could identify it accurately. The
Museatex sounded fuller, lusher, bigger soundstage by far (relatively)
and deeper bass. The main thing is the Museatex just sounded more
rich, more ‘real’ in a way that allowed me to listen to the performers
as if I were eavesdropping in the studio. The Sony just sounded too
one-dimensional and electronic in comparison.
Must I say again - subtle sonic differences, big subjective effect.
OK, so there you are. I’ve tried to describe the tests exactly as
they occurred, with no fudging. If I wanted to confirm my biases I’d
just invite an audio buddy over to talk about how great my components
are. Instead, I wanted to confront my subjective biases to see if
they hold up in an objective test. Gimme the truth, I can take it, I
swear.
Any comments on these shenanigans?