• Welcome to ASR. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Cambridge Audio EXN100 vs Eversolo A8 comparison blind test.

[...]

Thanks again for the good feedback. I think I've gone well above and beyond. Let the "yeah but you didn't . . ." or "to do a real A/B test you have to . . ." be flung. The testing was valid.

If you repeated all the same mistakes already pointed out multiple times, it wasn't. Since you did not clarify on how the testing in the studio differed from your previous testing, nodoby is any wiser than before.
 
After your inital post, members explained to you in detail the errors in your testing methodology and why your results could not be trusted (improper level matching, long switching time, didn't make sure to use the same settings on both streamers, only semi-blind). And now you've repeated the test and repeated the exact same mistakes? Like... why? This just adds noise to the void.

Re read. They were matched. Switching was instantaneous and long. Settings matched as best can be done in my and your home. No mistakes.
Well... he's wrong. Just use test tones and a multimeter, get them to within 0.2 dB. Why use the provably worse method? And devices which measure identical also sound identical, measurements are not just a "hint". They are objective, reproducible truths. Your ears will tell you one thing today and another thing tomorrow.

He's right. We talked about more than just what I posted. Didn't want to post a novel.

Regarding today and tomorrow your statement is unprovable and thus subjective. Perhaps not yours but unless I've been operating heavy equipment, been at the range, have a cold etc my ears function identically day after day of course with normal hearing degradation over time. You can only speak for yourself. Anything else is an over reach. But we can quote internet facts all day.
It's actually pretty much the opposite: With devices like speakers, where there's a measurable difference, you need to like the sound. Agreed. With devices which are audibly transparent, like the vast majority of DACs (including those in streamers) and many amps today, you will waste thousands of dollars chasing "better and better sound" while you actually change absolutely nothing about the performance of your system. Choosing something which is provably transparent by trusting your ears is a fools errand and will lead you down a long, expensive and time consuming road of despair.

Not sure where you are going with this but with the exception perhaps of wire little is transparent. Certainly not differently designed DCS, amps etc. If that were true the selction of audio equipment might be greatly simplified. Perhaps you should step back and look at the many forum posts. Many people here and elsewhere are "chasing the perfect sound". To say people aren't is nonsense.

Provably transparent? By whom? Youtube? I doubt any DAC design engineer is going to agree with you. I just proved that at least these two DAC/streamers aren't transparent. But people like to argue and be right. Some might say I spent a lot of money and proved nothing. That's ok. Without knowing their qualifications and experiences to make that statement it's an opinion and again that's ok. I can also read and form one. We all can.

Hopefully some will find value in the testing.

Again thanks for the useful advice. I appreciated it.
 
Everyone needs a different DAC for every type of music, that’s obvious, its just a bit of fuss when you change genre.
Keith
 
Provably transparent? By whom? Youtube? I doubt any DAC design engineer is going to agree with you. I just proved that at least these two DAC/streamers aren't transparent. But people like to argue and be right. Some might say I spent a lot of money and proved nothing. That's ok. Without knowing their qualifications and experiences to make that statement it's an opinion and again that's ok. I can also read and form one. We all can.

I spent over 17 years designing the DAC section on a line of consumer A/V products. I agree with him.

Your testing is flawed. Flawed testing leads to flawed conclusions.
 
Everyone needs a different DAC for every type of music, that’s obvious, its just a bit of fuss when you change genre.
Keith

It's especially challenging when you listen to a fusion band that combines rock, jazz, and a little funk into one song.
How can a DAC or streamer possibly be optimized for that?

(:))
 
I spent over 17 years designing the DAC section on a line of consumer A/V products. I agree with him.

Your testing is flawed. Flawed testing leads to flawed conclusions.
Interesting. If you say so.
 
It's especially challenging when you listen to a fusion band that combines rock, jazz, and a little funk into one song.
How can a DAC or streamer possibly be optimized for that?

(:))
It is what it is. Challenging? Not really.
 
Re read. They were matched. Switching was instantaneous and long. Settings matched as best can be done in my and your home. No mistakes.
Not sufficiently. I quote:
I asked about using a multi meter to balance the outputs. He didn't feel that was required.
One the one hand "feeling" isn't quite knowing. But even then:
He's right. We talked about more than just what I posted. Didn't want to post a novel.
He's wrong. And you can test it yourself. And it would have cost you nothing to do it right the second time - I don't even know why you would still argue about this.

Regarding today and tomorrow your statement is unprovable and thus subjective. Perhaps not yours but unless I've been operating heavy equipment, been at the range, have a cold etc my ears function identically day after day of course with normal hearing degradation over time. You can only speak for yourself. Anything else is an over reach. But we can quote internet facts all day.
Hearing is just not a reliable sense in general. That's why outcomes of testing using that sense require additional scrutiny. Not knowning about the lack of reliability doesn't make it reliable.

Not sure where you are going with this but with the exception perhaps of wire little is transparent. Certainly not differently designed DCS, amps etc. If that were true the selction of audio equipment might be greatly simplified. Perhaps you should step back and look at the many forum posts. Many people here and elsewhere are "chasing the perfect sound". To say people aren't is nonsense.
I'm not saying people aren't chasing better sound, why would you suggest that? I also think I've made my point abundantly clear: Many changes in a HiFi system like switching one welll engineered DAC for antoher don't make any difference to the audible performance whatsoever. But people still believe they do - call it bias, placebo, whatever you want. You can hear changes where there are none. And if you don't realize that, you will continue to spend money on non-improvements forever.

Provably transparent? By whom? Youtube? I doubt any DAC design engineer is going to agree with you.
Proven by thresholds which were scientifically tested. Typically using level-matched double blind testing, ABX testing or similar proven and reliable methods. I doubt any DAC designer would disagree - because they rely on that very science to design and build those products.

I just proved that at least these two DAC/streamers aren't transparent. But people like to argue and be right. Some might say I spent a lot of money and proved nothing. That's ok. Without knowing their qualifications and experiences to make that statement it's an opinion and again that's ok. I can also read and form one. We all can.
The problem is that you did not prove anything and it has been explained to you half a dozen times why. Your testing was flawed, you ignored any advice to improve it. Good luck, then.
 
 
If you repeated all the same mistakes already pointed out multiple times, it wasn't. Since you did not clarify on how the testing in the studio differed from your previous testing, nodoby is any wiser than before.
It wouldn't matter to some if I did but . . .

The DACs outputs were standardized and output matched via their equipment and methods. Once done music was streamed via ethernet from the same lossless source. Their speakers are studio monitors with a flat response. I had no idea which machine was streaming. I listened to the same song same passage. Repeating both slow and quick switching. My choice was noted and we proceeded on.

The same for when I did the switching for the listeners.

Same signal in. Different sound out. The incredulity here is . . .

Guys it's not that hard. I'm not sure what all of the "astonishment" is about by the few.

But lets be honest clearly their is a belief held by some to be unshaken by real world facts. Opinions to the contrary are unacceptable.

These DACs stream some differently. I was there as were others. Were the naysayers?

Matched I've heard a difference, a classical pianist had heard a difference, a audio engineer has heard a difference, studio crew heard a difference. I don't hold to (a) belief because it is a popular one and skepticism is popular. I am compelled to belief because of the facts.

I had earlier emailed Amir on this and included his advice in with the testing methodology. Although I could not hear clear distinctions in all music it was quite evident in some therefore it must be there in all whether distinguishable or not. Therefore the DACs perform/sound (whatever the popular adjective is) differently. They likely all do but I can't prove that.

Through doubt and wanting clear evidence I've gone far beyond what many would do applying the valid advice and suggestions here and elsewhere. Sorry if some don't like the facts.

Had I shone that they are the same there would be no debate. Irregardless of my methods.

Facts. Proven qualifications. I don't put myself forward as any expert. I'm not. By no means. Nor do I quote sources elsewhere without verification. I seek expertise. There's an old saying in testing "trust but verify" It doesn't mean the person giving advice isn't correct but the burden of proof has not been met. Heck, I can say I drove a NASCAR car on Charlotte Motor Speedway. Prove I didn't (even though I did). Nor can I prove I did so unvalidated. I can't make the argument.

We can go round and round on this. I'm just throwing it out there. If someone wants to say oh no you didn't then again that's OK. I can't and am not interested in changing ingrained (popular) beliefs. But if someone can't prove what they are saying and just rinse and repeat then I'll tuck that in the opinion or interesting point bucket.

Challenge: let someone take these DACs and hours of very expensive recording studio time, with technically qualified personnel and disprove my results or prove theirs. Words are cheap. Opinions unlimited. Google not 100% reliable research.

Anyone? Anyone at all? Yeah, thought so.

Armchair coaching. You got to love the Internet.

I've (correctly) done what I needed, made a decision and shared so I'm done with this post and won't be monitoring it further.

If you want further details on the studio equipment, DACs or such message me.
 
Last edited:
Challenge: let someone take these DACs and hours of very expensive recording studio time, with technically qualified personnel and disprove my results or prove theirs. Words are cheap. Opinions unlimited. Google not 100% reliable research,
[/QUOTE]


Why repeat your flawed test? What would that accomplish?
 
Guys it's not that hard. I'm not sure what all of the "astonishment" is about by the few.
No astonishment. No-one is saying you definitely didn't hear a real difference.

But from what we know about the peroformance of the DACs involved it is pretty dammned unlikely. And given what you've said about the test method - your controls were inadequate to overcome that "pretty damned unlikely*

So we are left with nothing. Certainly nothing proven.
 
What is the problem if somebody wants to treat a music player like a musical instrument? A musical instrument is a mechanism or vehicle for creating sounds that evoke an emotional response. Now this is not the forum of audio emotion testing. But I would argue that all of the stuff that gets tested here is created, ultimately, to produce musical emotions. To me, saying that all the DACs you can buy nowadays are provably indistinguishable by their output is a real stretch. Maybe what they are is not provably different, a statement so lacking in specificity that it equally indicts the methods of testing and the hypothesis being tested.
Everybody has a golden ear - it is formed by the connections of that (complex) Organ of Corti to the emotional centers of the mind. And don't think for a minute that hearing is special that way - how about the senses of smell, taste, touch, vision... ALL the senses have emotional potential because those emotions reinforce the strength of memory, and through the course of evolution, emotions and the behaviors they helped to reinforce got humans where we are today. If the top 50 DACs on Amir's ranked scale of quality are provably the same, why do they even all exist, and why do people keep trying, trading, and buying different DACs until they find the ONE that they like best? Nobody can prove they can't hear a difference in their music. Can it be proven (informed by differing musical tastes, differing emotional responses to the sound, and the very different ways in which individuals choose to evaluate sound) that a very large random group of people represent a valid control group for a single random individual? Pffff... We're talking about music here. Let's celebrate some differences - they drive the industry and they drive the pursuit of excellence in music reproduction.
 
What is the problem if somebody wants to treat a music player like a musical instrument? A musical instrument is a mechanism or vehicle for creating sounds that evoke an emotional response
Great! That means that all the work is already done before you listen to it! The emotion was already captured by the recording engineers, performed by the artists, and refined in mastering and mixing. All of this with artistic freedom to do whatever they feel is right for their product.

Why would we need a playback device doing more of this? There is no need.

Playback != music making. You are not an artist.

If the top 50 DACs on Amir's ranked scale of quality are provably the same, why do they even all exist, and why do people keep trying, trading, and buying different DACs until they find the ONE that they like best?
Well captain obvious: because the whole industry wages a massive misinformation campaign telling us these products all sound differently. It’s a self fulfilling prophecy.

Nothing about any of those built up emotions are yours. They have been indoctrinated into you until you thought they were real by this industry. They’ve been telling their customers what to hear and feel for decades.

Let's celebrate some differences - they drive the industry
So you do know what this is about :facepalm:
 
Everybody has a golden ear - it is formed by the connections of that (complex) Organ of Corti to the emotional centers of the mind.
But here is the thing. That ear is neither infinitely sensitive nor has infinite bandwidth. There are sounds to low for us to hear, and frequencies to high for us to hear. Not just me, not just you - all humans.


And all those dacs tested - their imperfections are to low for us to hear - so there is no difference to be heard. It doesn't matter that our hearing is different or our emotions are different. If the sense organ is not up to the job of detecting the sounds that make them different, then there is nothing sent to the brain to evoke any different emotion.
 
If the top 50 DACs on Amir's ranked scale of quality are provably the same, why do they even all exist, and why do people keep trying, trading, and buying different DACs until they find the ONE that they like best?
Why are there a thousand different bikes you can buy? They all ride fine.
 
But here is the thing. That ear is neither infinitely sensitive nor has infinite bandwidth. There are sounds to low for us to hear, and frequencies to high for us to hear. Not just me, not just you - all humans.


And all those dacs tested - their imperfections are to low for us to hear - so there is no difference to be heard. It doesn't matter that our hearing is different or our emotions are different. If the sense organ is not up to the job of detecting the sounds that make them different, then there is nothing sent to the brain to evoke any different emotion.
First, I appreciate your non-attack response. Good job.

What I mean to say below is:
A) Music is not generic sound because its sound can be cognitively reinforced by emotional pathways.
B) Listening is not passive hearing.
C) I don't challenge the data concerning the noise generated by DACs, but I challenge the conclusions.
D) I suspect that important subtle elements of the signals DACs generate can actually originate from the DACs input recorded digital information that is, on its own, below threshold and out of human bandwidth.

Point A: We're all emotionally unique. Enough said about what makes the sound of music unique...

Point B: As a first approximation, I agree that the sensitivity and bandwidth of human hearing is a large factor. And I know that my own sensitivity and bandwidth are not exceptional - in fact they are a little narrower than average. But hearing sensitivity can be focused (imagine the RCA dog cocking his head to critically listen to the Victrola :)). As one example, acoustic musical instruments can have their 'voices' changed by the smallest alterations in physical setup. And that sonic change can be obvious to their players and luthiers, but less so to those not trained to attend to the instrument's 'voice'. Would you invite John Doe off the street to tune your piano? Don't do it. Piano tuners are highly trained listeners.

Point C: Intro - I spend my leisure time to better understand and transform my observations into entertainment as I see fit. While the ideas from this shark tank are interesting, I remain deaf to the sharks' derision and/or caustic opinions. That said...

Background - I recently upgraded 4 ESS-based DACs that I built about 4 years ago. They all got a new external, frequency-switching master clock board. And I tested a small variety of clocks in the systems. With all of the DACs - two 9038Pro and two 9028Pro - the output sound had changed playing into headphones and confirmed by REW scans using my wide-bandwidth amp with highly resolving speakers.

Observations - Now, let's zoom into the 9038 with the cleanest clocks (which happen to natively output a square waveform). Especially with clean acoustic recordings at 24 bits of depth, all of the the interpolation and noise-shaping stages before HyperStream (block diagram below) in the DAC are not just unnecessary, they cause small degradations of the things I listen for. DSD vs. PCM input sounded almost identical. After listening while manipulating the DAC's various digital filters, I decided to use PCM because a) it allows optimizing the DAC's 'pre-Hyperstream' stages (whereas DSD shuts them down), b) 8X upsampling the PCM paid almost no dividends - the sound was just a touch more coherent, but lacked a little of the 'dynamic punch/transient weight' that came from the native recording frequency.

Experiments - In PCM, the harmonic distortion neutralizer circuit (THD Compensation) was the one exception to digital degradation of the sound. I wanted to learn if it could be used to help the 'voice' of the system and it turned out it can. But it's complicated, because it depends heavily on the recording quality, content, and playback volume. I had installed a web interface to manipulate the DAC chip from the player's internal RPi computer. It's 3 pages of buttons! Adjusting for each particular album or track - with instantaneous A/B switching - is no way to 'just enjoy' the music! In the DAC control website I built-in 4 harmonic distortion profiles, and confirmed them with FFT plots directly from the DAC's balanced I/V board. They do this: 1 - correct for inherent 2nd and 3rd harmonic imbalance - creating a clean one-peak FFT; 2 - emulate the performance of a 6SN7 triode (like my old preamp, now long retired); 3 - slightly 'warm up' strong vocals that my listening room can't quite handle; 4 - approach the harmonic sound signature of a 300B room-heater amplifier. Long story short - I'm in the midst of developing a system of digitally 'fingerprinting' each track using an ffmpeg analysis*, and putting a lightweight Dameon on the RPi to optimally, and automatically optimize the 9038 processing for each song. No more flipping around the control website to get the best - most emotionally engaging - sound reproduction. You see why I just can't accept that all DACs are transparent, and that brings me to my last point.

Point D: The DPLL and Sub-Threshold Information

In years past, it was generally accepted that when using the DAC's DPLL to eliminate jitter, narrower was better — a well-designed system would hold lock at the tightest possible window. With the low-jitter clock boards I installed, the DPLL is no longer needed, and the sound is measurably cleaner without it — just as in DSD mode.

The effect is most obvious on my best live acoustic recordings, the ones my son describes as "magical." When I engage the DPLL and progressively narrow its timing window, something essential disappears: the fine spatial clarity of the soundstage, the audience settling into silence, the small sounds of instrument handling and microphone movement during a live performance — that texture of being there goes away. On the FFT plots, all of that information sits down in the grass around −110 dBr. By any conventional standard, it shouldn't be audible.

My working hypothesis is that the DPLL's temporal averaging destroys the fine timing relationships between these sub-threshold signals — and that those relationships matter. In a nonlinear system, sub-threshold signals don't just disappear; they can combine to produce intermodulation products that cumulatively reach perceptual threshold. Destroy the timing coherence, and those products either don't form or shift out of the frequency ranges where they'd reinforce the original signal. What's lost isn't the signals themselves — it's the emergent audibility they were generating together.

I can't prove this yet. But I hear it consistently, my measurements are consistent with it, my A/B testing is consistent with it, and I'm not done investigating and enjoying it.

All the best, as always.

* - ffmpeg variables being characterized include: integrated loudness (LUFS), loudness range (LRA), crest factor, and flat factor
 

Attachments

First, I appreciate your non-attack response. Good job.

What I mean to say below is:
A) Music is not generic sound because its sound can be cognitively reinforced by emotional pathways.
B) Listening is not passive hearing.
C) I don't challenge the data concerning the noise generated by DACs, but I challenge the conclusions.
D) I suspect that important subtle elements of the signals DACs generate can actually originate from the DACs input recorded digital information that is, on its own, below threshold and out of human bandwidth.

Point A: We're all emotionally unique. Enough said about what makes the sound of music unique...

Point B: As a first approximation, I agree that the sensitivity and bandwidth of human hearing is a large factor. And I know that my own sensitivity and bandwidth are not exceptional - in fact they are a little narrower than average. But hearing sensitivity can be focused (imagine the RCA dog cocking his head to critically listen to the Victrola :)). As one example, acoustic musical instruments can have their 'voices' changed by the smallest alterations in physical setup. And that sonic change can be obvious to their players and luthiers, but less so to those not trained to attend to the instrument's 'voice'. Would you invite John Doe off the street to tune your piano? Don't do it. Piano tuners are highly trained listeners.

Point C: Intro - I spend my leisure time to better understand and transform my observations into entertainment as I see fit. While the ideas from this shark tank are interesting, I remain deaf to the sharks' derision and/or caustic opinions. That said...

Background - I recently upgraded 4 ESS-based DACs that I built about 4 years ago. They all got a new external, frequency-switching master clock board. And I tested a small variety of clocks in the systems. With all of the DACs - two 9038Pro and two 9028Pro - the output sound had changed playing into headphones and confirmed by REW scans using my wide-bandwidth amp with highly resolving speakers.

Observations - Now, let's zoom into the 9038 with the cleanest clocks (which happen to natively output a square waveform). Especially with clean acoustic recordings at 24 bits of depth, all of the the interpolation and noise-shaping stages before HyperStream (block diagram below) in the DAC are not just unnecessary, they cause small degradations of the things I listen for. DSD vs. PCM input sounded almost identical. After listening while manipulating the DAC's various digital filters, I decided to use PCM because a) it allows optimizing the DAC's 'pre-Hyperstream' stages (whereas DSD shuts them down), b) 8X upsampling the PCM paid almost no dividends - the sound was just a touch more coherent, but lacked a little of the 'dynamic punch/transient weight' that came from the native recording frequency.

Experiments - In PCM, the harmonic distortion neutralizer circuit (THD Compensation) was the one exception to digital degradation of the sound. I wanted to learn if it could be used to help the 'voice' of the system and it turned out it can. But it's complicated, because it depends heavily on the recording quality, content, and playback volume. I had installed a web interface to manipulate the DAC chip from the player's internal RPi computer. It's 3 pages of buttons! Adjusting for each particular album or track - with instantaneous A/B switching - is no way to 'just enjoy' the music! In the DAC control website I built-in 4 harmonic distortion profiles, and confirmed them with FFT plots directly from the DAC's balanced I/V board. They do this: 1 - correct for inherent 2nd and 3rd harmonic imbalance - creating a clean one-peak FFT; 2 - emulate the performance of a 6SN7 triode (like my old preamp, now long retired); 3 - slightly 'warm up' strong vocals that my listening room can't quite handle; 4 - approach the harmonic sound signature of a 300B room-heater amplifier. Long story short - I'm in the midst of developing a system of digitally 'fingerprinting' each track using an ffmpeg analysis*, and putting a lightweight Dameon on the RPi to optimally, and automatically optimize the 9038 processing for each song. No more flipping around the control website to get the best - most emotionally engaging - sound reproduction. You see why I just can't accept that all DACs are transparent, and that brings me to my last point.

Point D: The DPLL and Sub-Threshold Information

In years past, it was generally accepted that when using the DAC's DPLL to eliminate jitter, narrower was better — a well-designed system would hold lock at the tightest possible window. With the low-jitter clock boards I installed, the DPLL is no longer needed, and the sound is measurably cleaner without it — just as in DSD mode.

The effect is most obvious on my best live acoustic recordings, the ones my son describes as "magical." When I engage the DPLL and progressively narrow its timing window, something essential disappears: the fine spatial clarity of the soundstage, the audience settling into silence, the small sounds of instrument handling and microphone movement during a live performance — that texture of being there goes away. On the FFT plots, all of that information sits down in the grass around −110 dBr. By any conventional standard, it shouldn't be audible.

My working hypothesis is that the DPLL's temporal averaging destroys the fine timing relationships between these sub-threshold signals — and that those relationships matter. In a nonlinear system, sub-threshold signals don't just disappear; they can combine to produce intermodulation products that cumulatively reach perceptual threshold. Destroy the timing coherence, and those products either don't form or shift out of the frequency ranges where they'd reinforce the original signal. What's lost isn't the signals themselves — it's the emergent audibility they were generating together.

I can't prove this yet. But I hear it consistently, my measurements are consistent with it, my A/B testing is consistent with it, and I'm not done investigating and enjoying it.

All the best, as always.

* - ffmpeg variables being characterized include: integrated loudness (LUFS), loudness range (LRA), crest factor, and flat factor
Here is a tl'dr for you:

Not comparing blind invalidates ALL those vanishingly unlikely impressions you've just described.

But you're clearly having fun playing with your biases - have at it.
 
Why does OP needs to go to such lengths as to convince the rest of the world that his buying choice is better than others?
It´s just boring.
 
But you're clearly having fun playing with your biases - have at it.

You are quite correct. But somebody is going to think up the "Sub Threshold Intermodulation" marketing ploy. When they do, you read it here first! :)

From what I'm hearing, the soundstage effects clearly seem time dependent as one would expect for creating/sharpening the sense of depth and direction. If it is intermodulation it could combine harmonic cancellation with complimentary harmonic reinforcement. Both plus and minus...

I'm fortunate to have the time to play this way. Quoting Nelson Pass re: an almost heretical design: "Get over it! It's entertainment!" :cool: And for entertainment, try the cleanest DAC master clocks you can find and give them the cleanest power supply you can provide. Get back to me when you do... Cheers!
 
Back
Top Bottom