• Welcome to ASR. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Audio by Van Alstine ABX Comparator Review

tl;dr: I'm glad we found a reasonable answer but getting there was a crazy and dispiriting ride.
Why don't you try to solve this puzzle with just this box and nothing else from Josh. You seem to be thinking I should have been running random experiments here until some revelation popped out with everyone silent. All we have is a comparator and nothing else from Josh. Not his recordings. Not himself. No recordings of him conducting this test (why don't you ask him about not being able to record himself).

I am just stunned that I have dedicated good few days to testing this box and this is junk I have to read. The level of entitlement is beyond measure. Oh you were dispirited? Forgive me. I will try to be more careful as to not cause that.... :(
 
dr: I'm glad we found a reasonable answer but getting there was a crazy and dispiriting ride. I say this as a person with routine, perhaps even small-pond notorious, contempt for 'tone moderating'. But READ THE WHOLE THREAD if you disbelieve. Jeez, ASR, what a performance.
Thanks for the critical judgement. You should see what we think of you.
 
Last edited:
It was not an edifying experience. getting there was a crazy and dispiriting ride. I say this as a person with routine, perhaps even small-pond notorious, contempt for 'tone moderating'. But READ THE WHOLE THREAD if you disbelieve. Jeez, ASR, what a performance.

I get what you're trying to say. The tone of some of the naysayers might be harsh. But the tone of the pro Josh crowd has been overly sensitive and critical as well. Unless of course, you just skipped over all those posts. So a bit like the pot calling the kettle black. Except of course, the kettle brought scientific rigor to his beef with the pot.

Amir has done a great job showing why, from a scientific standpoint, Josh's claims of superhuman auditory ability remain unsupported. If you can't back up your claims with decent science, probably best to steer clear of ASR.

Are many of us secretly (well, and yeah, overtly, from the posts!) gleeful that Josh's phony claims have been discredited.

Yup. Not much more to say. Another phony bites the dust. Good job to Amir.
 
Are we really talking about DACs or about anti-imaging filters in DACs?




I was away for a bit and read this entire thread last night. I recommend all to do that.

It was not an edifying experience. Much of ASR seems to have lost a marble or two in response to the review.

That said, all props to Solderdude, one of the few who kept his head on straight throughout.

FWIW I believe Josh's claimed accomplishment is frankly impossible.

But for Amir to first cite a relay switch noise ('up vs down' , or 'tick vs tock') as a possible tell -- that's entirely possible -- but balk at recording it....amounting to dotting the 'i' and crossing the 't' on that theory -- was a flummoxing choice to this reader. I seriously, seriously doubt it requires anything near a $1000 microphone and fancy pre to capture that sound, a sound that could be heard by a good listener (Amir) wearing IEMS (not playing music). If he doesn't have an adequate one, for god's sake let's buy it for him! I'll send my never-used UMIK USB mic (purchased for REW readings that I still haven't done) to Amir if that helps. If he doesn't have time, fine, put it on the to-do list for the future! But to simply not be interested in entering an obvious bit of evidence into Josh's 'trial', but also offer sighted testimony with an 'even my wife could hear it' addendum-- plus continued chastizing of Josh for not providing us necessary recordings -- that all had me almost literally agog. It all has the makings of an audiophile farce. :rolleyes:

Regarding the crap bench results (distortion) this unit displays, Matt Hooper, of all people, hit a salient nail on the head: this means that for some uses -- such as amp comparison -- the Van Alstine device (NB., not the only ABX box ever made) really could be 'masking' a possible 'real' audible differences -- a charge audiophile crackpots have been leveling for decades at ABX boxes. And to use those crap results to wave away any need to even consider the case or the cause any further -- another rhetorical tactic displayed on this thread -- is a lame out.

Solderdude pointed out why the relay 'tell' theory might not hold given Josh's particular testimony. It feels like no one read that!. Then we moved on to another discovery, the impedence vs attenuation issue. Solderdude posted a very nice breakdown of what Josh did , to conclude this was the likely issue. No one else did that! Even though understanding what Josh actually did (to the extent we know) is critical to judging how dispositive any of the theories are. Much less to throwing accusations about what he didn't do, apparently without knowing that he didn't do it. There was so much posting about theories that had already been explained/discarded earlier in the thread.

Finally, allow me to cite the diversion into LED light conspiracy theories as another low point, and leave it at that.

tl;dr: I'm glad we found a reasonable answer but getting there was a crazy and dispiriting ride. I say this as a person with routine, perhaps even small-pond notorious, contempt for 'tone moderating'. But READ THE WHOLE THREAD if you disbelieve. Jeez, ASR, what a performance.
I ran an ABX test to determine whether this was rational self-positioning or just an egotistical rant, but I'm afraid the noise floor was too high.
 
I have to say, I just said, on another forum, that I did not believe "every amplifier I bought sounds different". This created a storm of complaint, but also a storm of agreement.

What upset some people is when I said "if two amplifiers sound different (at the same gain), then at least one of them is faulty". Oh dearie me. Like Krabapple, I'm really, REALLY, REALLY tired of being told how stupid and idiotic I am when I ask for an actual blind test.
 
What upset some people is when I said "if two amplifiers sound different (at the same gain), then at least one of them is faulty". Oh dearie me. Like Krabapple, I'm really, REALLY, REALLY tired of being told how stupid and idiotic I am when I ask for an actual blind test.
He isn't asking for blind test of audio. He is asking (presumably) for a blind test of the sound of a relay turning on and off. I really hope you are not with him in this regard.
 
He is asking (presumably) for a blind test of the sound of a relay turning on and off.

Based on the controversy that this 'relay sound' has elicited, can we assume that you will begin testing relays for their SINAD, frequency response, and other characteristics like jitter? I, for one, would look forward to those reviews. Thank you, by the way, for the review of this device. It's always satisfying to see the Conan the Barbarian approach applied to audio devices that make extraordinary claims and can't deliver.
 
He isn't asking for blind test of audio. He is asking (presumably) for a blind test of the sound of a relay turning on and off. I really hope you are not with him in this regard.
On this forum, we point out on a more than daily basis, that non blinded tests are invalid, no matter how big the perceived differences seem to be. I’m struggling to understand, genuinely… someone please explain this to me (please please please be kind too …) why blind testing the sound of the relays is not a good idea
 
Are we really talking about DACs or about anti-imaging filters in DACs?
Yes, some reconstruction filters can have a, substantially enough, roll-off in the audible band to be audible in AB tests.
This is evident of the many tests showing the transition band for filters by Amir (and other reviewers).
Edit: and ripple in some DACs.

Not applicable to Josh's experiments because he used 96kHz files which generally don't roll-off in the audible band (well, some post-filters in some DACs do) nor were DACs used with a high bandpass ripple.

In this case there is a roll-off but attenuator setting dependent and that's what I suspect is what made Josh ace the tests when comparing DACs that are arguably 'measuring transparent'. And as the influence of the AB box cannot be ruled out as a possible tell the whole test is 'suspect'.
 
Last edited:
Based on the controversy that this 'relay sound' has elicited, can we assume that you will begin testing relays for their SINAD, frequency response, and other characteristics like jitter?
I do not think that Amir will do it, but you can see relay distortion test in another thread here. (Post #17). It might sound funny for someone, but relay contact may have more or less nonlinear resistance, which strongly depends on contact material and construction. It is mostly measurable in power relays. The contact degrades gradually. I would add that in the first 5 Years of my career I was involved in a research of electrical arc in circuit breakers and a part of it was low voltage switching.
 
Yes, some reconstruction filters can have a, substantially enough, roll-off in the audible band to be audible in AB tests.
This is evident of the many tests showing the transition band for filters by Amir (and other reviewers
Once again, ripple in the audio band may be (is) more important than the roll-off and it was shown and supported by abx results.
 
On this forum, we point out on a more than daily basis, that non blinded tests are invalid, no matter how big the perceived differences seem to be. I’m struggling to understand, genuinely… someone please explain this to me (please please please be kind too …) why blind testing the sound of the relays is not a good idea

So, it's not that a blind test of a relay is in theory a bad idea. It's just that, well, how much more time do you want someone else to spend when the ABX machine used in testing has been shown to be severely deficient.

What we have is a device that has very significant nonlinear distortion, and significant linear distortion issues that render it unsuitable for the task apart from relay clicking issues.

I think Amir's contributions are quite definitive even excluding the relay audibility and no more is necessary for most of us.

You, of course, are free to spend your own time and money doing blinded tests of relay clicks and spending $5k on an ACO Pacific or BK mic and making pristine recordings for us all to review. Of course, to really do it right you'd need another ABx setup, arrange an evaluation that is blinded to both the listener and the tester, and have multiple participants, etc, etc.

I mean at some point you just have to look at the sum total of the work product that Amir has done and ask yourself if you are convinced. If not, again, maybe someone else starts putting in the effort. I'm sure they'd all like to recoup their $1300 to start for this not so state of the art ABX white elephant.
 
He isn't asking for blind test of audio. He is asking (presumably) for a blind test of the sound of a relay turning on and off. I really hope you are not with him in this regard.
If it makes an audible sound, and clicks in one test condition and not the other, it will provide cues. Really.
 
Josh's claims of superhuman auditory ability remain unsupported
In defense of Josh:

It is possible the tests he did 16/16 ones did actually have audible differences due to the different attenuation settings.
This is shown to exist in both Josh's measurement and Amir's.
I don't think this requires superhuman auditory abilities, just younger and trained ears ... which is applicable in Josh's case.

The only problem is that what he actually heard may not have been differences in DAC performance but attenuator response differences and/or different 'ticks' without realizing they might be different, or picking up on 'mute time' between relay switching/ticks. We can only speculate.

This does not seem to have been the case with R30 vs X30 and that one was 13/16 (AB box but same attenuation) but the whole relay issue may still have provided cues. Here too we don't know and can only guess what Josh heard.
 
Last edited:
You, of course, are free to spend your own time and money doing blinded tests of relay clicks and spending $5k on an ACO Pacific or BK mic and making pristine recordings for us all to review. Of course, to really do it right you'd need another ABx setup, arrange an evaluation that is blinded to both the listener and the tester, and have multiple participants, etc, etc
If it makes an audible sound, and clicks in one test condition and not the other, it will provide cues. Really.
The test is easy to do and it was done - look here and further posts.
 
The test is easy to do and it was done - look here and further posts.
I think that is the whole point! It really should not matter that the recording doesn’t sound like the thing IRL. It should be good enough to at least do an analysis and conclude if it would be audible even if the recordings themselves are not good enough for an ABX, just like you did with your relays.
 
If it makes an audible sound, and clicks in one test condition and not the other, it will provide cues. Really.
The box always makes a 'tick' even when there was A to A and B to B.
What was not investigated is how long the 'muting' was in all 'directions' and A to A, B to B.
This too can certainly provide cues.

That said... there could well be a difference in 'tick' sound (arguably) but neither Josh nor Erin mentioned hearing different 'tick' sounds. But when one does not know relays can/do make a different sound depending on energizing/de-energizing and don't pay attention to that because it isn't known to them and while listening out for 'differences in sound' and hearing the relay ticks (that can sound different) it indeed will provide cues.
 
At the conclusion of the review I touched base with Frank again, and he told me that a change had been made to the ABX Comparator in regard to the audible clicking of the switches when moving from system A to system B. It seems that in a quiet room there is a noticeable difference in the clicking of the relays. A user had clued Frank in to the fact that one could tell whether circuit A or B was in use by the sound of the switching!
... the one tested here must be the version before this change, or the change didn't really fix the problem. ;)


JSmith
 
This is like a poor social network chat going round and round in circles, merry-go-round, without any continuity. Sorry guys, terribly frustrating.
 
Back
Top Bottom