• Welcome to ASR. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Audio by Van Alstine ABX Comparator Review

It depends how and what he used for it.

As much as I can see here testing a gazillion of ways, there's simply no way to match levels at exact (and I mean exact) voltages (=levels) across the spectrum if the slightest FR change occurs between them.

And that's not only this box's fault, it just makes it way worse than it already is if FR changes exist.
Oh I agree that if there is different rolloff with A and B then they can't be matched. I was just talking about the 1Khz measurement with REW.
 
dB or voltage, makes no difference. A(dB) = 20*log(X2/X1). 1dB = 10% difference approx. 0.1dB = 1% difference approx. Just allow more than 1 decimal point precision behind the zero. This is really tiring. It goes ad absurdum, like almost always.
 
Oh I agree that if there is different rolloff with A and B then they can't be matched. I was just talking about the 1Khz measurement with REW.
1kHz sine can be rock solid if cross-checked, but is it enough?
 
dB or voltage, makes no difference. A(dB) = 20*log(X2/X1). 1dB = 10% difference approx. 0.1dB = 1% difference approx. Just allow more than 1 decimal point precision behind the zero. This is really tiring. It goes ad absurdum, like almost always.
Agree that it looks like an obsession, is just the far-right side of objectivity though.

I just demonstrate it even if I don't agree with it to such level.
 
... there's simply no way to match levels at exact (and I mean exact) voltages (=levels) across the spectrum if the slightest FR change occurs between them.

And that's not only this box's fault, it just makes it way worse than it already is if FR changes exist.
You can exactly match the RMS voltage of any waveform with any frequency response.
The definition of RMS is the same in all cases, sqrt(mean(samples^2)).

This doesn't imply that the voltages are the same at every frequency, just that their overall total powers are identical. It is traditional to call the square root of RMS power RMS voltage, as it relates the power that would be dissipated across a 1 Ohm resistor . That's what true-RMS meters report.
 
Last edited:
This it third and last known ABX comparator that I know of
Ok, I only got through three pages, but can you list what the other two were? Were either of them any good? For side by side speaker testing and not DACs is there a solution you would use? My practice so far has been to switch the A/B speaker outputs on a receiver (after level matching of course), but I know of at least one custom built A/B switch that is floating around.
 
Thanks for testing, @amirm . What a miserable unit. Almost 10 years ago I designed and built an AB box with much better parameters.


View attachment 562437

View attachment 562436

View attachment 562435

Looking at the measured results of the Van Alstine box + remarks on clicks, and uncontrolled test conditions, it may be said that the results and outcome of the @Josh83 tests are untrustworthy.
how well does this design work- what strengths/ weaknesses does it have? Would you recommend building one as a DIY? @amirm , or any of the other experts here, is this design likely to work well and what drawbacks might it have?
 
how well does this design work- what strengths/ weaknesses does it have? Would you recommend building one as a DIY? @amirm , or any of the other experts here, is this design likely to work well and what drawbacks might it have?
I do not use it anymore and I do not have it anymore. The reason is that I have never found a difference in the assisted AB(x) testing of opamps, DACs, and preamps with the comparator. The parameters were better than was my test/measuring system those days. You have measurements in the link you quoted.
Now you may wait for the opinion of ASR experts. Those who have never used it and have never measured it.

After there is a generation of new Topping (and similar) DACs and ADC of quality like Cosmos ADC, I do not see any reason to use any comparator box for the link level signal devices and I find the DAC/ADC method much more accurate. The only reason when to use the box is for speakers, to me. But it has caveats as well. I am sceptical to any amateurish attempt of abx testing with a comparator box, if the person does not have knowledge and instruments background.
 
Last edited:
@amirm
RMS across any selected frequency range (like 20Hz-20kHz or whatever you want) is shown automatically in REW. Depends only on operator knowledge and skills.
Neither of which you are demonstrating seeing how you are not addressing the points I made. So let me explain it to you.

A voltage value could either be extracted using time or frequency domain. If it is the latter, which would make sense given the core functionality of REW, then it is subject to different sources of error. Key is compensation for Windowing used for FFT and spectral leakage as I mentioned. The former can be implemented as an approximation but the latter is left up to the user to avoid. Which means you have to pick frequencies that land in a single FFT bin -- something I am sure many don't know and that likely includes you. And good luck to you if you attempt to use noise as Josh mentioned. See: https://www.audioprecision.com/news/fft-scaling-for-noise

"In Audio Precision analyzers, FFT spectra are scaled so that the amplitude axis gives the correct reading for discrete tones. This makes sense, because most often we are characterizing the performance of a DUT using sine waves. The amplitude axis, however, cannot be used to indicate the level of a spectrally non-discrete signal, such as noise, without first applying a correction factor that depends on the FFT bin width and the window used."

A single frequency tone that doesn't land in a single bin is also non-discrete.

I am actually reviewing an audio analyzer that gets the above wrong creating large amount of error.

Even outside of the above, you have to show that across the full dynamic range of the interface, accuracy is maintained.

This is all very different than how Audio Precision and multimeters work. They are operate in time domain so not subject at all to above error sources. And their accuracy is checked, specified and documented.

In a pursuit to see if voltages are the same, you need to use the same, accurate voltage measurement scheme. If you attempt to use these different methods, you can easily get wrong comparable results.

Yes, if you don't care about absolute values, you could use CHIRP/FFT based analysis but Josh's write clearly indicates a mix of these methods and hence my comment.
 
More words of wisdom from owner of AS Forum:

"You guys are tying yourselves into knots over this experiment not falling into line with your expectations. "
No, just like when cold fusion was announced to be real, we jump into action, put in our own money and resources to confirm. We don't sit there and throw out all the physics books because someone without prerequisite background has come up with a sensational result. Cold fusion results could not be replicated and hence dismissed. This is where we are with Josh's tests. We have found real flaws in the instrumentation he used that explains his false conclusions.

"Shouldn't this be the spice of measurement life? "
Only if you have yourself confused. Our life is not that of measurements. it is the fundamental science and engineering of audio. Measurements are data points to assess fidelity of products in those domains. Listening tests are another. Here, the listening tests have created fantastical results from someone who has refused to cooperate with us to find out how exactly he arrived at his outcome. His attitude, supported by you, shows disdain for getting to the truth. So the spice you are talking about comes from your and his attitude. Otherwise, we would have already had the answer weeks ago by simply giving us a few files (and sending me the comparator to measure).

Bottom line we absolutely value controlled listening and take them seriously. They are the the foundation of psychoacoustics. If Josh's work is found to be true, it has a serious impact in our understanding of that science which goes well beyond the borders of that paid article.

"I feel very comfortable with Josh's article and his conclusions, that are only valid for him. "

The what? Just for him? He did all that work only to not be valid for you or others there?

Ah, wait, you mean that blind tests are not really useful so you should be free to continue to use uncontrolled testing to promote whatever you like. Got it.
 
Ok, I only got through three pages, but can you list what the other two were?
There was the original box made by Clark et. al. as explained in their AES paper:
High-Resolution Subjective Testing Usinga Double-Blind Comparator
DAVID CLARK
ABX Company, Troy, MI 48099, USA

1791744972742.png


And this appropriate warning:

"It is important that the relays or other means of accomplishing the switching do not produce extraneous hums or switching noise. The hum or switching noise can be distracting but the major problem is that the character of interference with the two components may be different, thus allowing identification on an irrelevant basis."

They continue to say:

"Perhaps the most difficult switching problem is silently switching preamplifier/amplifier combinations. The more complex relay module in Fig. 7 accomplishes this task. The low level section is fully balanced and shielded with a minimum of stray capacitance. The relays are sealed and rated down to dry circuit switching as approximated by a phonograph cartridge output. Coil voltages are ramped up and down to avoid feedthrough into the audio. The loudspeaker level section is rated at 30 amperes and introduces less than 10 mΩ of additional resistance. Both high and low sides are switched. All relays are controlled by an eight-phase timing sequence that disconnects and reconnects outputs, inputs, high sides, and low sides in the proper order for a silent exchange of components within 50 ms. The relay assembly is elastically mounted to minimize acoustical noise."

They designer of AVA would have done well to have read this paper from 1982!

The other one I know about was designed by an engineer at QSC (pro audio company). You can read about its history in this colorful write up: https://wirebenderaudio.blogspot.com/2014/10/test-your-ears-or-shut-your-mouth.html
APIUysi9aKMa9EJb-1yUnmeEXN_r6syjLtaUX8iIEj1ollUpXBvUmglc4WjJ0ec-6V9eRiIIsSV0Zo-BED_oN5o=s1600


"30 years ago, Pat Quilter handed me a piece of junk that QSC had purchased to help make objective evaluations of audio gear; an ABX box that had been sold by some audiophile company a few years earlier. The original box had goofy firmware that occasionally retained incorrect test history, lousy circuitry for switching, and limited current capabilities. Since we would be testing everything from line-level signals to power amp output levels into a common speaker system, I pretty much dumped everything except the remote control and redesigned the whole box. From a previous engineering project, I had a few mercury-wetted, silver contact low signal relays in my parts bin, which I used for the line-level switching components. From the design work I’d done on the “award winning” Wirebender Musician’s Preamplifier, I incorporated a hard-wired parallel shielded signal path that minimized crosstalk (to 85dB unweighted), wiring capacitance and inductance, and kept the connectors-to-relay-to-connectors signal path as clean as possible. For the high power signal path, I used gold-plated dual banana connectors and some silver-plated-contact motor controller relays, also from my previous design engineering life."

Interesting that he considered the original ABX switcher a piece of junk. Wonder what he would have thought of the AVA! :)

"Years after I left, QSC turned the whole ABX concept into a product and discovered that proving your customers have mediocre hearing is not a great marketing tactic. On average, the “ABX test” established something that an audiologist discovered at a 1980’s AES, most audio professionals are “functionally deaf” and hate having that demonstrated in public. "

:)
 
There's a reason why good measurement and testing gear cost more, immunity is the key here.
AP gets the score it gets WHILE having a 100kOhm input impedance , that's no small.

Now compare that with low cost Cosmos for example and its pains with the low input impedance settings.
The Cosmos Scaler is the (cheap) solution.
 
I am using a buffer with 100k input impedance and capability to drive 50 ohm load - if is needed. It happens very seldom, almost never. So it is a non-issue.
 
Gut feeling says VA outsourced the design to some industrial, non-analog/non-audio engineer around the corner who didn't get paid much.
I've seen this before...
You can read tons about the AVA, including the name of the person that designed it ( Dan Kuechle.. though it seems to have been misspelled) ...and about another ABX farrago using it (tl;dr: result was 'everything matters,almost") in this 2015 article

I'm tempted to have AI summarize it but I fear AI may be sentient now, and resent me for it.
 
Last edited:
We can nitpick but QED, the device is faulty per amirm's measurements.
Whether Josh did or didn't know it only Josh knows; the rest is either heresy or hearsay, depending on nothing more sophisticated than your spellchecker.

Well gosh by all means let's keep repeating this over and over in posts, I'm sure it'll stick eventually.
 
That is one of the reasons why instant switching between the channels is a wrong method. I have been saying it all the time.
I'm not sure I understood what switching regime you are advocating. A followed by B but without instant switching? Can you explain?
 
It's still only a hobby.

No wonder there are wars in the world if there's this much conflict over something so unimportant.

It's not armed conflict level important, but audible DAC difference even anything near what Josh reported, if actually, truly, specifically, true, would throw decades of psychoacoustics into extreme doubt. At the very least open up a whole new field of inquiry within it.

So yeah, important to some, at some professional level.
 
More words of wisdom from owner of AS Forum:

....

"I feel very comfortable with Josh's article and his conclusions, that are only valid for him. "

The what? Just for him? He did all that work only to not be valid for you or others there?

OMG Connaker really went there? 'It's his truth'?
Beyond pathetic.
 
Last edited:
Just remember that Chris CON naker totally buys into people's individual truth.

This Josh's experiment and write up isn't the 1st time something like this has gained traction at A.S.

Look at DarqueKnights (deceased 05/25) 'instrumented testing' of the EtherRegen for the purposes of improved video quality. It's one of the threads that I think precipitated my ban with all the pushback I engaged in.

Chris is a fool for allowing and even championing patently wrong methodologies.
 
Last edited:
Back
Top Bottom