Panasonyum
Member
- Joined
- Oct 5, 2025
- Messages
- 12
- Likes
- 12
Background:
I was unsatisfied with a couple of previous blind tests of DAC dongles vs bigger DACs. For example, Archimag's test used recordings of DACs as opposed to participants listening to actual DACs https://archimago.blogspot.com/2024/05/high-end-dac-blind-listening-results.html, other tests used DACs+amps and headphones (e.g., "Epic Multiple Blind Tests! Can They Tell The Differences?" on youtube). I wanted to listen to the actual sources and to eliminate amps.
Setup:
Apple USB-C Dongle connected to a PC; and PC optical out to Chord Mojo 1. Both sources are connected to an RCA switcher which is wired to my active studio monitor speakers Adam A5X. https://i.postimg.cc/vmc1nhj6/mojo.jpg
Procedure:
My test was to be done in the following way. There are N trials, each trial consisting of the same song section played twice. The experimenter chooses if it is played from different sources (e.g., dongle then Mojo) or on the same source (eg., dongle twice). Volume is set to zero in the beginning of each song, the participant is free to adjust it. The participant ranks the first song as 10, second song as 11, 10 or 9 =better, same, worse. The experimenter adds up all the scores for both sources, divides by the number of trials and we have a result.
Unfortunately I could not convince my partner that the needs of science were greater than hers, so I did the "blind test" myself - thus omitting the hard "any trial could contain two instances of the same source" case.
Yesterday, I've attached all the audio cables to an RCA switch box, and this morning I realized that I could not remember which switch position corresponded to which source - hence my decision to run the test. Apart from the physical button, I've used a script to switch between the optical out to Mojo and the Apple dongle sources in Foobar. When I clicked it, it switched between the two sources without it telling me which of them was active (there was merely no sound if it did not correspond to the RCA switcher position).
Every song started with the volume dial on the speakers set to 0 or near 0. I've adjusted loudness for every song to where it felt good - this was different for every song and every trial. Volume settings were very close and I could not guess the source from fumbling with the volume dial.
Results:
Out of 30 trials, Mojo won on 18 trials. 10 trials were a draw. Apple won 2 trials.
Discussion:
It was hard to find differences on all tracks, there were no "night and day" tracks. Acoustical instruments, vocals and acoustic drums sound "more flowing" on Mojo. Electronic music sounded extremely similar, although maybe I was still getting accustomed to the test.
Shortcomings:
1).I always knew that each trial had 2 different sources, this made things easier - this is a biggie, and I still hope to convince my partner to donate 30 minutes of her life to redo this.
2).Although the volume dial settings were very similar for both sources (about the 1st mark on the drawn scale- depending on the song), and I did not look at this scale when setting volume, I may have developed a subconscious feel for which source corresponded to which volume setting. Asking my partner to go louder or quieter would also mitigate this. I don't want to rely on precise volume matching as changing volume for each song and genre is a natural way to listen to music and I tend to doubt the precision of those measurements.
I was unsatisfied with a couple of previous blind tests of DAC dongles vs bigger DACs. For example, Archimag's test used recordings of DACs as opposed to participants listening to actual DACs https://archimago.blogspot.com/2024/05/high-end-dac-blind-listening-results.html, other tests used DACs+amps and headphones (e.g., "Epic Multiple Blind Tests! Can They Tell The Differences?" on youtube). I wanted to listen to the actual sources and to eliminate amps.
Setup:
Apple USB-C Dongle connected to a PC; and PC optical out to Chord Mojo 1. Both sources are connected to an RCA switcher which is wired to my active studio monitor speakers Adam A5X. https://i.postimg.cc/vmc1nhj6/mojo.jpg
Procedure:
My test was to be done in the following way. There are N trials, each trial consisting of the same song section played twice. The experimenter chooses if it is played from different sources (e.g., dongle then Mojo) or on the same source (eg., dongle twice). Volume is set to zero in the beginning of each song, the participant is free to adjust it. The participant ranks the first song as 10, second song as 11, 10 or 9 =better, same, worse. The experimenter adds up all the scores for both sources, divides by the number of trials and we have a result.
Unfortunately I could not convince my partner that the needs of science were greater than hers, so I did the "blind test" myself - thus omitting the hard "any trial could contain two instances of the same source" case.
Yesterday, I've attached all the audio cables to an RCA switch box, and this morning I realized that I could not remember which switch position corresponded to which source - hence my decision to run the test. Apart from the physical button, I've used a script to switch between the optical out to Mojo and the Apple dongle sources in Foobar. When I clicked it, it switched between the two sources without it telling me which of them was active (there was merely no sound if it did not correspond to the RCA switcher position).
Install the Spider Monkey Panel component. To add this scripting ability, you must first install the foo_spider_monkey_panel component. You can download it from the foobar2000 components page and install it by going to File > Preferences > Components > Install.
Locate your device names. In foobar2000, go to File > Playback > Device. Note the exact names of the output devices you want to switch between. They will be listed under the DS (DirectSound), WASAPI, or ASIO sub-menus, depending on your setup and installed components. For example: DS: Speakers (Realtek(R) Audio).
Scripting with the Spider Monkey Panel
Add a new Spider Monkey Panel: Right-click on your foobar2000 layout and select Add new panel > Spider Monkey Panel.
Open the panel configuration: Right-click the new panel and select Configure panel.
Insert the script: In the script editor window, enter the following code. This example shows a simple script to cycle between two devices, triggered by a click.
// Configuration
var devices = [
"Playback/Device/Realtek Digital Output (Realtek USB Audio) [exclusive]",
"Playback/Device/Headphones (USB-C to 3.5mm Headphone Jack Adapter) [exclusive]",
//"Playback/Device/Primary Sound Driver",
];
var currentDeviceIndex = 0;
// A label to display and click
function on_paint(gr) {
gr.FillSolidRect(0, 0, this.width, this.height, 0); // Black background
gr.DrawString(
"Switch Device",
gdi.Font("Arial", 14),
0xFFFFFFFF,
10,
10,
this.width,
this.height
);
}
// A function to handle the click and change the device
function on_mouse_lbtn_up(x, y) {
currentDeviceIndex = (currentDeviceIndex + 1) % devices.length;
var deviceName = devices[currentDeviceIndex];
fb.RunMainMenuCommand(deviceName);
// Optional: Show a popup to confirm the device change
//fb.ShowPopupMessage("Switched to: " + deviceName.split("/").pop(), "Device Switch");
}
Locate your device names. In foobar2000, go to File > Playback > Device. Note the exact names of the output devices you want to switch between. They will be listed under the DS (DirectSound), WASAPI, or ASIO sub-menus, depending on your setup and installed components. For example: DS: Speakers (Realtek(R) Audio).
Scripting with the Spider Monkey Panel
Add a new Spider Monkey Panel: Right-click on your foobar2000 layout and select Add new panel > Spider Monkey Panel.
Open the panel configuration: Right-click the new panel and select Configure panel.
Insert the script: In the script editor window, enter the following code. This example shows a simple script to cycle between two devices, triggered by a click.
// Configuration
var devices = [
"Playback/Device/Realtek Digital Output (Realtek USB Audio) [exclusive]",
"Playback/Device/Headphones (USB-C to 3.5mm Headphone Jack Adapter) [exclusive]",
//"Playback/Device/Primary Sound Driver",
];
var currentDeviceIndex = 0;
// A label to display and click
function on_paint(gr) {
gr.FillSolidRect(0, 0, this.width, this.height, 0); // Black background
gr.DrawString(
"Switch Device",
gdi.Font("Arial", 14),
0xFFFFFFFF,
10,
10,
this.width,
this.height
);
}
// A function to handle the click and change the device
function on_mouse_lbtn_up(x, y) {
currentDeviceIndex = (currentDeviceIndex + 1) % devices.length;
var deviceName = devices[currentDeviceIndex];
fb.RunMainMenuCommand(deviceName);
// Optional: Show a popup to confirm the device change
//fb.ShowPopupMessage("Switched to: " + deviceName.split("/").pop(), "Device Switch");
}
Results:
Out of 30 trials, Mojo won on 18 trials. 10 trials were a draw. Apple won 2 trials.
- Chi-square statistic: 12.8
- p-value: 0.00166
- The p-value (0.00166) is much smaller than the typical significance level of 0.05.
- This means I reject the null hypothesis and conclude that there is a statistically significant difference in the preference between Mojo and Apple Dongle.
Discussion:
It was hard to find differences on all tracks, there were no "night and day" tracks. Acoustical instruments, vocals and acoustic drums sound "more flowing" on Mojo. Electronic music sounded extremely similar, although maybe I was still getting accustomed to the test.
Shortcomings:
1).I always knew that each trial had 2 different sources, this made things easier - this is a biggie, and I still hope to convince my partner to donate 30 minutes of her life to redo this.
2).Although the volume dial settings were very similar for both sources (about the 1st mark on the drawn scale- depending on the song), and I did not look at this scale when setting volume, I may have developed a subconscious feel for which source corresponded to which volume setting. Asking my partner to go louder or quieter would also mitigate this. I don't want to rely on precise volume matching as changing volume for each song and genre is a natural way to listen to music and I tend to doubt the precision of those measurements.
Last edited: