Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
Welcome to ASR. There are many reviews of audio hardware and expert members to help answer your questions.
Click here to have your audio equipment measured for free!
I remember the ABX Comparator plugin performs a one-sided (one-tailed) statistical test. But maybe my memory is wrong or I got it wrong when I played with the tool for some personal research, few years ago.
Edit: in my score of 5/16, Foobar ABX p-value is 0.9616. Two-sided would have been 0.2101. So, here we go.
I remember the ABX Comparator plugin performs a one-sided (one-tailed) statistical test. But maybe my memory is wrong or I got it wrong when I played with the tool for some personal research, few years ago.
Here is an image from the first page of the thread. Maybe that will refresh you on the Foobar ABX? I think In understand the statistical scoring question, but I am not sure I understand how ABX can be one sided or two sided.
With the tests proposed by pma, if I combine all results from all members who participated in one or both tests (@RandomEar : 6/16, 7/16, @pjug :10/16, @Holy Spirit: 8/16, @pma : 8/16, 10/16 (random clicking), @Sokel : 2/16, 3/16, @staticV3 : 8/20, @NTTY : 10/16, 5/16, 6/16, 8/16, 13/16, 9/16, 11/16), I get the below:
7 participants
260 tests
124 positives
124/260 means 0.2476 one-sided p and 0.4952 two-sided p.
For two-sided p, if you treat both 2/16 and 14/16 as success, shouldn't you count 2 as 16-2=14 (or any n<8 as 16-n). Otherwise they cancel out and from 2 successful tests (2/16 and 14/16) you get just random guess (16/32).
I'm guessing , I skipped some classes on statistics :
One-sided, the expected outcome have a probability between 0.5 and 1. You count 2/16 same as 8/16. 14/16 would be a success.
Two-sided, the expected outcome have a probability between 0 and 1. 2/16 or 14/16 can bee success. But not at the same time, otherwise it would be 16/32.
As I understand it's statistics on a process who has a (to be determined) statistic outcome. Not statistics to get a given outcome (given a determined process).
2-sided replies to the wider question "did I score unexpectedly high in one or the other direction?". In our case, it addresses to the initial question of @Salt "BTW: 2/16 is far beyond statistical noise: are you not concerned you simply did A for B ?"
But if we want to take these into consideration, then the <0.05 mark is more stringent, which I don’t see as a problem in our specific research.
This is an online test that I prepared in March 2026. Wav files. Anyone can try it online, the test interface avoids cheating. Test files are also attached at the bottom of this post.
Anyone want to suggest a track to use for making recordings? Josh said he used 96K recordings of Steely Dan “Negative Girl” and “Cousin Dupree”, so maybe one of those? He also listed a couple Van Morrison tracks he said were 96K but I only see them in 44.1K in Tidal. I haven't looked but I would buy those for the testing if I can find them in 96K. And the other ones he used he said were upsampled to 96K. I'd rather use something released at 96K.
, I skipped some classes on statistics :
