On this bit Josh is saying there:
"Finally, I reluctantly participated in PMA’s DAC->ADC “loopback” ABX tests on ASR. I scored an 8/10 (p = 0.055) on the test that compared the original file versus the DAC into the ADC, as well as a 9/10 (p = 0.011) on the comparison of two DACs."
First, I don't know why he would be reluctant if he is good at these things. Second, these would be good results for the average person. But not when same person claims 100% success across so many of the hardware tests:
Where are the 8 out of 10 results, p = 0.05 there? It doesn't exist. The worst case p value for 15 out of 16 is a whopping 0.0005 or two orders of magnitude smaller! He should have been able get 11 out of 10 in the software ABX test to match those.

Even 9 out of 10 with p value of 0.02, a far cry from what he got in the hardware AVA case.
Based on my subjective testing and finding, the only way to get results like this across 16 trials is with clear volume differences. Something that we could have figured out with just a pair of comparison files. In absence of that, we have clearly shown the potential for that and only have his word that it must not have happened to him. Yet he did not observe this problem despite doing the test two ways that would show it.
I should also note that
detection in ABX is not the same as fidelity differences. Two DACs with different volumes can easily be detected in ABX testing. Doesn't mean they have different fidelity. Once a person finds differences, then a preference test can be conducted. As it stands now, nothing has been demonstrated as one DAC sounding better than another.
If Josh/Chris, etc. want to prove that fidelity is different, go ahead and conduct a blind test again and this time attach preference scores. You don't need or want the AVA box as it screws the heck out of the fidelity of the DAC. Use a simple AB switcher. Match levels in software/player/content and do the testing.