Why was the DCS chosen as a reference? It was the one you wanted to buy.
Actually not quite. The initial impulse to compare at all had been: "What the heck, lets see how a 20 year old dCS Purcell / Delius holds up against some of these miracle DACs we keep reading about. And while we're at it, let's see how my Weiss does against the dCS". I was not predisposed to buy the dCS. In fact if the listening sessions had confirmed that I liked my Weiss the best, I would have happily kept it and saved myself a significant amount of money.
For the tests I only had access to the dCS Purcell / Delius combo (which is 20 years old) of my friend's and my Weiss for an extended period of time and had to loan the other DACs one by one from dealers. So to make any meaningful comparison, we used the dCS as a reference (sorry not reference as per your definition) to match the other DACs against. As it turned out, we all
- were able to reliably (around 90%) distinguish the dCS combo from the other DACs
- did not prefer the sound of any of the other DACs (including my Weiss) to the dCS combo. Why is not relevant here. Simply personal preference
During the comparison session with my Weiss, I preferred the dCS by a substantial margin. Again, why is not of issue here. Had I liked any of the other DACs better than the Purcell / Delius, we would have compared the DACs I preferred (to the dCS) against each other. As that was not the case, we were able to leave out that step (which would have meant getting several DACs again from the dealers.
The Purcell / Delius is not manufactured and not serviced any more, so as a final round we compared the current Rossini to the Purcell / Delius combo and we preferred the Rossini (no miracle, as it is three generations further along the family tree. Had the Bartok been available at that time (half of the Rossini's cost), we would have probably chosen the Bartok for the final comparison.
The fact that none of the new DACs sounded better than the 20 year old dCS combo was a huge surprise to all of us.
But I take your point, we could have taken along my Weiss as reference. I do not feel that would have changed the result, as I clearly preferred the Purcell / Delius to the Weiss in the direct comparison.
Call me biased. I will not lose any sleep over it. For the purpose of making a choice the process fulfilled its purpose. I am sure it could have been improved, if the intention had been to conduct a scientific experiment fit for peer review.