If the recorded tracks sound different thru' the same device then the recordings need as much(if not more) scrutiny as the device, not ignoring subjectivity of course.
With the stated level of uncertainty, why bother?
Not sure what you mean by this.
Scenerio is simple.
I
believe the Mojo sounds
slightly different to many DACs. This is a subjective observation which I have not scientifically explored. I am always very cautious about subjective conclusions as there are so many pitfalls.
The recordings were made not for this purpose and had a slight difference in volume level due to the finite graduation in dac output volume control. This has been corrected. I still believe I can hear the difference, although it is not as obvious as when listening directly. This could be for several obvious reasons like effect of headphone load or the level of transparancy of the ADC (the original sounds subtly but noticeably different to both recordings to me). However the ADC is a consistent factor and if sufficiently transparent should not stop you differentiating between the dacs, assuming there is a sufficient difference to hear.
Without an ABX I could easily be kidding myself. I probably am. These are all exploreable variables, its not a futile exercise as you seem to imply, and of course a simple switch box can also be employed for direct testing. The recordings were presented because I was asked, and because its interesting and helpful to get others involved.
Why bother? Its a fascinating question to try and answer. We have seen with the testing performed on this site that there many very affordable dacs that are technically very competent. The crux of what we do here is to objectively identify worthy kit that ultimately is subjectivly satisfying. So we need to at least try and establish if we can hear differences between dacs that are of a decent level of technical performance regardless of price differential. Otherwise the limit of what we can acheive here is identifying the odd bit of kit that performs like Schiit..I mean shit.....interchangeable words of the same meaning