One still has to contend with the gem ploughing vinyl. Do these amazing rigs somehow make the inherent characteristic flaws of the record disappear, e.g. the granular nature of the grooves, groove echo, etc.
The best vinyl rigs don't need to be tested to reveal inferiority to CD. Physics and mechanics analysis has long revealed this.
Well, of course. The point would not be to show that vinyl is as good as CD. The point would be to show what products that are used for vinyl playback actually do.
Yes, there would need to be controls. One significant challenge is that whatever test record Amir used would become...used...after only a few tests. That would need to be controlled, too. Perhaps establishing a "reference" turntable, and then comparing everything to it, using a fresh digital recording of the test record on each test to normalize the results and to show what effects of use the test record is showing. Even that would be interesting to know in some objective way.
Target audience is crucial. The target audience for DAC testing is not, really, those who are prepared to spend $10,000 on a DAC. Those folks are exploring something unrelated to measured performance (and, no, I'm not saying that something is in any way audible). The target audience for nearly all of the DAC testing has been those who just want a good DAC and their price point, whatever that is. So the reference turntable and cartridge need not be the esoteric best available, but rather something of good quality and recognized as such. A Rega Planar 3, for example, with a quality moving magnet cartridge, and maybe also a reasonable quality moving coil cartridge. Amir probably already owns something that would do just fine.
Occasionally, someone in Amir's area might be willing to pop over with their Goldmund Reference and give it a whirl. That would not establish a new reference, but would show how much better it can get--or not. Maybe it would help us clarify the diminishing returns.
Unlike with DACs, turntables have measurable imperfections up to the very best available that are relevant to most users, so we can perhaps start to quantify those diminishing returns. We may discover that there is no diminishing returns trend, as has been the case with DACs--cheap DACs perform as well as (or better than) expensive DACs and the only difference is features, brand value, and packaging.
But I think it is reasonable to constrain the variables, occasionally exploring those orthogonal axes to provide a way for people to estimate how the thing would perform for them. Those orthogonal axes (effects of loading, effects of compliance, effects of damping, effects of antiskate adjustments, effects of tracking error, effects--or not--of VTA, etc.) might prove more interesting than product comparisons.
One good place to start would be with cartridges made available since the days when magazines tested cartridges for things like frequency response.
Rick "Amir would be sensible to avoid this line of testing, but what does that have to do with it?" Denney