Exactly. That is precisely what I use in the form of templates (so you can't overwrite them by accident). You load up the template and 99% of the settings are the same.
Are they public?
And then why not publish the full test report PDF?
Some of the other issues he is talking about is brought onto himself. He has cooked up his own way of testing products that in some cases are the same as mine, and in others, they are not. So naturally you can't compare those measurements to mine. If he really wanted these problems to not exist, he should not be making the changes.
He should not be making the changes to your way of doing things?!
There is more then one valid way to do things.
for example i never understand why you would only measure DACs at 2/4V this is not how most would use them.
The user usually controls the volume behind the DAC.
Finally, finishing the video with saying two headphone amps with the same SINAD "sound vastly different" is so absurd as to undo everything else he said up to that point. There is really no reason for him to test anything if he can't point to any test that identifies that "vast" difference.
this is bullshit but it isn't undoing everything else he said.
He has a valid points and mixes them with bullshit to please a specific audience.
Only if you are sitting there randomly messing with the dials to measure things.
Well true random has no chance of being influenced from conformation bias...
Doing so will quickly get you in trouble the first time a manufacture challenges your measurements. Then the truth comes out that you were gaming the measurements and you will be done with anyone trusting you.
Or you hand wave it away...
"Normal variances"
So what is Measurement uncertainty and Measurement error at -120dB?
What if some measurement was taken with an output "clipping" or closes to saturating.
Go on and test at 2/4V as always or see this limitation and test at lower voltage.
I remember some controversy about this with some integrated amplifier dac thing.
In other words, there is tremendous pressure to do things right and the same across full range of products tested.
It is ok to make mistakes.
The question is how you react to them.
Perfections can't be achieved but coming extremely close is all you need to ultimately determine one thing: "is the product well engineered?" That is what you want to know, isn't it? That for all the money you spend, someone cared to build a very high performance product.
Sure this is what we want to know.
But SINAD at 1K 4V 44.1khz with 20khz bandwidth is not the only or way to determine this.
Maye some extra care was taken to isolate the USB gnd from the audio gnd.
This can makes way more real world performance difference then 3dB SINAD at 12xdB
Or headroom for inter sample over.