Two hour suite though? That doesn’t sound too practical. Like imagine that on top of something like a 30 minute thermal test.
There’s also the issue of needing to get liscence free music, on top of opening yourself up to critique about music selection.
Again, the test itself doesn’t strike me as something unsound, but as you can see, noise of 1-2db of difference is hardly something I think is worth exploring beyond recognition of its existence for said device. I imagine a difference of something like 2db is seemingly only an issue with respect to final output through headphones or speakers that distort far worse than any modern DAC. A 2db diff between something like 120db SINAD and 122db SINAD seems uneventful in the least even if such diff manifests in the first place using non coherence as a metric.
Also, at these levels with the AP pushed to its limits, I imagine breathing (metaphorically speaking) over the devices as they run - would have an impact.
You’d also have to be careful on measuring noise separately (unless I misunderstand non coherent distortions).
So again, I’m just not seeing the value. Great for theoretics, and for someone that really wants to dig deeper. And possibly a test suitable if he never transitioned to testing speakers (though I’d say possibly better for speaker testing), but in reviews where I have to bug him to run Toslink measurements, SINAD over Power level, or SINAD over time, or just filter performance. I doubt this is something Amir would run. The work itself isn’t daunting as you can just create a single file of the entire suite, the time required is the problem.
I'm not proposing to use the full 2-hour test suite, for the vey reasons you mention. I'm proposing to use the
already standardized and widely used BS EN 50332-1 'Program Simulation Noise' test signal (described toward the bottom of
this page), which was originally devised to have spectral content representative of music and speech for testing audio devices. This test signal is
just 30 seconds long. As I said, SoundExpert's previous measurements have shown the null difference metric using this program simulation noise to be
consistently just ~1-2 dB higher (worse) than the same metric calculated using the 2-hour real music suite, over all devices tested (45 so far), and using different ADCs. This is strong evidence that the program simulation noise would make an
ideal analogue to worst-case real music (i.e. music that would produce the worst distortion through the DUT) to use in the null difference measurements instead of the 2-hour test suite. So that's just a 30-second recording and a few mouse clicks in the software to measure
all possible sound degradation of any part of the electronic audio reproduction chain. I can't think of a quicker, easier measurement with as much utility as that. Well worth a try at least I reckon. (The non-coherent distortion metric mentioned in the video I linked isn't directly related to null difference measurements by the way - I just mentioned it as it also uses music as the test signal, and to demonstrate that the standard multitone test is poorly correlated to sound quality.)
I see there are several owners of an APx555(B) in this thread - would any of you be willing to try out these null difference measurements using your AP analyzers? Preferably recording a device already measured here on ASR so correlations with SINAD can be made, but any data would be useful. A loopback null test would also be interesting to see the upper limit of the APx555 in terms of the null difference metric.