Fair enough, you're being rational and realistic about all this and maybe not testing things in a way that's scientifically rigorous but doing a few things you can do without turning your home into a test lab
The issue for me still remains this one though: how can a person possibly hear anything 100dB below the signal?
Oh I'm not sure what I'm hearing would be something 100db below the signal. I can't tell you since I'm not measuring it, I can just tell you what I hear by going back and forth.
I think that the analyzer tests don't test every possible combination. For example mfg usually post specs at a certain frequency, like 115db Snr @ 1khz. If amir tests at a different frequency, the performance isn't necessarily the same.
Well with music there are many different tones of all different frequencies, and that must have some effect on the performance of the product.
I think this is where amir's linearity test has more weight than some other ones, as it tests performance across all frequencies.
We were also discussing the reduced performance of amplifiers while driving actual headphones due to feedback.
I think that this might also be the cause of what I have been able to hear, simply because different amp topology would respond differently to the loads of different headphones feedback.
It's part of how Amir test of the liquid carbon was interesting to me, not because I am a fan of that amp or expected it to be better. But when we tested it at my house (me and my couple friends into audio) it was unmistakably warmer sounding than every other amp we had here for testing. But in amir's test it had a flat frequency response... So there has to be something else at play here.
before I ever found this site (and I was stuck on headfi) I had drawn various conclusions through my own testing that some DACs were more resolving than others (atleast in my testing). Later on after finding this site and sending amir a box of audio devices, I have to say that I was spot on with my conclusions vs the test results here. I think that possibly amir should try to develop a similar linearity test for amps, as it could give more insight vs what has been currently tested.
The thing that made me look for this site in fact was due to me purchasing Schiit products (after all with the hype on headfi, you end up trying them sooner or later) and finding that they sounded really bad. In fact my fulla2 had a noticeable drop / pop / crack which occurred during quiet parts of classical tracks, my modi multibit had the same issues... Schiit threatened me when I notified them of what I found. So I originally planned to rent an analyzer and invite all my friends with Schiit gear. Upon making a thread about said meet up, Jude sent friends of his own to derail the thread until it was administratively closed.
I was so angry I actually reached out to quite a few audio brands that I thought were honest and asked them to work with me; they were interested in results but largely "afraid" of the Schiit - headfi partnership exileing them too and ruining their businesses.
Thankfully I found Amir here and he was responsive to what I had to say, and well now the rest is history!
I am so thankful for the great work Amir does here to keep the audio scene in check.