They don't need really to "know about music", listeners rather punish colorations of any kind and these are very clearly audible even on unknown music or even test signals.
The test material is wisely chosen having a broad spectral density as this way its more revealing tonal flaws
http://seanolive.blogspot.com/2010/03/method-for-training-listeners-and.html
If I could not imagine that the theory of preference, so celebrated here, would need an addition, then the term 'science' would probably be inappropriate.
I think the 'science' should be clarified in several places. Conceptually I am not quite clear what 'preference' means. The term seems to be self-evident, but even the mapping of statistically maybe secured binary yes-no decisions to a
ratio scale ( see:
https://en.wikipedia.org/wiki/Level_of_measurement ) seems to me worth considering. Nevertheless, it is very often treated here as if it were a yardstick.
This is also done quite naturally with
qualitative studies, for example from the AES smoke screen. They are simply evaluated
quantitatively without any sense or understanding, as if man were a diesel engine.
Well, that said, I would like to say that in my opinion there is a difference between listening to stupid records of unknown intention on the one hand, and enjoying music on the other hand. Listening is focused according to your interests. How can you take for granted that there is no difference between listening and hifi-testing? This will copy through to 'preference', if that does make sense at all.
For purely logical reasons, the circle of confusion sends its regards, there can be no valid evaluation of a loudspeaker based on unknown recordings. At least not if only linear characteristics are to score. Because the linear parameters are left to the arbitrariness of the sound engineer. He mixes the mix. Even in largely unknown surroundings. The listener cannot know what is right! ( Consider the case that engineer and producer both expect You (!) to have a bad taste, and try to shape the sound to Your expectations *g* )
How much more are parameters of secondary importance that are first created in the mixer's control room, where they influence the mixer's taste, implicitly but not explicitly make it into the recording, and then created in a completely different way in the comfort of your own home?
I find it ridiculous to argue about a few dBs here and there. Anyone who does that simply hasn't understood the concept. ( Let alone the more technical problems with "averaging rooms" 8-] )