The crux of the matter is in your first sentence: "Perhaps more important to me personally, the preference scores correlate quite closely with my interpretations of the data."
As for the Harbeth, one can argue that many people disagree with your assessment that their Spinorama performance is not representative of their success appeal (see below).
But we are discussing preference, not quality.
I think that here, in my view, is where the problem lies. Preference is what people like and choose, not what people should be buying.
I also find it unacceptable that speakers with very different SPL and LF extension capabilities all be put in the same baskest. The smallest Genelec may perform admirably in all parameters but it just can't be used without subs in typical domestic circunstances and thus cannot be compared with a large standmount or small floorstander with larger cone surface and cabinet volume.
Finally, even though the rather limited research in regard to driver + cabinet resonances and harmonic + intermodulation distortion might indicate a very crude audibility threshold perhaps too much emphasis is being given to directivity comparatively.
Either way, I really don't think that the preference rating is of any use; fortunately I'm able to interpret the measurements and draw my own conclusions.
You misunderstood my comment about the Harbeths, or perhaps I wasn't clear enough
; I meant that I didn't expect it to score as well as it did, though now that I understand the formula better I see why. I get your point though.
I definitely agree that it's great many of us here can come to our own conclusions about the data, but I would contest that anyone is really putting speakers like the Genelec in the same basket as larger speakes. I would imagine most buyers, at least the ones visiting this site, would know they need to buy a speaker that fits their needs and that active speakers especially are limited in output capability.
It's pretty clear to me that the preference score denotes preference within a speaker's comfortable output capability. If you exceed output capability, the speaker distorts or compresses, and that's a change in frequency response. I'd expect the Genelecs to win a double blind-test in a small room or studio setting against a mid-ranked speaker. I would not expect the same in a large living room or auditorium. And in any case, I feel most of us here primarily look at the with subwoofer score, as most ASR readers use a sub (at least based on a poll a while back). That opens up SPL capabilities for a whole lot of speakers. It would be good to be able to test output capability more systematically though.
I also disagree about directivity; I think not quite enough emphasis has been placed on it in the reviews so far
and in general in forum discussions. To that point...
I very much agree with this. Narrow dispersion means that the room has less impact on the reproduction and in my view should be considered more accurate. Wide-dispersion may sound nice to some people (as does a pinch of 2nd harmonic) but it's the result of room-induced "colouration".
And this is why we should be talking about directivity more; it's one of the areas where it seems people have the most subjective preference (as opposed to frequency response and smooth off axis in general) even among good-measuring speakers. Some people have very strong feelings about narrow directivity, but based on the research I've read, it
seems most (including yours truly) prefers speakers on the wide camp.
My arguments for wide: While intuitively I see your point on narrow directivity, part of the Toole research is that people are good at separating the room from the speakers (above the transition frequency). So unless there are some egregious colorations in the room, I wouldn't say it's less accurate. It's also worth considering that the narrower the directivity, the more you will exacerbate the interaural crosstalk dip in the upper mids inherent to stereo. Admittedly, I can't quantify how much worse it is with stereo, but subjectively it's something I've noticed in my own evaluations.
On the other hand, narrow directivity speakers let you adjust perceptions of spaciousness more via toe-in, which can be nice, though usually at the expense of having a smaller sweetspot.
The way I always view narrow vs wide directivity when it comes to stereo playback is that the latter transports you to the recording space, while the former invites musicians into your home. Problem is, I rarely find the former illusion convincing because the room is already so present - so my preference is for the wide camp. Things can vary significantly from recording to recording though, and multi-channel changes everything.
Of course, it's not black or white. There's a lot more nuance to it than just "wide" or "narrow." It depends on the frequencies and angles we're talking about, and I can't even really say where the cutoff is between wide or narrow, only in larger contexts or in direct comparisons. And heck, sometimes I prefer narrow directivity speakers to wider ones. But increasingly I find, not usually.
But that's just my, ahem,
preference.