Your argument hinges on Amir’s subjective listening not lining up with the preference score.
I don't agraee that the "measurements don't agree with the subjective listen" argument hinges entirely on the Olive preference score. I think that even looking just at the spinorama, there is still a disagreement that exists between objective and subjective. Going forward in this thread, I think we should probably just ignore the Olive score altogether and focus on what's different in the actual measurements.
I think that carefully comparing the measurements of this speaker against the measurements of the M106, M105 and M55XC can help to show why this speaker doesn't sound as good as those other 3(at least post EQ). Given that those other 3 speakers sounded excellent, there must be some attribute that they share that the SVS lacks. Find the variable contained in A, B, and C, that's missing from D.
Ideas(many of these already mentioned by others):
1. Directivity Error(bottom half of spinorama)
Many have pointed to the directivity error as being the cause of the brightness, but I don't think it's that easy. Both the M106 and the M105 have the same directivity error, and both of those speakers still sound excellent. Some have suggested that the directivity error is due to trying to integrate a 6.5" woofer to a dome with no waveguide, but why does the M106 and M105(which do have a waveguide, and smaller woofer) still show that directivity error? Is there more going on there that I don't understand? I guess that's a question for those who know more than me.
Here is the SVS side by side with the M106, with the directivity error circled. Looking just at this spinorama, the magnitude of error seems about the same, or maybe 1dB worse on the SVS.
So, just looking at the spinorama, I don't think it's obvious that directivity error should be the sole cause of harshness here, otherwise it would have also doomed the M106 and M105. I do think directivity is a contributing factor, though.
Note, the spinorama groups vertical and horizontal together, so maybe there's an error in one that's masked by the other? That's one of my ideas I show later.
2. Overall tonality(top half of spinorama)
I would say that these two speakers have very, very similar spins. To my eyes, the M106 looks slightly more neutral on axis, while the SVS seems to have slightly smoother ER and SP measurements. I certainly don't see anything here in the comparison to suggest that one sounds excellent, while the other sounds bad, and the M105 looks very similar. I don't think anything in the top half of the spin is obviously to blame for the bad sound the SVS exhibited. The M55XC is another good comparison here, as (to me) it looks to have an overall much less neutral response. If the top half of the spinorama is to blame, then I think it would doom all 4 speakers, especially the M55XC. In fact, the M55XC does have what I would call bad tonality, but it makes up for it by having the most consistent dispersion of the speakers here.
*Notice the lack of directivity error in the M55XC!
Having looked at both the bottom half and the top half of the spinorama, I honestly don't think the error shows itself here, though I do think the directivity error is part of it. A, B, and D all have excellent top halves. C is the only one with an error free(mostly) bottom half, and yet A, B, and C are the ones that sound good, subjectively.
Going beyond the spinorama,
3. Distortion - at first glance, this speaker seems to have pretty good, low distortion. It's very comparable to the M106 and better than the M105. However, as
@lashto pointed out, the SVS's distortion is mainly H3. I definitely think he could be on to something here, as both the M106 and M105 have lower H3. I definitely think this could be a contributing factor(good eye), but it can't be solely responsible, as it would have doomed the M55XC, which has comparable H3 with worse every other type.
5. Horizontal Dispersion - Here's where the M55XC really shines, and where (imo) it makes up most of the ground it lost with tonality and distortion. This is also where I think the SVS commits a sin that none of the other speakers do. The difference I see is, the SVS is firing off considerably more excess horizontal energy in the 2.5kHz - 8kHz region than it is in the 800Hz - 2.5kHz. Not sure how big this issue is, but it's something I noticed. Could the excess horizontal energy in the upper mids and treble - combined with the lack of horizontal energy in the lower mids - be a contributing factor towards that "harsh" sound that Amir(and many people who've heard this speaker) heard? Comparison between SVS and M106 below. I've drawn a blue line to help illustrate what I'm talking about.
As you can see, the M106 still has a similar horizontal directivity glitch, but it looks less severe(imo). The M106 looks much closer to a consistent width beam. Why doesn't this show up clearly in the spinorama's directivity index? The directivity glitches seem very comparable in the spinorama, but much less so here. The M55XC is actually the star here. It has by far the most consistent beam.
Anyways, those are just some ideas. I think there's probably multiple things going on here that cause the objective measurements to not be as near perfect as they seem at first glance. Likely it's several small magnitude errors that add up to a sizable change in sound. Even adding all the measurement errors together, though, I still can't honestly say I would expect one speaker to sound excellent and one to sound bad, but I have a lot to learn I suppose.
I've found that I generally prefer keeping the first reflections, but I think this could be a speaker that might sound better by absorbing them. Amir was unable to tame the harshness with EQ, but I wonder if he might have been able to tame it by absorbing the first reflections. This speaker is firing off extra treble energy to its left and right.