I guess an entirely new topic and not saying you are right or wrong, but I agree in some ways.
I mean over the years have listened to many dozens of speakers, and at times, truly enjoyed some VERY non accurate sound.
I think we have to train our brains in some ways to "Hear" neutral or accurate and use that as a benchmark.
At times I have "Enjoyed" speakers with some truly loud boomy bass, so I can see your point for sure!
But what is enjoyable and a flaw will tend to color ALL recordings so to me often hit or miss.