The biggest (and most obvious) problem associated with loudspeakers is dealing with the room acoustics. Not only do different designers have differing opinions about how to do that, but rooms are all different sizes and shapes, with differing degrees of reflectivity, so the problem is even more complex and more difficult to deal with.
I was in Japan in 1975, and visited a research center for audio. As part of a demonstration, I, among others, was led into a dark room that had one single chair in evidence. I sat down, and the most amazingly real jazz trio played in front of me, club environs and all. The piece played out, and the lights came up, and I was in an anechoic chamber. In front of me were two medium-size speakers. They appeared to be 8" two-ways.
In discussions with the presenters, there were statements made that (at the time) surprised me. They said that 1) the recording didn't sound the same in a normal room. In fact, it didn't sound very good at all except in the chamber. 2) The speakers sounded hugely different outside the chamber, and 3) for this arrangement to work, head positioning was critical.
I was unable to really appreciate what I had just heard, and went about my way, searching for speakers that sounded good in my normal living environs. But I never forgot that the best sound that I had ever heard was in a controlled environment that removed the room from consideration.
Jim