Nonsense.I'm convinced my speakers, your speakers and 98% of enthusiasts speakers are too small. Too small not only to provide enough headroom for uncompressed loud dynamic peaks, but too small (and inefficient) to provide micro-dynamics at lower volumes. Increasing amplifier wattage does not solve this issue.
I can't see a way out of this scenario, big speakers aren't exactly inconspicuous (or beautiful for that matter), but I think of the reviews of 5" or 6" bass driver bookshelf speakers looking for ever better measurements could just be chasing our collective tails. Is there really something groundbreaking yet to come out of such small speakers, however expensive?
Even the Genelec Ones have an optional W371A bass unit to go with it, to free them up from reproducing the difficult bass region, suggesting that for all it's clever design, you can't fight physics and what physics demands is more cone area & larger cabinet size.
If you have the space (and most of us do), then what you need are bigger speakers.
Sorry about your size anxiety.