Are we talking about the same "speed" that usually is referred to in 'high-quality' subwoofers, like "fast" drivers?
If so, this is the ability of a driver to
stop its impulse. Usually not a problem with small drivers due to a relatively low mass, but certainly something to take into consideration with big drivers.
For simplification only, I would refer to "small" woofers as ≤ 10" in size and to "big" woofers as > 10" in size.
Rythmik Audio, for example, call their solution '
Direct Servo', which is nothing but a "stop motor": an additional sense coil that gets its feedback through the amplifier without delay, to stop any given movement. The effect could be measured via
group delay; and will manifest in
magnitude of distortion.
====
Edit: A similar phenomenon could also be the reason in lower quality tweeters.