It's not about the motion of the speaker, but the motion of the air. Why is your subwoofer enclosure made so sturdily? To prevent the enclosure itself from vibrating with the large changes in air pressure going on inside. As the enclosure expands and contracts with that pressure, the outside of the enclosure will create pressure waves that you can hear. It's a transducer itself.
Isn’t the in-wall speaker an “infinite baffle” kind of device?
I don’t know much about this.