That's a popular MYTH. While IT'S TRUE that you can burn-out a speaker by pushing the amp into clipping, higher power is even MORE DANGEROUS.
Why Do Tweeters Blow When Amplifiers Distort?
Voltage, current, impedance and power are all mathematically related. (You can look-up the formulas if you're interested.) If your amplifier is putting-out 100W the only way to get more current is to increase the voltage which also increases current and power.
Or, lower impedance speakers will "pull" more current and power. Or if you put two 8-Ohm speakers in parallel you've got a 4-Ohm load. Assuming the amplifier can handle the 4-Ohm load, they'll both get the same voltage, current, and power so the total current and power are doubled.
Or with no speaker connected (infinite impedance or resistance) the voltage is still present but no current flows and no power is coming out.
You might need bigger woofers or a subwoofer. Size isn't everything but you aren't going to get "realistic bass" that you can feel in your body from a tiny woofer.