Wow, this sounds like every second recording is smashed against the limiters... I know people who have worked on some of the recordings mentioned, and I've worked on plenty of others. I'm pretty sure nothing was deliberate;y clipped in the recording.
A few things people may not be aware of - no engineer deliberately clips a recording, or an internal buss, EVER. Mixed recordings are usually delivered for mastering at -1 to -3 dBFS.
Compression and limiting started with radio (danger of over modulating the transmitters), it is also useful for a lot of pop recordings, particularly if they are on analogue media or are listened to in less than pristine environments. The limited DR makes for a better listening experience for most listeners.
Due to the historical use of mild compression, tape compression and limiting, pop records traditionally have that sound, so today it is still practiced, it is a style issue. Classical recordings almost never see a compressor or limiter, even in analogue days (listen to the Decca 1963 recording of Miserere - LOTS of tape hiss).
Thrash metal made clipping into an effect that was used to make it sound harsher (sigh) that has sometimes been used on other types of music, but it is not common.
Mastering engineers hate clipping as much as you do, and love dynamic range as much as anyone, but they usually have to compress the recordings they get (ok, not classical) to satisfy the record company and the producer. If they refuse, the job just goes to another house...
Extreme compression was only available with digital media because it has "look ahead" algorithms instead of realtime operation in analogue production workflows. This led to the loudness wars. There has been a huge amount written about the Loudness Wars, check up what (for example) Bob Katz has written about it. It might be over, too bad for the recordings that have been released that way.
If you want to complain or change it, complain to the record companies, they are the ones who are insisting on recordings being "louder" and the compression etc that delivers this. And vote with your wallet, do not buy sub-par recordings. Tell the record companies that you would buy the music again if it was released UNMASTERED, if the original mix was released with full DR. They might get enough requests to take notice...