Even a one bit error can be extremely audible - it just depends what bits you hit and hence how loud the "click" is.
PeteL seems to be confusing a couple of things - sure, skipping or repeating a single sample likely won't be terribly audible, because that doesn't introduce a large waveform discontinuity.
But actually changing the value of a single sample to something different from the surrounding waveform can be extremely audible as a click, depending on how much you changed it. You're potentially injecting a huge spike.
Digital systems are all designed to run with robust bit integrity in their entire transmission chain in mind and will fail spectacularly when it doesn't.