I guess it’s because majority just listen to music while doing something else, and only critically listen when swapping a component or challenge yourself to see if you can hear it - for 15 mins. only to hear nothing. How many hours you only listen to music, instrument sustains, releases, etc. on your sweet spot, without a mobile phone...
No one can pick the 24/192 over 16/44 (or even 320 mp3) because the material that makes highres better are unknown and subjective. (I’m not talking about on paper comparison) Let’s say the low end bass resolution is a bit bad on lowres vs highres. How do you process this and determine which one is bad in quality. If you never paid attention to what you listen, and don’t have a clue on what to expect from each instrument. You can’t. But, if you listen carefully, the same material, on the same system, you can pick the version that you listen. And easily spot if something is different.
i.e.: Shofukan from Snarky Puppy. Live recorded, very good DR, well produced. Just listen to the trumpet solos - and you can pick something is different on a different setup/source etc. Bass and snare are also good for this but it’s harder to understand what you are looking for on those than the trumpet.