Well, yes, I was thinking more of the DAC side... what you were describing is nothing less than the venerable "ESS hump". Here's an example:
https://www.audiosciencereview.com/forum/index.php?threads/pcm-vs-dsd.41092/
DSD (a bunch of shaped dither) clearly reduces the "fuzz".
Now that being...