I’ve had the M500 for about a month now and until just a few days ago I also experienced various similar problems as many report in the forum of an subtile popping sound in between tracks and on various occasions in tracks or changing track. This really made me believe the DAC was faulty as I have a pretty good technical understanding and tried to solve it in any way possible (drivers, software, OS, connections, EC, jitter etc).
So after being annoyed at this problem for a while I simply tried what I least expected solving anything and changed the USB connector in the PC from USB 2.0 to USB 1.0 and voila, problem solved and heaven unfolded as I finally was able to enjoy the crispy wonders of MQA delivered as smooth as silk. Maybe it was due to non compatible drivers etc.but this solved it for me and I believe many experiences similar error.
When it comes to optical signal from TV there was also a sound problem solved by changing the audio output format in the audio menu of the TV.
The golden rule is to suspect user error first while exploring new technologies such as the M500 and secondly be careful of prematurely judging the device in reviews as it really can make benefiters believe there is something wrong with it rather than the competence. .