Very curious. My experience is totally different.
I have a MacBook Pro M1 (2021) and a Mac mini M1. Currently on Ventura 13.1 on both devices.
Connected directly from USB 2.0 type C (and A from the Mini) to a RME ADI-2 DAC (USB B) and a HIDIZS S2 dongle DAC (USB C) and have NEVER experienced audio drop-outs not due to source stream nor have I heard popping/crackling.
Players used: Quobuz App and Roon, and sometimes Apple Music
Also often use headphones direct from the MacBook headphone jack, without any problems.
I have not experimented specifically under various system loads but listen while working so can only assume my system has been under reasonable load during periods where I've been listening i.e. multiple apps open including lots of tabs in Safari, MS Excel, and MS Teams (a terrible app performance-wise).
Not sure how much of the above is helpful but just thought I'd share my experience.
I have a MacBook Pro M1 (2021) and a Mac mini M1. Currently on Ventura 13.1 on both devices.
Connected directly from USB 2.0 type C (and A from the Mini) to a RME ADI-2 DAC (USB B) and a HIDIZS S2 dongle DAC (USB C) and have NEVER experienced audio drop-outs not due to source stream nor have I heard popping/crackling.
Players used: Quobuz App and Roon, and sometimes Apple Music
Also often use headphones direct from the MacBook headphone jack, without any problems.
I have not experimented specifically under various system loads but listen while working so can only assume my system has been under reasonable load during periods where I've been listening i.e. multiple apps open including lots of tabs in Safari, MS Excel, and MS Teams (a terrible app performance-wise).
Not sure how much of the above is helpful but just thought I'd share my experience.