Yes, this is a real possibility on the RPi 4. The earlier RPi had a messed up implementation of the USB controller chip or something, and was not suitable for jitter-free streaming.
But the appeal of the PecanPi is that it's a single box, and at the same time it's one of the best DACs around...