So I tried pink noise, periodic and random, no change.
I tried putting it on a pillow rather than my desk, no change.
I used the RTA tool in a silent room, no change, those spikes were still there.
I moved the USB cable from the eGPU I have (it's connected with tbolt4) to be directly connected...