I am by no means a expert on this, so take everything I say in this subject with teaspoon of salt.
With that said, from my understanding; a
completely floated system (source, dac, amp, etc) solve one problem: Ground loops. However, the rising enemy for such systems are current leakage or also referred to as capacitance leakage. SMPS are the worst offenders, but all power supplies will leak, even batteries. This leakage has nowhere to go and will cause issues in one way or the other (pun intended).
The second enemy that arise, as a good number two, is EMI. In other words the chassis/shielding becomes an antenna that picks up noise. With some clever management of separating signal ground and chassis ground, one can sort of 'deal' with the EMI in a floating system. I believe a balanced system (xlr) does exactly this for a floating system, while it alleviate the issue of ground loops in a grounded system.
For the case of current leakage, the only way to deal with it is to have as little of it as possible.
Linear power supplies is one way to go, since they have very low current leakages, but that have other problems on its own.
Another way is to connect a earth ground to the DC neutral before it goes into any equipment in the floating system. John Swenson have done some testing on this and parts of the journey is documented here:
https://audiophilestyle.com/forums/topic/37034-smps-and-grounding/. There are some interesting posts there, where they experiment with grounding the chassis vs signal ground as well.
I am not sure if this is the issue that NTTY has in his case, but since this is my latest rabbit-hole, I guess that "a man with a hammer will treats everything as a nail".