Another idea which may have fatal caveats: what about using the Rpi5 pins to connect all 4 stereo data signals for I2S to a proper 8-channel DAC-chip, e.g. diyinhk's ESS9028PRO
4 layer PCB, two solid middle ground plane NDK NZ2520SD 80Mhz low phase noise oscillator USB Type-C socket, Gold plated RCA socket Three ultralow noise 1.2V linear regulator Free 0.96 OLED display until stock last
www.diyinhk.com
The DAC card would act as master clock and the Rpi5 hence slave. Output in 8 channels would be perfectly time-synced. No need for XMOS USB->I2S-card and also no need for reclocker on the DAC card (since it is master anyhow).
Aim would be to surpass the performance of Hifiberry's DAC8X at similar cost. I "need" 8 channel output from my Rpi5 running Moode/CamillaDSP for an imagined 4-way active drive system

Fairly happy to spend some money on high value items like amps and tweeters etc. but not on a fancy studio USB interface that I otherwise don't need.