No, I wouldn't expect any. You've pretty much got 22 dB of extra dynamic range over even the best recordings and distortion levels that are inaudible as-is. For a line-level source, that's really as good as it needs to be.
According to
here, the Stream Magic 6 v1/v2 (which I assume this is) even slightly beats its specs with a 114 dB(A) dynamic range over XLR (maybe RCA is a bit worse), and distortion of a -60 dB tone comes in at 0.04% or -128 dBFS, so linearity is to something like 21 bits.
Note that the unit seems to be using an upsampler which is likely to hard-limit at 0 dBFS, so I would make sure that enough digital headroom (maybe ~3 dB) remains at all times, especially for hot recordings. Not sure what your options are in this regard. Looks like you'd be in much the same boat as
this guy. If you are already streaming from a media player that can apply ReplayGain on the fly (Foobar2000 with the UPnP Server component being one of them), you'd be fine, otherwise this is a route I would investigate. Obviously providing enough headroom for hot recordings is more of a side effect of RG, but a welcome one.
Should you find that applying RG drops your max levels too much, don't sell your E30 just yet and use that between the Stream Magic and the E50 (with an adapter cable) to provide the extra gain required if need be. I would shoot for handling of not only RG enabled, but about -3.5 dB of preamp as well - then even the most dynamic recordings (e.g. some Mahler symphonies) should be within the setup's reach.