A common argument I've seen against SPDIF, especially optical TOSLINK, is they sometimes use the incoming data as the clock source, which could potentially have a lot of jitter depending on the source, compared to asynchronous USB DACs which use an internal clock. But I also know some DACs...