The reason I ask is I had a very similar experience when using a miniDSP nanoDIGI with the Okto, 6 channels were OK but 8 would not work. I tried many different RCA to XLR cables as well as RCA to BNC cables in to SPDIF to AES transformers but could never get it to work with all 8 channels. Others had used the nanoDIGI with the Okto successfully in the past but had since upgraded the Okto firmware and were seeing the same issues as me. There is more discussion here ->
https://www.audiosciencereview.com/forum/index.php?threads/okto-8-owner’s-thread.13899/post-684285.
I've also heard of issues with the Audiopraise VanityPro requiring an Okto firwmare upgrade but apparently the solution is very hush-hush ->
https://www.audiosciencereview.com/...eview-hdmi-audio-extractor.30440/post-1240789.
I guess I was just surprised that you had issues but were able to get it to work with such an inconsistent selection of cables, although re-reading your post it seems like you are only using 6 channels which was the max I could get with the nanoDIGI.
Michael