I finished designing a PCB for a 4-output Toslink module about ten days ago. However, the connections between the Pico and the module are wired, which isn't technically ideal (but it does allow for connection to other GPIO pins).
Ideally, I'd like to create a motherboard/breadboard onto which the Pico could be mounted. To achieve this, we would need to be certain of the GPIO pin assignments and, above all, that this assignment is always permanent (by design, of course) (but especially that there are no conflicts with fixed utility GPIO pins!).
The 4-input and 4-output Toslink [FCR684214T & FCR684214R] would be directly connected and "stabilized" by the PCB, but the other GPIO pins would be left "free" with a corresponding wired connection pin for other, less sensitive applications (connection to a screen controller and clickable scroll wheel (I2S?), IR input (I2S?)...).
I imagine that GPIO pins 2, 3, 4, and 5 would be dedicated to the inputs? What about GPIO pins 10, 11, 12, and 13?
In any case, the DSPi firmware isn't yet sufficiently developed for the scenario I envision, so we'll just have to wait for its completion. Aside from the input/output types and PEQ (which are already implemented), the essential element
- for DIY speaker builders - lies in the crossover filters (first and second order, Butt 1 to 8, LR 2, 4, 6, 8, Bessel 2 to 8... and why not add more exotic filters? + Linkwitz transform). Once that's done, all that will remain is managing volume control/presets via IR receiver, dial, the Pico's Wi-Fi/Bluetooth chip using a mobile app, or whatever.
Whether you push the project that far or not, what you've done (headphone and room correction) is already very nice and sufficient in itself. I know you're going and are going further, probably more than I could imagine, but perhaps less as well... But that's not the important thing : "Caminante no hay camino, se hace camino al andar"* (
"Traveler, there is no path, the path is made by walking") (
"Cantar de caminos" by Antonio Machado)
Here's an interpretation of the poem by Juan Manuel Serrat:
(After all, we're here because we're "enlightened" music lovers...) 
*And for general knowledge, here is the original poem and its English translation:
"Caminante, son tus huellas
el camino y nada más;
Caminante, no hay camino,
se hace camino al andar.
Al andar se hace el camino,
y al volver la vista atrás
se ve la senda que nunca
se ha de volver a pisar.
Caminante no hay camino
sino estelas en la mar."
"Traveler, your footprints are
the path, and nothing more;
Traveler, there is no path,
the path is made by walking.
By walking, the path is made,
and when you look back, you see the trail that will never
be trodden again.
Traveler, there is no path,
only wakes on the sea."