Not necessarily.
#1 are you using balanced or single-ended connections?
#2 do you know what your AVR and sub do to the signal polarity
It seems to depend
My understanding is that the Fosi's maintain signal polarity when you use balanced connections (there is a little debate about that actually, hopefully someone can clarify) whereas the signal polarity is reversed when using single-ended connections.
So: IF you are using balanced connections AND your AVR/Sub also maintain signal polarity THEN connect everything up as normal.
Otherwise you need to work out what's going on and connect accordingly.
You can just wire it all up and listen to it too