Does it need to be a progressive difference? If not, and if you can stream to a rpi, you only need to setup camilladsp and apply a negative gain to one of the channels. I use a small zero 2w with moode as streamer for my headphones rig, it is very easy to forget it is there. If you prefer to adjust as needed, you can also build a hardware control, but that is more involved.