I've replaced the original power supply with a better and more powerful one (smps, not linear) that I had lying around, I don't have any decent measurent equipment but I haven't found any noticeable differences.
Regarding replacing the electrolytics I don't think that any of them are in the audio path, and particularly regarding the two elna's they are likely connected to the opamp's power supply pins and capacitance should be enough (you have even reduced it as you said).
The only odd behavior that I've found and can't explain is that when using asio the sound is brighter (for the worse) than when using wasapi (both with foobar2000). Wasapi and spdif sound mostly the same, neutral, while asio sounds artificially more detailed (just brighter), and plain wrong to my ears.