However, a pot in the middle, placed somewhere between the gain stage and output buffer will definitely lower the output background noise and very sensitive IEMs will feel better with pots instead of DAC's digital volume control.
Really? And how exactly pot lowers the "background" noise?