There are likely ways you can reduce the spring tension on the click-stop points in the attenuator. Back in the day, I used to bend the spring plate back a bit with ball bearing detent switches to give a "nicer" feel to the operation.
Many such switches can be modified to feel "nicer". Take out the postional detent altogether and pack the shaft/sleeve with 500,000- 1,000,000 wt silicone oil (used in R/C cars differentials). The contact points are usually so close together the wiper never ends up in no man's land.