I've tried Equalizer APO, same thing happens. I've also tried changing players to Music Bee and Foobar. Still the same.
I have the EQ sliders all at 0, then up around 5, 3, 2, for the lowest frequencies.
As you can probably tell, I'm not really sure how all this works, but using the headphone...