Soooo... It seems like it's a room issue. I've tried the mic at 0 and 90... No difference in the results. Thanks to all for helping me out here.
I don't know what I might have done before when measuring at 1m, but now I'm measuring at 1m and the roll off looks as to be expected. Sadly I can't...