It's not irrelevant. Sometimes the other aspects will cancel the uneven response, but sometimes they will enforce it. What one should aim for is, where they have control, have neutrality.
The chase for -80dB THD is meaningless, other elements introduce distortion orders of magnitude larger...