Not incomparable to, perhaps, a chipped or broken tooth. The tongue continually scans the interior of the mouth creating a 3D 'picture' of it in the brain. If left untreated, after a while the chip is no longer noticed as an anomaly, but as an integral part of the 'picture'.
So, while the shape of our outer and inner ears may differ from person to person, do our brains calibrate in such a way as to allow us hear more or less the same things?
I expect the effect to be similar. We pick up all kinds of sounds all day long. Our brain retrieves location information based on what is heard and what is seen. It doesn't care about fidelity, just about the information it can use. Arguably the eye isn't full color and equally sharp as a sensor. Yet, to us it appears as though the eyes are full color and sharp to the edges (assuming no glasses are needed), despite the blind spot we all have we don't see it. The brain makes something from this that doesn't appear to have the actual shortcoming the eyes have. Likewise our hearing also isn't 'flat' either. The brain knows what everyday sounds sound like. When you combine this with eyesight it is even better.
For instance, look at someone playing the piano on a TV. When you only listen to the sound it probably sounds like crap. When you see the piano and thus also see where the sounds are coming from the piano sounds a lot better.
With audio only the quality and accuracy needs to be better. Not to sing along with a tune or enjoy the 'art' but to create a mental map the cues must be 'better'.
So regardless how different the hearing is and the eardrum receives the sounds it doesn't matter. The brain knows how it should sound. This is the self-calibration part. Also the brain can get used to a 'presentation' and learn to accept a certain sound character. In some cases this doesn't happen and after a while we buy other speakers/headphones and decide we don't like it, while other folks have no problems 'believing' the sound.