Whether by measurement or ear, how do we determine "a winner" with software that's designed to modify the
incoming signal?
I'm no EE but I guess there's a way to measure any THD or noise introduced? SINAD?
When Amir reviewed Audyssey + Editor, he did so only in a basic UI subjective way.
That's not a criticism, simply an observation.
Exactly, what do we compare?
Which makes a flatter FR at the listening position, auto-magically?
Which is getting the distance for each speaker more accurately determined?
Who's is easier to set a desired room curve with?
I could go on but the software's job is to modify a signal, not be transparent.
So who's does a better job at not being transparent? LOL
Sure - but it is only relevant if you are looking at it in a perfect environment.... ie: an anechoic chamber, where there will be no reflections, no room effects etc...
The point of Room Correction software, is to take an imperfect environment, and adjust it for improved psycho-acoustic performance.... the key being "psycho acoustic".
The first thing one has to accept, is that the room is imperfect (non transparent, if you prefer!) - once you are past that, the question is, what can be done to ameliorate that inherently flawed environment.
You can perfect the environment, and then use the signal "RAW" - but that environment (anechoic) is a truly horrid place to listen to stuff in!
In reality stereo and surround recordings, are designed to be listened to in a living space or movie theater, environments that are imperfect, and have inherent flaws.
So, transparent to what!? - Transparent how!?
And of course all of this through those least transparent of all components... speakers - with most people's speakers having THD of over 1% (especially in the bass)
What some of the Room EQ systems are now starting to demonstrate (eg: Dirac Live ART), is that active correction, which is effectively another step away from purist "transparency" - gets substantially closer to achieving perceived transparency.
I have no idea what a system of measurement to identify perceived transparency would look like. But our current measurements are designed to identify signal transparency, in one dimension only... and now we are talking about perceiving the end result of that signal in a three dimensional domain.
To some degree, this will force us back to subjective evaluations, while the tools for objective measurement are developed.