So is this going to be a stereo recording at the normal LP, going to be a recording 1 meter from the speaker or what do you have in mind?
While I've not always investigated fully, good amps that sound different have normally come down to FR differences due to output impedance or volt/amp limitations when actually attached to complex speakers.
I figured I'll put the recorder on a tripod in a position where the recording sounds pretty decent with not too much room interaction to muddy the waters. I'll experiment and find a single spot and not move the recorder once located. What amazed me last time I recorded my system was the room acoustics were really obvious although when listening "live" my brain simply locked it all out.
I'll pick a level that will give me a decent lift above ambient noise but not try for silly SPLs. That way, various amplifiers of wildly differing power outputs can be compared all at a similar nominal (normal) level. Preset all the amplifiers to exactly the same output level (V across a common resistor, just in case output impedance is an issue) and use the comparator or simply plug and unplug each amp. Obviously, all the amplifiers will have their tone bypassed, line direct on and no filters or loudness engaged. Any amplifier with a significant variation in frequency response will not be included in the experiment.
Assuming it doesn't turn into an all weekend affair, I'll put the FR plots up for each amplifier (at the preset volume position to ensure variations from pot position are not an issue in differentiating the "sound") and do an output impedance (damping factor) vs Freq if I get time.
The listening room is a mess anyway, so I might as well have more fun.
What do you suggest in terms of period for each sample? 30 seconds? Less or more? I'll pick something where I think the recording is good and use a reasonable pair of 6.5" two ways and identify the speakers once I've sorted the room/recorder/speaker interaction for the "best" sound at the LP.
Now I know people will say "we can hear stuff the recorder can't so the experiment may not prove anything" To that I say, it doesn't matter. The recorder should capture any audible differences between the various amplifiers if they are as clear as I think some can be. I'm prepared to be wrong and admit it. Maybe, depending on how good and identical the file lengths and levels are, perhaps PKane's difference software may come in handy to look at the results?