Did a little experimenting with sweeps and RTA tones for distortion measurement. I'm not sure we can get there from here.
With both I found moving the Umik 1 even a few inches could alter the distortion significantly. Sometimes 20 db for RTA use. Just for instance using a 780 hz tone and RTA several feet from speakers, I could get .134 % 2nd and .454 3rd, move it six inches resulting in 2.55% 2nd and 6.34% 3rd. Going 6 inches further gave a result of .444% 2nd and .874% 3rd. Obviously at least two are wrong for what the speaker is doing and probably all of them. Peaks and dips for standing waves are a problem.
Similar problems though of smaller magnitude with sweep based distortion measures. And whether you get a lower resulting distortion with long, short or medium length sweeps depended upon where in the room you put the microphone. Getting close to the speaker also didn't seem to help.
Or am I doing this all wrong?
Getting close should give an improvement, but perhaps only significantly so if the speaker is far away from any reflective surfaces and the room is relatively dead. For example, if there’s a 1:2 ratio between the the path lengths of the direct sound to reflected sound, that’s just a 6dB difference, and that’s not even counting subsequent reflections, which will reduce the difference even further. You can imagine that if you hope to benefit from getting close, that ratio will need to be very very low, indeed well within the room’s critical distance at
all frequencies of interest, if the measurement isn’t to be dominated by room effects. What makes this probably uniquely more difficult than in-room amplitude response measurement is the comb filter effect. If a harmonic falls on a “tooth” of the comb, it just won’t show up in the measurement, and smoothing can’t fix this. Averaging a number of measurements might help, but it will still very hard to know your measurements reflect reality.
If you can take the speaker outside or have a very large space inside somewhere and can then get the mic quite close there, you’ll get a more reliable result I reckon. Otherwise you’re really just stabbing in the dark IMHO.