That might very well be the case. But printing a few remarks on the graph will not really help that.
Actually I think there are at least as many who do not look at the graphs in any meaningful way (as it does not tell them much), but will mainly try to interpret the remarks, the graph is just an illustration at this point.
I would prefer the remarks below the graph like
@KSTR does, but mainly for aesthetic reasons. I do not like the red arrows and the dashed lines either, but that is just my taste and I understand why the arrows are there.
My guess is, that many would like to have a single number (like sinad) for speakers. The preference score does give them that, but Amir is not calculating it for good reasons.