Hi all, in a now shut down thread (for other reasons), I suggested that it might be nice to develop community FAQ on standards for double blind testing of components. That is, a guide that lays out some basic principles (e.g., same signal path EXCEPT for the two components being compared, both rater and "switcher" blind to which component is current active, etc.) as a FAQ that we can point to. Might include numbers of trials, appropriate statistical tests, etc. I thought I would start this thread to garner suggestions. One hopes (maybe not?) that we can converge on a set of mutually-agreed conditions that can then be synthesized into a FAQ. Amir did point me to: the "bible of blind testing", ITU BS1116. https://www.itu.int/dms_pubrec/itu-r/rec/bs/R-REC-BS.1116-1-199710-S!!PDF-E.pdf However, it is pretty cumbersome and runs 20+ pages. I am hoping we could synthesize the critical principles in a page or two.
So open to principles to consider including in a FAQ.
So open to principles to consider including in a FAQ.