@amirm , am I correct in assuming that you test AV analog and digital electronics to see their electrical and data manipulation performance, and test speakers to measure their pseudo-anechoic performance - and that listening evaluations are only an occasional add-on to satisfy your curiosity?
It seems to me that if you were to try to evaluate the acoustic performance of components in a loudspeaker-based system (your primary home AV rig), that would be a whole 'nuther layer of time-consuming work. And since only double-blind ABx testing is truly worth anything from a scientific perspective, truly objective audio testing would be huge task with multiple volunteer listeners over many days of repetitive testing.
I see your work as an attempt to level the playing field in an environment where manufacturers play loose and easy with few standards and little to no enforcement. I like the fact that I can visit ASR and compare products that have been tested in a uniform manner, and where designers and manufacturers can come and confirm things, or plead their case if they disagree or dispute the findings.
ASR is a science-based (oriented?) web forum, not a hardcore science website per se. Anyone who has worked in science can easily see that. To mee, the professional engineers and designers who come here provide peer review, and the rest of us are like those who write comments at any science-reporting website.
I was called out for referring to the Monoprice AV processor as "flawed", but as long-time AV enthusiast who is not a technical professional in the field, I agree with others who have supported you in saying that this component - at $4k - could have done a few things a bit better. When you get up to 30 to 40 AV processors and receivers tested, we can take a better look at the matrix of test results and see where any particular unit stands in relationship to its "peers".
It seems to me that if you were to try to evaluate the acoustic performance of components in a loudspeaker-based system (your primary home AV rig), that would be a whole 'nuther layer of time-consuming work. And since only double-blind ABx testing is truly worth anything from a scientific perspective, truly objective audio testing would be huge task with multiple volunteer listeners over many days of repetitive testing.
I see your work as an attempt to level the playing field in an environment where manufacturers play loose and easy with few standards and little to no enforcement. I like the fact that I can visit ASR and compare products that have been tested in a uniform manner, and where designers and manufacturers can come and confirm things, or plead their case if they disagree or dispute the findings.
ASR is a science-based (oriented?) web forum, not a hardcore science website per se. Anyone who has worked in science can easily see that. To mee, the professional engineers and designers who come here provide peer review, and the rest of us are like those who write comments at any science-reporting website.
I was called out for referring to the Monoprice AV processor as "flawed", but as long-time AV enthusiast who is not a technical professional in the field, I agree with others who have supported you in saying that this component - at $4k - could have done a few things a bit better. When you get up to 30 to 40 AV processors and receivers tested, we can take a better look at the matrix of test results and see where any particular unit stands in relationship to its "peers".