-
WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!
Actual Double Blind Studies
- Thread starter hawkjeff
- Start date
Good double blind tests are very difficult just to get arranged and organized.
Subjective types don't want to be involved for fear of failing to hear the things they constantly claim to hear.
Objective types don't want to go thru all the work because TBH, so much of audio is a solved problem and many already
know what the outcome will be and feel it will be mostly a waste of time. Only in cases where determining the audible levels of things like say distortion, jitter, SINAD can you get much enthusiasm pumped up...
It's a strange, strange world we live in Master Jack.
Subjective types don't want to be involved for fear of failing to hear the things they constantly claim to hear.
Objective types don't want to go thru all the work because TBH, so much of audio is a solved problem and many already
know what the outcome will be and feel it will be mostly a waste of time. Only in cases where determining the audible levels of things like say distortion, jitter, SINAD can you get much enthusiasm pumped up...
It's a strange, strange world we live in Master Jack.
Would you go to the trouble of reproducing experiments in what object falls faster in a vacuum? I mean, ok, the feather and the weight accelerated at the same speed, but whAt abOut a FRisbeE?Good double blind tests are very difficult just to get arranged and organized.
Subjective types don't want to be involved for fear of failing to hear the things they constantly claim to hear.
Objective types don't want to go thru all the work because TBH, so much of audio is a solved problem and many already
know what the outcome will be and feel it will be mostly a waste of time. Only in cases where determining the audible levels of things like say distortion, jitter, SINAD can you get much enthusiasm pumped up...
It's a strange, strange world we live in Master Jack.
Gary_G
Active Member
Is the Earth round?
While the Earth appears to be round when viewed from the vantage point of space, it is actually closer to an ellipsoid. However, even an ellipsoid does not adequately describe the Earth's unique and ever-changing shape
oceanservice.noaa.gov
Why don't we just say it's lumpy and bumpy?Is the Earth round?
While the Earth appears to be round when viewed from the vantage point of space, it is actually closer to an ellipsoid. However, even an ellipsoid does not adequately describe the Earth's unique and ever-changing shapeoceanservice.noaa.gov
Gary_G
Active Member
That would be the geoid. LoL
What is the geoid?
The geoid is a model of global mean sea level that is used to measure precise surface elevations
oceanservice.noaa.gov
Especially for loudspeakers!
"Double blind" means that even those administering the test do not know which speaker is being auditioned. Short of having a speaker shuffler that required zero human intervention or monitoring once the test begins, like what Harmon spent the big bucks to create, I don't see how a controlled double-blind test could be done.
Fortunately for loudspeaker testing, single-blind is sufficient as long as those administering the test have no direct or otherwise potentially bias-inducing interaction with the listeners during the test. This is not like drug testing where you don't want the nurse who administers the pills to know which ones are placebos.
I was once the behind-the-curtain "speaker shuffler" for a controlled single-blind test conducted by Earl Geddes, and would have had a really hard time doing it blind-folded, but even then I could have differentiated the speakers by weight.
Very true, with speakers the differences are mostly wide enough that only preference needs to be determined among a large listening group. The "better" speakers can mostly be determined by measurement which is easily repeatable.
Well, it looks like somebody decided to test astrology:
Can astrology predict life outcomes? We tested it.
Many people claim astrology is nonsense, whereas others swear by it. But is there actually a simple way to test if it works? It turns out, it’s not too hard to put the simple sun sign (a.k.a., zodiac sign) version of astrology to the test. So, we ran a study to do so.If you want to see what we...
www.clearerthinking.org
cavedriver
Addicted to Fun and Learning
This test reminds me that I felt there was a very discernible difference between my Hypex 502MP and my vintage Onkyo tx-sr805 receiver. Both have plenty of power and I was using them to drive a variety of relatively small and easy to drive speakers, but it was all completely sighted so now I wonder what I was hearing. I would be interested in seeing ABX tests of class D vs class AB amps to see if some of the behaviors of the AB equipment vs the D are typically discernible. The two things that seemed remarkable to me would have been that the bass seemed much cleaner and tighter with the Hypex, and the highs were a bit more sterile and perhaps a little louder. Given that we're talking about a 10+ year old mid-grade receiver, there's no telling if the amp's frequency accuracy has measurable fall-off at the low and high ends of the range.
Also, regarding running double blind tests, I suppose having the two speakers sitting next to each other behind the screen and just switching the sources is not good enough since the listeners could rapidly discern, "oh, that's the one on the left". I suppose a pair of automated turn tables for the speakers to rest on could make the swap-outs fast. Something I've been wanting to set up at a trade show like CAF. Maybe this coming year.
Last edited:
These days, it's a lot easier. Use a good recording interface or sound card and record the electrical signal at the speaker terminals at about the same sound level (precise matching isn't needed, just get it close). You want to use a couple resistors (say 10k and 1k) to divide down the voltage for protection of the sound card. Then use Deltawave software to look at the differences and see if they're significant. You can also use the software to run a level-matched ABX.
Good post. The biggest variable is the person listening, their experience, and hearing quality.
cavedriver
Addicted to Fun and Learning
I think I could build this as simply two large circles so we could A/B two or three pairs of speakers at a time. Plenty of large lazy susan bearings with 1,000 lb weight capacities out there. If it were to be turned manually could build a pair in one day. Automated would take longer. Biggest hassle would be building damping into the platform to ensure there are no vibrations being perpetuated by the platform. Perhaps dense foam on top surface and a CLD layer between two sheets of 3/4" plywood, and then edge protection so you can roll the monstrosity in and out of trade shows. If the bearing is contributing to the vibration could use wood shop portable table feet that latch down to the baseplate during playback.
Sounds pretty formidable, but the *most* formidable obstacle is lack of a core audiophile constituency that actually wants this sort of thing to happen. They don't want windows opened, there are too many houses of cards in the room.
MAB
Major Contributor
Like this!
Blind Listening Test 2: Neumann KH 80 vs JBL 305p MkII vs Edifier R1280T vs RCF Arya Pro5
Shortly after completing the first blind listening test, @Inverse_Laplace and I started thinking about all the ways we’d like to improve the rigor and explore other questions. Written summary follows, but here is a video if you prefer that medium: Speakers (calculated preference score in...
www.audiosciencereview.com
cavedriver
Addicted to Fun and Learning
Yeah, I could build it, but could I get my local audio club to help sponsor me to set it up in a room at CAF? Maybe, maybe not. I think it would be a cool "attraction" at an event like that. There's always those rooms where you wonder what they are selling and why they even have the room in the first place. A room with a sign out front reading, "TEST YOUR AUDIOPHILE CHOPS HERE!" would be fun, and I wouldn't have to use currently hot new speaker designs, just things that are well known or have interesting behaviors. Could give anyone that gets a certain score a prize or something. I think a lot of people would be interested in the challenge. We think we know what we know and some are curious and brave enough to test it.
some indeed. Obviously it would be much easier with electronics, which many at those shows think they know as well.
My guess is you'd get low participation and a bunch of quibbling with the test conditions. Like this
Blind Listening
John Atkinson sets the stage Nothing seems to polarize people as much as the vexed question concerning the importance of audible differences between amplifiers. If you think there are subjective differences, you're an audiophile; if you don't, you're not.
www.stereophile.com
Similar threads
