• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Can we trust our ears?

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
How was this double-blinded, pray tell?

Also, do you understand that that outcome will happen 1/16th of the time. Assuming you have the first one "right", four more trials make that one in 16. If you want to talk about 5 independent trials, it's still 1/32, which is no big deal.
The difference is really obvious. During the process it's less obvious because he only switched twice. I don't care about you. It's too obvious to continue.
 

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,789
Location
My kitchen or my listening room.
The difference is really obvious. During the process it's less obvious because he only switched twice. I don't care about you. It's too obvious to continue.

Well, now, here we have another of those "it's obvious" claims that you won't subject to any real double-blind test.

I understand you don't care about science. That's ok. If your cables make you happy, fine. But this audible difference, that's a claim to a fact we don't have to accept.

Let me put it this way:

Which two cables?
How was the test DOUBLE blinded?
How long for cable swaps?
What are the controls on this test?

Given what I know of the cables you mention, I suspect:

1) Something might be broken
2) You have some terrible interference or ground loop
3) You IMAGINE you hear a difference
4) Your test blinding has a leak

I'm almost sure of 4, since you refused to answer the question of how the test was DOUBLE blind.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
Well, now, here we have another of those "it's obvious" claims that you won't subject to any real double-blind test.

I understand you don't care about science. That's ok. If your cables make you happy, fine. But this audible difference, that's a claim to a fact we don't have to accept.

Let me put it this way:

Which two cables?
How was the test DOUBLE blinded?
How long for cable swaps?
What are the controls on this test?

Given what I know of the cables you mention, I suspect:

1) Something might be broken
2) You have some terrible interference or ground loop
3) You IMAGINE you hear a difference
4) Your test blinding has a leak

I'm almost sure of 4, since you refused to answer the question of how the test was DOUBLE blind.
Lol. You are entitled to your opinion. This test is significantly more difficult than ABX where I can ab the candidate myself. In this test I can't know whether he changed or not. I couldn't tell him to switch to a different one to compare.
I said in the post Stock Focal cable and Cardas cable.
Cable swap is about 20 seconds.
He always unplug and plug the cable during trials.
It's not going to be obvious for you. But it's obvious for me.
You are almost sure. Oh well. You are sure....I really feel a little butt hurt right now. Because you are completely wrong but sound like you are right.
Surely the "double" blind test was referring to my friend doesn't know the answer. But my definition is different. My definition is the layer of blindness. As this is more difficult than ABX. Whether he tests it or computer tests it doesn't matter to me. There was no interference what so ever. If it doesn't blind me, who do I not know? That's really funny.
 

ahofer

Master Contributor
Forum Donor
Joined
Jun 3, 2019
Messages
5,045
Likes
9,148
Location
New York City
I’m willing to accept those results. As long as they replicate.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
Well, now, here we have another of those "it's obvious" claims that you won't subject to any real double-blind test.

I understand you don't care about science. That's ok. If your cables make you happy, fine. But this audible difference, that's a claim to a fact we don't have to accept.

Let me put it this way:

Which two cables?
How was the test DOUBLE blinded?
How long for cable swaps?
What are the controls on this test?

Given what I know of the cables you mention, I suspect:

1) Something might be broken
2) You have some terrible interference or ground loop
3) You IMAGINE you hear a difference
4) Your test blinding has a leak

I'm almost sure of 4, since you refused to answer the question of how the test was DOUBLE blind.
Oh ok. I thought it was a different thread.

The following was the post I post in a different thread.
I just did a blind test with my friend using Focal Stellia and cardas and stock cable.
It was a double blind test. Being,
1, I can't see which is which
2, I can't know whether he switched cable or not.
The track I used is Facepalm Mute - Periphery
Results
1, stock correct
2, stock correct
3, cardas correct
4, cardas correct
5, stock correct
During the process I felt like I couldn't hear the difference until the 5th.

The stock has more highs and more open sounding with less congested mids and bass.

The background story. I demoed stellia a few months ago. That time I went to the store by myself. Today I went with my friend. When I hear it, it doesn't sound quite the same than what I remembered. It has cardas cable. I switched back to stock cable I heard the difference. So I let my friend listen to it, also with stock cable. He also thinks the difference is very big. We do both agree the difference is too big to do blind test. But I said I have to do it just to make sure. And here it is. All 5 correct. Big difference. The reason why I thought I couldn't hear the difference was because he only changed once in first four trials. When he changed back to the stock cable again, the difference is big.
How big is the difference then, I would say about +2db around 3khz-6khz. But it doesn't relate to actual measurement of frequency response. It's just perception. It feels like less 500-1000hz and more 3-6khz.

It's a proof that headphone cable and consequently speaker cable do make difference. And it's not really a small difference.
 

SIY

Grand Contributor
Technical Expert
Joined
Apr 6, 2018
Messages
10,511
Likes
25,346
Location
Alfred, NY
I’m willing to accept those results. As long as they replicate.

And the procedure is clearly stated in full detail. If I were going to guess at what the "leak" that @j_j hinted at was, it would be timing of the swap. That's almost never controlled in amateur swap-out tests.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
And the procedure is clearly stated in full detail. If I were going to guess at what the "leak" that @j_j hinted at was, it would be timing of the swap. That's almost never controlled in amateur swap-out tests.
It doesn't affect me. As it still blinded me during the test. If one's blinded, the one under test knows.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
Sorry, that won't work here. Too obvious to test means you should knock out an ABX 100% with extreme ease. 5 for 5 isn't convincing anyone either. You say you don't care about someone else, but you cared enough to proclaim you reliably here these differences.
ABX is a different test than the test I did. If I can do ABX on this I am sure I can do 100% over 20 trials. In ABX i can switch back and forth as I want. But I don't know whether he changes in each trial.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
Unless you're human.
You guys are going insane. I will know if I got interfered. And during the first 4 trials, I wasn't sure is just a different proof on that.
 

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,789
Location
My kitchen or my listening room.
No, you will not know if you caught a clue from something other than sound. That's how all human beings work. Furthermore your test has absolutely no controls built in.

Oh, and yes, everyone is entitled to an opinion. Some of us are experts who are WAY past being gratuitously insulted by someone who barely ran a test, has too few repeats, said "it was obvious" and THEN said "during the first 4 trials I wasn't sure..."

Make up your mind.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
No, you will not know if you caught a clue from something other than sound. That's how all human beings work. Furthermore your test has absolutely no controls built in.
Alright then. There is no way to conduct the test. So cable will never make difference. Thanks guys.
 

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,789
Location
My kitchen or my listening room.
Alright then. There is no way to conduct the test. So cable will never make difference. Thanks guys.

Really? If I use an open cable, I bet I can hear the difference, too. Your conduct, by the way, is rude and inexcusable, and resorting to rhetoric like that makes it pretty clear you don't actually want to know how to run a test.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
No, you will not know if you caught a clue from something other than sound. That's how all human beings work. Furthermore your test has absolutely no controls built in.

Oh, and yes, everyone is entitled to an opinion. Some of us are experts who are WAY past being gratuitously insulted by someone who barely ran a test, has too few repeats, said "it was obvious" and THEN said "during the first 4 trials I wasn't sure..."

Make up your mind.
There is proof that there can be frequency response discrepancy because cables. Why is it too hard to believe there is difference. On diyaudioheaven there was measurement showing difference in frequency response using different cables.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
Really? If I use an open cable, I bet I can hear the difference, too. Your conduct, by the way, is rude and inexcusable, and resorting to rhetoric like that makes it pretty clear you don't actually want to know how to run a test.
I covered my ears between trials. Wasn't it enough?
 

BDWoody

Chief Cat Herder
Moderator
Forum Donor
Joined
Jan 9, 2019
Messages
7,079
Likes
23,523
Location
Mid-Atlantic, USA. (Maryland)
Alright then. There is no way to conduct the test. So cable will never make difference. Thanks guys.

No, it's just that the way you did it is no way to conduct a test that's going to mean or prove anything to anyone. Insulting true experts may not help either.
Don't pout...
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
People like you always nitpicking the details that don't matter. Before blind test, you guys like must do blind test. After done test, you guys like the test was faulty. Yeah. Also I didn't like you already from a different thread. I don't care about how you conduct tests or anything.
 

BDWoody

Chief Cat Herder
Moderator
Forum Donor
Joined
Jan 9, 2019
Messages
7,079
Likes
23,523
Location
Mid-Atlantic, USA. (Maryland)
People like you always nitpicking the details that don't matter. Before blind test, you guys like must do blind test. After done test, you guys like the test was faulty. Yeah. Also I didn't like you already from a different thread. I don't care about how you conduct tests or anything.

So, knowing you might have some skepticism, that was the best test methodology you could come up with?
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
So, knowing you might have some skepticism, that was the best test methodology you could come up with?
Only thing that could possibly not be good enough is there was only 5 trials.
I didn't know if I was correct or not during the test.
I didn't know if he switched cable during the test.
I covered my ears between trials to not let sound interfere with me.
He unplug and plug cable in each trial.
Interval between each test is about 20 seconds.
Same song first 10 seconds.
I face back to him.
I couldn't touch the headphone during the test.
What else? What else that could be improved if I don't go into using an ADC to record the voltage across the headphones and using ABX software to conduct the test? Seriously.
 

JohnYang1997

Master Contributor
Technical Expert
Audio Company
Joined
Dec 28, 2018
Messages
7,175
Likes
18,300
Location
China
What I meant was, he doesn't tell me whether he changed. I'm blind to whether he changes. I have to tell myself. In contrast to ABX, which I can listen back and forth the A and B then X.
The difference is very obvious between 4th and 5th trial. That was a instant tell, so I stopped the test.
 
Top Bottom