• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

High Resolution Audio: Does It Matter?

Sal1950

Grand Contributor
The Chicago Crusher
Forum Donor
Joined
Mar 1, 2016
Messages
14,206
Likes
16,948
Location
Central Fl
A good test not only allows quick, clickless switching, but also looping around material the SUBJECT thinks is critical.
OK J_J
But I've listened to the heartbeat in the PF DSOTM opening way too many times already. LOL
 

pablolie

Major Contributor
Forum Donor
Joined
Jul 8, 2021
Messages
2,097
Likes
3,548
Location
bay area, ca
This is why controls are added in every decent test, both positive and negative controls.
The only thing I have seen in some tests (I think it was Archimago) was that they asked for a degree of confidence. Other than that it seems to me they take raw data...

I'd love for some high end audio brand to have the guts to put up a -let's say- $100k prize for the person that reliably can tell such differences the best ((ideally using their equipment, ha!). *That* may make people tell these tests more seriously (and also promote their brand as the one that's best to tell such differences). But for some reason that's never happened, and I suspect it never will. :-D
 
Last edited:

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,792
Location
My kitchen or my listening room.
The only thing I have seen in some tests (I think it was Archimago) was that they asked for a degree of confidence. Other than that it seems to me they take raw data...

A positive control provides something that the subject should hear, and should report accurately.
A negative control provides something that is "same vs. same" that should never reach beyond probability.

This has nothing to do with a 'how confident are you' question.
 

DonH56

Master Contributor
Technical Expert
Forum Donor
Joined
Mar 15, 2016
Messages
7,906
Likes
16,732
Location
Monument, CO
Minds me of the time I was doing some amplifier tests and nobody could tell them apart even though I had measured and listened beforehand and knew they were different. For real. But blind AB testing showed nada. Turns out I had forgotten to connect power to the AB switch. The negative control worked like a champ. :p
 

Sal1950

Grand Contributor
The Chicago Crusher
Forum Donor
Joined
Mar 1, 2016
Messages
14,206
Likes
16,948
Location
Central Fl
But for some reason that's never happened, and I suspect it never will.
Not if any of the powers that be at Stereophile/TAS & all the other ad supported high end websites have anything to say.
There's just too much big money invested in the continuation of the lies that support the high end.
@amirm I hope you have a good security system on your home and property.
I wouldn't put anything past that crowd.

Turns out I had forgotten to connect power to the AB switch. The negative control worked like a champ
LMAO
 

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,792
Location
My kitchen or my listening room.
Minds me of the time I was doing some amplifier tests and nobody could tell them apart even though I had measured and listened beforehand and knew they were different. For real. But blind AB testing showed nada. Turns out I had forgotten to connect power to the AB switch. The negative control worked like a champ. :p

That's happened a few times. Including some times when it's not not all that wise. :)
 

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,792
Location
My kitchen or my listening room.
Are folks on this thread familiar with Joshua Reiss's Meta-Analysis of High Resolution Audio Perceptual Evaluation?


What tests can you cite that satisfy the requirements of ITU-R BS.116?


Does anyone claim the Archimago or Hydrogen Audio tests satisfy these requirements?

I certainly worked on tests that satisfied 1116, in fact, some of the tests that established BS1116. All of the MPEG-audio tests until after MPEG-2 was done, a variety of internal tests that surpassed 1116 requirements at AT&T Research, and a few more I can't talk about.

Many tests do not meet 1116, of course.
 

jhaider

Major Contributor
Forum Donor
Joined
Jun 5, 2016
Messages
2,874
Likes
4,675
Even Mark Waldrep, the owner of a recording studio that made it's bread and butter
selling 24-96 admitted the same.

I wouldn’t say he “admitted” it. Rather, Dr. Waldrep accepted that hi-rez is pointless for consumers after conducting a study he must have expected to vindicate “hi-rez,” but pointed in the other direction instead.

Willingness to accept reality when it conflicts with one’s established beliefs is too rare. Extra so when reality conflicts with one’s pecuniary interests as well.
 

Sal1950

Grand Contributor
The Chicago Crusher
Forum Donor
Joined
Mar 1, 2016
Messages
14,206
Likes
16,948
Location
Central Fl
I wouldn’t say he “admitted” it. Rather, Dr. Waldrep accepted that hi-rez is pointless
So my use of "admitted" doesn't meet your definition of "accepted" ???
Slicing it a bit thin there J just to throw your barb. :facepalm:
 

jhaider

Major Contributor
Forum Donor
Joined
Jun 5, 2016
Messages
2,874
Likes
4,675
So my use of "admitted" doesn't meet your definition of "accepted" ???

No barb intended, but the connotation is quite different.

“Admitted,” especially without context, implies being caught after less than good faith actions. She admitted to the affair. He admitted he used corn syrup rather than honey. That sort of thing.

“Accepted” is more, ok, she thought something was x but the data shows it’s actually y so she went with the evidence over her previous position. She accepted the 2020 election results when they were certified even though she voted the other way and had heard a lot of stupid talk discrediting the election after the votes were in. That sort of thing.
 
Last edited:

Sal1950

Grand Contributor
The Chicago Crusher
Forum Donor
Joined
Mar 1, 2016
Messages
14,206
Likes
16,948
Location
Central Fl

Geert

Major Contributor
Joined
Mar 20, 2020
Messages
1,955
Likes
3,570
I wouldn’t say he “admitted” it. Rather, Dr. Waldrep accepted that hi-rez is pointless for consumers after conducting a study he must have expected to vindicate “hi-rez,” but pointed in the other direction instead

He actually already concluded that for himself before the study. The study gave that opinion statistical relevance.
 

Sal1950

Grand Contributor
The Chicago Crusher
Forum Donor
Joined
Mar 1, 2016
Messages
14,206
Likes
16,948
Location
Central Fl
He actually already concluded that for himself before the study. The study gave that opinion statistical relevance.
Marks a super good dude, honesty is his trademark.
He was one of the original whistle blowers on the phony baloney AudioQuest HDMI cable video.
He took the truth path in the discussion of cables and much of the rest of the High End bunk enough
that got him kicked off a couple of the big audio clubs out west.
The whole attack against him was really said.
 

j_j

Major Contributor
Audio Luminary
Technical Expert
Joined
Oct 10, 2017
Messages
2,282
Likes
4,792
Location
My kitchen or my listening room.
Marks a super good dude, honesty is his trademark.
He was one of the original whistle blowers on the phony baloney AudioQuest HDMI cable video.
He took the truth path in the discussion of cables and much of the rest of the High End bunk enough
that got him kicked off a couple of the big audio clubs out west.
The whole attack against him was really said.

Yeah, the whole audiophile thing these days is nothing but "shun the unbeliever", except here, and a few quietly run places.

Any number of people have simply been silenced for being less than completely credulous. Some of the harassment goes well beyond words on the internet, as well.
 

beagleman

Major Contributor
Joined
Sep 24, 2020
Messages
1,187
Likes
1,646
Location
Pittsburgh Pa
Yeah, the whole audiophile thing these days is nothing but "shun the unbeliever", except here, and a few quietly run places.

Any number of people have simply been silenced for being less than completely credulous. Some of the harassment goes well beyond words on the internet, as well.

The Unbeliever, gets labeled a troll, a trouble maker, lacking in hearing, just does not want to get along etc.

I was kicked off a few forums for the crime of "Making too much sense" or "Using logic".

No one can dare question some random guy on the internet making some huge unsubstantiated claim.....EVER!
 

krabapple

Major Contributor
Forum Donor
Joined
Apr 15, 2016
Messages
3,197
Likes
3,767
This is why controls are added in every decent test, both positive and negative controls

If the test aims to be scientific, absolutely.

But I don't think it will affect Pablo's subject's loss of motivation during the test, unless they are given encouraging feedback. Like knowing that they got the positive controls 'right', for example.
 
Last edited:

krabapple

Major Contributor
Forum Donor
Joined
Apr 15, 2016
Messages
3,197
Likes
3,767
Are folks on this thread familiar with Joshua Reiss's Meta-Analysis of High Resolution Audio Perceptual Evaluation?


Yes, quite familiar. Also familiar with the complaints about , e.g., his choice of data to include or exclude in the meta-analysis.

(And also that even if we decide to take Reiss at face value -- we are still talking about a very, let's say 'subtle', effect. One hardly supporting the vast claims of audibility emitted frequently by the audiophile collective)

What tests can you cite that satisfy the requirements of ITU-R BS.116?


Does anyone claim the Archimago or Hydrogen Audio tests satisfy these requirements?

Not meeting the highest standards of rigor does not automatically invalidate results. Details of intention, how the test was done, and what claims were made from it -- special attention to phrasing of conclusions -- these matter. There are also prior probabilities to consider.


You are of course free to test *yourself* as rigorously as you like. Please keep us informed of your protocol and results if you do.
 
Last edited:
Top Bottom