• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

New "Science": FLAC vs. WAV

iridium

Addicted to Fun and Learning
Joined
Feb 28, 2016
Messages
525
Likes
114
I must always form an association to remember what I want later; so here it is:

WAV file = riding a beautiful, smooth WAVE.
FLAC file = I need a FLACK JACKET to survive.

Not a joke; this will be my memory association.

iridium
 

amirm

Founder/Admin
Staff Member
CFO (Chief Fun Officer)
Joined
Feb 13, 2016
Messages
44,368
Likes
234,388
Location
Seattle Area
Not these guys again. Once again they claim to have done blind tests yet they will not disclose the protocol or the detailed reports. Just a summary with fantastical conclusions like height of the music changing with generations of files, metadata, etc.

I will put forward $5,000 of my money to show that they are complete farce. I will go to where they are, play the same files they say they can detect these differences in, and see if they can get the same outcomes they say they can. I am confident they will lose and will lose big. Let's see if they accept the challenge and how much money they will put forward to defend their beliefs.

They are doing so much damage to the cause of high fidelity sound reproduction. So many believers are going to now strip out album arts, thinking that degrades audio.
 

FrantzM

Major Contributor
Forum Donor
Joined
Mar 12, 2016
Messages
4,337
Likes
7,731

The order in which this sequence was generated is indicated by dashed lines in Fig 1, but for clarity has been omitted in subsequent figures. Where applicable, in each experiment we show the height estimate on the vertical axis, plotted against the conversion number of the complete series (abbreviated WFW) on the horizontal axis. Height estimates were made (using a tape measure hung from the ceiling behind the speakers) by listening to a specific chord, repeated twice on a harp passage during a 6s segment (39-45s into track 1). This tight musical restriction was found necessary to ensure consistent height estimates over weeks and months of listening sessions. We initially repeated the experiment conducted in 2010, and despite various system upgrades made over this time, the height method obtained the same pattern of results found previously with our subjective sound quality scale, as long as the same version of J River Media Center software (JRMC v15) was employed. Also, as found in our original experiments, we found little or no significant benefit of engaging the memory playback setting of this software version. Using these defined methods, our results are shown in Fig 1.

No comment ...
 

iridium

Addicted to Fun and Learning
Joined
Feb 28, 2016
Messages
525
Likes
114
So I do not need to remember WAV vs. FLAC?

iridium.
 

DonH56

Master Contributor
Technical Expert
Forum Donor
Joined
Mar 15, 2016
Messages
7,835
Likes
16,497
Location
Monument, CO
Good grief...

Guess they had to do something different since numerous trials show FLAC is, well, lossless, like the "L" implies, and the input and output files are identical after decoding.

Did they compare their tape measure to a NIST standard at the start and end, and verify it did not shift position during the test? What about atmospheric temperature and pressure? Heaven knows their ears and memory are perfect, goes without saying...

<elided off-topic comment, sorry>

(Moderator) I did not have a problem with it:)
 
Last edited by a moderator:
OP
dallasjustice

dallasjustice

Major Contributor
Joined
Feb 28, 2016
Messages
1,270
Likes
907
Location
Dallas, Texas
Not these guys again. Once again they claim to have done blind tests yet they will not disclose the protocol or the detailed reports. Just a summary with fantastical conclusions like height of the music changing with generations of files, metadata, etc.

I will put forward $5,000 of my money to show that they are complete farce. I will go to where they are, play the same files they say they can detect these differences in, and see if they can get the same outcomes they say they can. I am confident they will lose and will lose big. Let's see if they accept the challenge and how much money they will put forward to defend their beliefs.

They are doing so much damage to the cause of high fidelity sound reproduction. So many believers are going to now strip out album arts, thinking that degrades audio.
Amir,
You are the one always saying the subjectivists never want to test their findings with blind testing. Now that they have a "study" to prove what they are saying, you want to dismiss it. How open-minded of you! Maybe you never heard of "bit rot." :p
 

DonH56

Master Contributor
Technical Expert
Forum Donor
Joined
Mar 15, 2016
Messages
7,835
Likes
16,497
Location
Monument, CO
The velocity of sound is related to temperature and humidity. The frequency response in a room, unless it is completely anechoic and/or perfectly climate-controlled, will change with changes in weather. Wonder if that matters in this sort of study...
 

alfe

Member
Joined
Jun 24, 2016
Messages
20
Likes
0
Amir,
You are the one always saying the subjectivists never want to test their findings with blind testing. Now that they have a "study" to prove what they are saying, you want to dismiss it. How open-minded of you! Maybe you never heard of "bit rot." :p

If it's a blind test who is reading the measuring tape?
 

Sal1950

Grand Contributor
The Chicago Crusher
Forum Donor
Joined
Mar 1, 2016
Messages
14,072
Likes
16,605
Location
Central Fl
The only thing I see blind is the supervision of the tests.
Just like all other subjective claims any evidence has to be transparent to all concerned.
Where's the beef?
 

amirm

Founder/Admin
Staff Member
CFO (Chief Fun Officer)
Joined
Feb 13, 2016
Messages
44,368
Likes
234,388
Location
Seattle Area
You are the one always saying the subjectivists never want to test their findings with blind testing. Now that they have a "study" to prove what they are saying, you want to dismiss it.
They did a single blind test alright. They kept one eye closed and the other open! :D

Again, if anyone can reach them, let them know that they can win a $5,000 prize if they can repeat their results in front of me.
 

Fitzcaraldo215

Major Contributor
Joined
Mar 4, 2016
Messages
1,440
Likes
632
Does anyone actually know what Dr. Charles Zelig has a doctorate in? I cannot find it a second time, but I believe I saw a reference to something medically related. And, as we know, that makes all the difference when it comes to assessments of audio, especially those done "scientifically" by tape measure and subjective listening. And, he knows how to draw "relevant" graphs to prove his point. That is for sure.

I just love guys who throw their irrelevant doctorates around to seemingly enhance their status in an unrelated field. But, alas, I only have a Master's degree, so I cannot do that. My opinion is obviously worthless and not credible.
 

Blumlein 88

Grand Contributor
Forum Donor
Joined
Feb 23, 2016
Messages
20,523
Likes
37,056
Can anyone dowload the link in this summary article to obtain the full report? I get a 404 on it.

They say their methodology is described there as well as in previous TAS articles.

I know I wasted enough time deciphering their bull $hite in the TAS articles. They never actually told you exactly how they did single blind. They constructed a scale numerically with long subjective sighted listening. Then corroborated it with estimates subjectively done (which may have been single blind they never really quite told anyone). Then found the height measure to be more accurate and consistent than their subjectively developed points scale. Then proceeded by listening and estimating heights. Again never saying if it was blind at all and if so how.

It is curious height would pop out as being so hugely obvious (they are talking some large differences) and they surmise it is from very small levels of jitter due to computer activity with the two formats at least until this most recent article. We know height is perceived as a moving notch filter between about 6 khz and 12 khz. The higher notch in response being higher elevation. My guess is they don't know this and have pictured in their mind height represents an expanded enhanced sound field from lower jitter. Such an effect should cause a measurable change in the analog output.

I also note if nothing has changed in all their tests they run the signal thru a processor (BSG qølTM processor) which basically does some matrix manipulation to improve the size of the soundstage. It is essentially a fixed Mid-Side processor to widen the sound of things. It was subject of a thread at WBF forums. It basically does mid-side processing the way the Blumlein shuffler circuit did. You shelf up a few db the frequencies below 700 hz, and ramp down some upper frequencies a bit less. Mix back together with emphasis on the Side or difference channel between the stereo signals.
 

Blumlein 88

Grand Contributor
Forum Donor
Joined
Feb 23, 2016
Messages
20,523
Likes
37,056
Does anyone actually know what Dr. Charles Zelig has a doctorate in? I cannot find it a second time, but I believe I saw a reference to something medically related. And, as we know, that makes all the difference when it comes to assessments of audio, especially those done "scientifically" by tape measure and subjective listening. And, he knows how to draw "relevant" graphs to prove his point. That is for sure.

I just love guys who throw their irrelevant doctorates around to seemingly enhance their status in an unrelated field. But, alas, I only have a Master's degree, so I cannot do that. My opinion is obviously worthless and not credible.

Physiology and oncology I believe. You can find it on linkedin.

I believe this is the guy.
https://www.linkedin.com/in/charles-zeilig-63635316

I see he has a store, HiFi Doctor.
 
Last edited:

amirm

Founder/Admin
Staff Member
CFO (Chief Fun Officer)
Joined
Feb 13, 2016
Messages
44,368
Likes
234,388
Location
Seattle Area
Can anyone dowload the link in this summary article to obtain the full report? I get a 404 on it.

They say their methodology is described there as well as in previous TAS articles.
The link for me does not work either. But I had, and read multiple times their article in TAS. It says nothing about the methodology, the stats, etc. It is a carbon copy of this one saying it is single blind and that is that.
 

Mivera

Major Contributor
Joined
Mar 4, 2016
Messages
2,322
Likes
97
Location
West Kelowna
The worlds top DAC chip engineers also agree Wav is better than FLAC as well. So these guys must be onto something. Sounds better to me ears as well. I suppose the key is know how things actually work. Either that or have the ability to hear.
 

fas42

Major Contributor
Joined
Mar 21, 2016
Messages
2,818
Likes
191
Location
Australia
If one looks at the conclusion to the article, the key point is expressly stated - the processing of the data varies between FLAC and WAV, and imperfect isolation of the analogue side from electrical effects of the variation in digital processing is enough to "do the damage". Yes, competent design should eliminate such impact, but the reality is that nearly all real world circuitry is "not good enough" - hence the result ...
 

amirm

Founder/Admin
Staff Member
CFO (Chief Fun Officer)
Joined
Feb 13, 2016
Messages
44,368
Likes
234,388
Location
Seattle Area
The worlds top DAC chip engineers also agree Wav is better than FLAC as well. So these guys must be onto something. Sounds better to me ears as well. I suppose the key is know how things actually work. Either that or have the ability to hear.
They aren't on to anything. Designing DACs teaches you nothing about proper audio evaluation.

I know how they work and I can assure you that your impressions are wrong.
 
Top Bottom