• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Master Thread: Are measurements Everything or Nothing?

ahofer

Master Contributor
Forum Donor
Joined
Jun 3, 2019
Messages
5,047
Likes
9,155
Location
New York City
You missed the bit where Toole and Olive conducted experiments that show people prefer the lowest colouration. You seem to be living the fantasy that we all have widely disparate and unique tastes in sound reproduction.
I'm not sure the Toole and Olive data is robust enough to generalize. But I would certainly bet that way.

edit: and yet it is the most robust data in the public domain, as far as I can tell....
 
  • Like
Reactions: VQR

SIY

Grand Contributor
Technical Expert
Joined
Apr 6, 2018
Messages
10,511
Likes
25,352
Location
Alfred, NY
That is cool. Fourier transform is just stupid useful. You can pretty much use it for analysis of anything with a wave or a number array. I'm surprised it is not used in audio more often. Maybe it is used a lot in the design phase of huge companies like Harmon. I had an engineer buddy that worked for Raytheon and even though there were other mathematical ways to solve things they always used FFT "just because" if it was at all possible.
So you have exactly zero idea of how audio measurement is done. Zero.
 

GXAlan

Major Contributor
Forum Donor
Joined
Jan 15, 2020
Messages
3,925
Likes
6,066
I'm not sure the Toole and Olive data is robust enough to generalize. But I would certainly bet that way.

edit: and yet it is the most robust data in the public domain, as far as I can tell....
Overall, they are still doing well.

 

Newman

Major Contributor
Joined
Jan 6, 2017
Messages
3,533
Likes
4,372
I'm not sure the Toole and Olive data is robust enough to generalize. But I would certainly bet that way.

edit: and yet it is the most robust data in the public domain, as far as I can tell....
Some Toole and Olive data have higher confidence than others. They show you the various confidence levels in the papers.

But their data on low colouration being preferred is plenty solid enough to generalise.
 

ahofer

Master Contributor
Forum Donor
Joined
Jun 3, 2019
Messages
5,047
Likes
9,155
Location
New York City
I’m
But their data on low colouration being preferred is plenty solid enough to generalise.

What sample size and replication do you consider adequate?
 

Galliardist

Major Contributor
Joined
Jun 26, 2021
Messages
2,558
Likes
3,278
Location
Sydney. NSW, Australia
What examples do we have of equipment testing well, but sounding poorly?
Logically, the answer to your question is none, providing:
  • Proof of poor sound is established (that means more than your favourite subjective reviewer saying it is poor):
  • Listening was done in the context of a system and environment where the device was used within its capabilities:
  • Testing is sufficient to determine the deviation causing the poor sound.

If you find claims that some item measures well but sounds poorly, beware. Generally, the first of my points has not been met: by definition, the third hasn't.
 

MattHooper

Master Contributor
Forum Donor
Joined
Jan 27, 2019
Messages
7,334
Likes
12,296
What, exactly, do you mean, "sounding poorly"? Adjudged by whom?

It is very common (at least in my experience) for fans of modern tube equipment ( "boutique" designs that are deliberately inaccurate) to complain about accurate, neutral audio reproduction. Common descriptions include "cold", "sterile", "flat", "unmusical" and "lacking life". This doesn't mean that accurate reproduction is cold, sterile, etc., but rather that the listeners were not accustomed to it.

I think that's a plausible conjecture on your part.

On the other hand, if we are to grant for the sake of argument certain equipment adding some sort of coloration, let's say some of the classic tube attributes are there,
it could also be that, in a way, neutral reproduction is "cold" "sterile" etc...relative to natural acoustic sounds or whatever. That is somewhat my take on much reproduced sound in general. And presumably the problem is largely in the recordings (and the inadequacies of stereo etc). For instance I was listening to a lot of different tracks on the Kii Audio 3 speakers recently. Sounded very neutral, very insightful in to the recordings. The sound was also generally to my ears mechanical, artificial, electronic, hardened, lacking timbral finess etc. But that is my judging it generally to reality, not just to "other speakers." But...many people looking for neutrality aren't judging speakers or sound that way.
The little weasels that push equipment with affected or unnatural reproduction characteristics onto naive buyers know this principle very well, and understand that people in general prefer an attractive illusion to the truth.

It's all an illusion. Stereo isn't reality. "whatever gets you there..."
 

Benedium

Senior Member
Forum Donor
Joined
Aug 1, 2020
Messages
343
Likes
255
If only there was just one speaker model used as a standard everywhere. Maybe then we can finally enjoy the recordings and the processing in peace?
 

MattHooper

Master Contributor
Forum Donor
Joined
Jan 27, 2019
Messages
7,334
Likes
12,296
If only there was just one speaker model used as a standard everywhere. Maybe then we can finally enjoy the recordings and the processing in peace?

Sounds boring. Then there'd be no more audio hobby ;-)
 

Newman

Major Contributor
Joined
Jan 6, 2017
Messages
3,533
Likes
4,372
What sample size and replication do you consider adequate?
As Dr Olive wrote in that thread you linked, "There is probably sufficient knowledge already to design and build a decent loudspeaker based on measurements."

To your question on sample size and replication, apart from the basic statistics of experimental confidence, the answer is hugely context-dependent. If the finding came from experiments by trusted doyens of the field, standing on the shoulders of the best prior research, implicitly confirming much of prior understanding, and is 'no surprises' (What?? You found that a reproduced voice or acoustical instrument is preferred when it sounds like the original with least colouration? I'm shocked! Prove it to me again, and again!), then I don't think the same sample size and replication is needed as when an experiment by some noob or outsider or biased interest turns prior understanding and intuition on their heads.

Many people's resistance is born of their not liking the findings, and that is usually because the findings contradict their contaminated/sighted listening experiences (and which they have used as sole guide for their long journey with a lot of learnings and very large hifi expenses over a very long time). For these people there is no sample size and replication that they will consider adequate, nor will there ever be. OTOH when a paper confirms their sighted listening, they won't question it at all.
 

antcollinet

Master Contributor
Forum Donor
Joined
Sep 4, 2021
Messages
7,759
Likes
13,101
Location
UK/Cheshire
None by all accounts as all that tests well are perfect and unlikely to be bettered. We don't use our ears on this site as all are faulty by definition.
Why do people keep repeating this strawman?

Use your ears - but do it properly. Blind and controlled.
 

JSmith

Master Contributor
Joined
Feb 8, 2021
Messages
5,224
Likes
13,483
Location
Algol Perseus
listen-eyeball.gif



JSmith
 

thewas

Master Contributor
Forum Donor
Joined
Jan 15, 2020
Messages
6,904
Likes
16,933
  • Like
Reactions: MAB

MAB

Major Contributor
Joined
Nov 15, 2021
Messages
2,153
Likes
4,851
Location
Portland, OR, USA

Galliardist

Major Contributor
Joined
Jun 26, 2021
Messages
2,558
Likes
3,278
Location
Sydney. NSW, Australia
None by all accounts as all that tests well are perfect and unlikely to be bettered. We don't use our ears on this site as all are faulty by definition.
So how on earth do you listen to music then? Your knees, perhaps?
 

Galliardist

Major Contributor
Joined
Jun 26, 2021
Messages
2,558
Likes
3,278
Location
Sydney. NSW, Australia
If only there was just one speaker model used as a standard everywhere. Maybe then we can finally enjoy the recordings and the processing in peace?
But how would you set it up?
 
Top Bottom