• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Master Thread: Are measurements Everything or Nothing?

slsmaster

Member
Joined
Sep 22, 2022
Messages
9
Likes
6
Quite amazing how much subjective nonsense you can cram into 3 paragraphs... :facepalm:
Maybe it is the worse channel matching that made a difference here? There are unit variations due to the analog pot. The A90D doesn’t have that issue.
It seems to me that at least from a measurement point of view, that every other metric is so close in performance that it shouldn’t be audible?
But there also could be some other performance criteria that hasn’t yet been specified in form of an measurable metric.
 
Last edited:

Lupin

Addicted to Fun and Learning
Joined
Feb 11, 2021
Messages
575
Likes
961
But there also could be some other performance criteria that hasn’t yet been specified in form of an measurable metric.
And what might that be?
Audio is just an electric signal, nothing more nothing less. So what part of this electric signal is not measured and/or looked at yet?

Keeps amazing me that people don't or hardly care about the electrical signal when it comes to their TV, the CPU or GPU in their computer. But once it is an audio signal suddenly all kinds of mythical and magical properties are attached to that signal...
Audio is an electric signal. Audio reproduction has been solved years ago. All the rest is just audiophile snake-oil and plain old marketing.
 

raif71

Major Contributor
Joined
Sep 7, 2019
Messages
2,333
Likes
2,535
And what might that be?
Audio is just an electric signal, nothing more nothing less. So what part of this electric signal is not measured and/or looked at yet?

Keeps amazing me that people don't or hardly care about the electrical signal when it comes to their TV, the CPU or GPU in their computer. But once it is an audio signal suddenly all kinds of mythical and magical properties are attached to that signal...
Audio is an electric signal. Audio reproduction has been solved years ago. All the rest is just audiophile snake-oil and plain old marketing.
I thought the mantra here is that DACs measured similarly, sound the same. This is not necessarily the same between different amps, ie amps that measure similarly can sound different, right?
 

Cidious

Active Member
Joined
Jan 18, 2019
Messages
148
Likes
140
I thought the mantra here is that DACs measured similarly, sound the same. This is not necessarily the same between different amps, ie amps that measure similarly can sound different, right?
Of course they can, but you'll always have forum Maffioso like Lupin that have to repeat their same lines in every topic. It's probably ignorance or not having enough funds to buy and test some of the devices him/herself. Who knows. I'm just speculating at that.

I've got plenty of kit here. And if it was all the same I'd have never bought anything else anymore after I would have noticed after the first two or maybe three times that it wouldn't matter going off of just measurements. But it does differ. For good or for worse is subjective. All I can say. Devices don't sound the same because they contain an audio signal as mr wise guy tries to sell above.

How much some of the subtleties are worth to someone in terms of money and how much one can hear of it is up to someone on it's own. Some products are snake-oil for sure. But AMPs easily sound different not just by volume level. More measurements and tests need to be included to get a fuller picture of these differences or maybe a better interpretation of the ones already measured.

Having said all that. I stuck with my A30Pro purely for convenience of use and thinking it wasn't worth the extra coin to me personally. A practical decision. D30Pro + A30Pro work just fine for most situations.
 

Veri

Master Contributor
Joined
Feb 6, 2018
Messages
9,596
Likes
12,036
How much some of the subtleties are worth to someone in terms of money and how much one can hear of it is up to someone on it's own. Some products are snake-oil for sure. But AMPs easily sound different not just by volume level.
Not *just* by volume level? ;)

How much some of the subtleties are worth to someone in terms of money and how much one can hear of it is up to someone on it's own. Some products are snake-oil for sure. But AMPs easily sound different not just by volume level. More measurements and tests need to be included to get a fuller picture of these differences or maybe a better interpretation of the ones already measured.
This is a bit of a red herring, "more measurements and tests need to be included to get a fuller picture of these differences" basically corresponds to "that which proves my anecdotal findings is yet to be found but it's surely there". You could explain anything with that.
 

heatwave

Member
Joined
Oct 28, 2022
Messages
6
Likes
3
And this got a 5 star review on What HiFi

They quote:

"Streaming SBTRKT’s Trials Of The Past, the AVC-X3800H delivers a surprisingly nuanced musical performance with an assured attack at the start of each synth note and the envelope of each reverb tail given space to breathe. The hefty bass is solidly controlled, while at the top end of the spectrum, the shakers are nicely defined and spread wide"

:facepalm:
The difference being - What Hi-Fi? based their findings on what you experience with real world usage - actually allowing the receiver to be used the way everyone who owns will be using it. Measurements are never any guarantee of what to expect from a perofrmance point of view. How are senses enjoy what a piece of home audio offers has to offer actually means something to the consumer. Lines on a graph are for would-be engineers, engineers and people with a science delusion.
It would take a complete fool to believe they senses are always going to agree with 'scope measurements.
Here's another thing to consider with measruements. In the late 1970's, Hitachi manufactured an integrated amplifier which measured 'perfectly'. But it was a flop because it apparently sounded very boring.
 

heatwave

Member
Joined
Oct 28, 2022
Messages
6
Likes
3
Great Review Amir, Thanks
I had high expectations but what a disappointment, oh well, I will keep enjoying my X3700H
Give the AVR-X3800H a listen. The proof is much more in the experience than it is in the measurements.
 

heatwave

Member
Joined
Oct 28, 2022
Messages
6
Likes
3
Pure gobbledygook from a person that apparently does not have a understanding of electronics. The circuitry is reacting to each electron passing through it and the designers are basically counting electrons when designing due to the ability to easily convert current and voltage to electron flow ~quantity. Electronics theory(s) has been around for a long time and it has been proven time and time again to be accurate. So when a layman comes along with big ideas about electronics it's amusing if not ridiculous.
Your rant doesn't explain how measurements are any guarantee of outright performance.
When you spend a good deal of time in front of the equipment, comparing with others in it's range, it's very clear to see how mearurements and performance are not necessarily going to correlate.
If you love how something sounds after having compared with the other models of it's type by other brands, but then read the measurements were not good, would you no longer be interested?
That's like falling in love with someone, but deciding to have nothing to do with them because someone else said they didn't like certain little things about their personality.
Mis-matched systems are built around buying based on measurements.
An open mind will trust thy senses and pick based on the sound which was most enthralling. The rest can enjoy their system by looking at the spec's over and over.
 

mctron

Active Member
Joined
Apr 24, 2020
Messages
100
Likes
175
Your rant doesn't explain how measurements are any guarantee of outright performance.
When you spend a good deal of time in front of the equipment, comparing with others in it's range, it's very clear to see how mearurements and performance are not necessarily going to correlate.
If you love how something sounds after having compared with the other models of it's type by other brands, but then read the measurements were not good, would you no longer be interested?
That's like falling in love with someone, but deciding to have nothing to do with them because someone else said they didn't like certain little things about their personality.
Mis-matched systems are built around buying based on measurements.
An open mind will trust thy senses and pick based on the sound which was most enthralling. The rest can enjoy their system by looking at the spec's over and over.
So you've come to Audio Science Review to tell everyone that measurements don't matter and trust your ears
 

Doodski

Grand Contributor
Forum Donor
Joined
Dec 9, 2019
Messages
20,749
Likes
20,760
Location
Canada
Your rant doesn't explain how measurements are any guarantee of outright performance.
When you spend a good deal of time in front of the equipment, comparing with others in it's range, it's very clear to see how mearurements and performance are not necessarily going to correlate.
If you love how something sounds after having compared with the other models of it's type by other brands, but then read the measurements were not good, would you no longer be interested?
That's like falling in love with someone, but deciding to have nothing to do with them because someone else said they didn't like certain little things about their personality.
Mis-matched systems are built around buying based on measurements.
An open mind will trust thy senses and pick based on the sound which was most enthralling. The rest can enjoy their system by looking at the spec's over and over.
You came to ASR a objective website to preach your subjective nonsense and want me to provide the proof to answer your subjective questions. It does not work that way. The electronics theories have been proven over hundreds of years of research. Better specs means better design and transparency. You are apparently not educated in electronics and I say apparently because I don't actually know and we have had peeps come here with a electronics education and subjectively go at us for fun and games. How can I answer your subjective questions when you do not have a fundamental understanding of electronics? It takes 8 months to 10 months of full time study to get the electronics core education under ones belt and that is serious attention to study and lots of hours of studying for tests and stuff. It takes 4 years to be a engineer. So why should any peep here take any layman seriously when they come here preaching listening tests, trusting their senses and whatever else it is you subjectively think. You are deluded and have fantasies about what is what with electronics and want me to explain them for you.
 

solderdude

Grand Contributor
Joined
Jul 21, 2018
Messages
15,891
Likes
35,912
Location
The Neitherlands
Your rant doesn't explain how measurements are any guarantee of outright performance.

Performance.... for certain there is a high correlation.
With performance is meant 'signal fidelity'. With signal fidelity is meant, the described waveform (analog or digital) is reproduced as closely as possible to that waveform.
With performance is not meant how one evaluates a complete sound system in a room including personal preference.

When you spend a good deal of time in front of the equipment, comparing with others in it's range, it's very clear to see how measurements and performance are not necessarily going to correlate.

Correlation with perceived sound and technical performance can be very poor for those that have a certain preferences indeed. Blame the preference of the listener, not the measurements.
Aside from that... There is a difference in quality between 'measurements' and one needs several different measurements (what is called a measurement suite) and knowledge HOW to interpret them AND how to translate that to conditions for that individual.
Do not blame that on measurements but lack of understanding of a bunch or measurements.

If you love how something sounds after having compared with the other models of it's type by other brands, but then read the measurements were not good, would you no longer be interested?

Some would, some won't. See my remark above.
That's like falling in love with someone, but deciding to have nothing to do with them because someone else said they didn't like certain little things about their personality.

Could be they were right about that person but infatuation makes you not see it or do not care about such aspects personally.
Mis-matched systems are built around buying based on measurements.

A bold statement. Any examples of this ?

An open mind will trust thy senses and pick based on the sound which was most enthralling. The rest can enjoy their system by looking at the spec's over and over.

An open mind will realize preference is involved and not discard measurements because of lack of understanding them.
Disregarding measurements and only trusting 'senses' is not open minded behavior.
Open minded means approaching something without prejudice and able to accept any outcome.
 
Last edited:

beren777

Senior Member
Joined
Feb 25, 2020
Messages
339
Likes
589
What I'd like to see in ASR reviews are two separate conclusions: technical excellence, and audible transparency/utility. Many people obsess over and admire which cars can get from 0 to 60 the fastest, or have the highest fuel economy over various scenarios. Many of us just want to get to the grocery store affordably, reliably, and in comfort. I believe ASR can serve both performance and utility-driven objectivists. ASR is never going to satisfy all or even a minority of subjectivists, because by its very nature, subjectivism is only going to be satisfied by putting reality aside and embracing a marketing-driven approach. Other sites and some manufacturers already serve the "tell me how special my ears are and what sounds good to me on Tuesday" crowd.

What I want to know, for a given piece of audio gear, is am I likely under reasonable use and blind testing to notice any audio reproduction quality differences, for better or worse, between it and other available options? If AVR A and AVR B have a SINAD difference of 10 and the IMD is different, but the differences are generally imperceivable either before or after room correction up to normal (or even reference level) listening volume, for example, then I'd like to know so I can make an informed choice. If one AVR costs $5,000 more than another but all features and performance are audibly identical, I'd like to know.

I also like to see what liquid nitrogen-cooled 2-channel DAC has just reached 160 SINAD so I can marvel at it from a "holy crap that's amazing for $200" perspective.

I also like to know if key difference-making features (say, DIRAC support) require additional licensing, whether that licensing is locked per-device, whether it's stable, and whether it degrades audio quality. Does turning it on for a given unit reduce SINAD from 85 to 75, and can I hear the difference or is it off-set by other factors?

Are there areas of research that aren't being addressed these days

Personally, I believe that SINAD is a more useful benchmark of general quality the simpler the audio chain is and ASR weighs this in its bucket approach and in grouping AVRs separate from the 2-channel DACs. There's less going on with a 2-channel DAC intended for music reproduction than an 11.4 channel AVR that has to decode multiple audio and video formats and incorporate all the features expected of a modern AVR, while also running stable and having an easy to use interface for configuration and management. A 120 SINAD AVR is useless if it crashes and experiences weird, movie-interrupting glitches every few minutes, or if the manufacturer provides crappy support and deletes users from its forum if they fail to start their posts with "HAIL MANUFACTURER!"
 

Killingbeans

Major Contributor
Joined
Oct 23, 2018
Messages
4,089
Likes
7,547
Location
Bjerringbro, Denmark.
If you love how something sounds after having compared with the other models of it's type by other brands, but then read the measurements were not good, would you no longer be interested?

Depends on how bad those measurements are.

They could be bad only from an engineering point of view, but still be good enough to exceed the expected abilities of human hearing. In that case, I could simply tell myself that the product was good enough for my hearing, and I could appreciate it for its other abilities like looks, functionality and what have you. If wanted another product with more functionality or a different visual design, I could look for one, well knowing what thresholds of "bad" measurements I should aim for to avoid worrying about any audible downsides.

Or they could be so bad that they'd give indisputable audible effects. In that case, I'd have an indication of what "bad" things pleases me, and I'd have the option to seek out those things in other products, well knowing what to look for. I could hone in on a product that satisfies my lust for those effects, but also has the looks, functionalities and other features that gives me an enjoyable experience. The measurements would help me reach that goal without the need of simply throwing money at products and keeping my fingers crossed.
 

irontortoise

Member
Joined
Jul 21, 2022
Messages
57
Likes
147
Location
Texas
Your rant doesn't explain how measurements are any guarantee of outright performance.
When you spend a good deal of time in front of the equipment, comparing with others in it's range, it's very clear to see how mearurements and performance are not necessarily going to correlate.
If you love how something sounds after having compared with the other models of it's type by other brands, but then read the measurements were not good, would you no longer be interested?
That's like falling in love with someone, but deciding to have nothing to do with them because someone else said they didn't like certain little things about their personality.
Mis-matched systems are built around buying based on measurements.
An open mind will trust thy senses and pick based on the sound which was most enthralling. The rest can enjoy their system by looking at the spec's over and over.
I would recommend doing a little research and discovering a little about the science of sound. Or, I guess you could try and tell engineers, scientists, and educated hobbyists, how they’re wrong based upon your own emotions.
 

TimF

Senior Member
Forum Donor
Joined
Dec 15, 2019
Messages
491
Likes
874
Are measurements everything? Sometimes in music there is more than fidelity if you know what I mean.
 

pau

Member
Joined
Oct 2, 2022
Messages
82
Likes
39
Location
Moon
I have huge respect for the engineering and research done and very much enjoy educating my self via information shared.

One aspect often forgot while just looking at the measurements is the environment noise floor and what we can utilize from the devices on our typical listening levels and rooms.

I was shocked to find i cannot hear more than <48db dynamic range with my typical listening volumes and old ears. o_O Doesn't stop me from enjoying any less, but just points out that there might come other aspects to consider than just equipment measures.

Hunting better measuring devices where the improvements are not audible in many cases will end up money wasted that could be used to better aestetics & acoustic treatments.

"Whatever's good for your soul.. Do That."

 

Robbo99999

Master Contributor
Forum Donor
Joined
Jan 23, 2020
Messages
6,874
Likes
6,672
Location
UK
What I'd like to see in ASR reviews are two separate conclusions: technical excellence, and audible transparency/utility. Many people obsess over and admire which cars can get from 0 to 60 the fastest, or have the highest fuel economy over various scenarios. Many of us just want to get to the grocery store affordably, reliably, and in comfort. I believe ASR can serve both performance and utility-driven objectivists. ASR is never going to satisfy all or even a minority of subjectivists, because by its very nature, subjectivism is only going to be satisfied by putting reality aside and embracing a marketing-driven approach. Other sites and some manufacturers already serve the "tell me how special my ears are and what sounds good to me on Tuesday" crowd.

What I want to know, for a given piece of audio gear, is am I likely under reasonable use and blind testing to notice any audio reproduction quality differences, for better or worse, between it and other available options? If AVR A and AVR B have a SINAD difference of 10 and the IMD is different, but the differences are generally imperceivable either before or after room correction up to normal (or even reference level) listening volume, for example, then I'd like to know so I can make an informed choice. If one AVR costs $5,000 more than another but all features and performance are audibly identical, I'd like to know.

I also like to see what liquid nitrogen-cooled 2-channel DAC has just reached 160 SINAD so I can marvel at it from a "holy crap that's amazing for $200" perspective.

I also like to know if key difference-making features (say, DIRAC support) require additional licensing, whether that licensing is locked per-device, whether it's stable, and whether it degrades audio quality. Does turning it on for a given unit reduce SINAD from 85 to 75, and can I hear the difference or is it off-set by other factors?

Are there areas of research that aren't being addressed these days

Personally, I believe that SINAD is a more useful benchmark of general quality the simpler the audio chain is and ASR weighs this in its bucket approach and in grouping AVRs separate from the 2-channel DACs. There's less going on with a 2-channel DAC intended for music reproduction than an 11.4 channel AVR that has to decode multiple audio and video formats and incorporate all the features expected of a modern AVR, while also running stable and having an easy to use interface for configuration and management. A 120 SINAD AVR is useless if it crashes and experiences weird, movie-interrupting glitches every few minutes, or if the manufacturer provides crappy support and deletes users from its forum if they fail to start their posts with "HAIL MANUFACTURER!"
I'll just give my thoughts on this, they're not answers to the problem, but they're my thoughts on it. About your second paragraph, I don't think enough is known about how to relate measurements to audibility and enjoyment for a review site to compare those aspects and draw the conclusions that you're looking for. The way I see it with SINAD and IMD, etc is that if the price is right then I'll just choose the piece of equipment that measures the best for something simple like a DAC or amp. I agree though that it would be great if there was some scientifically proven information out there that could thresholds for these various measurements and therefore we'd be in a position to evaluate the real world importance of the measurements. In my opinion you want your DAC to be over 100dB SINAD for psychological/theoretical comfort, that said I've got a miniDSP 2x4 that's hooked up to my speakers and the output side of that DSP solution says it's measuring minus 80-85dB of noise floor when not even playing anything and I'd say it's not negatively impacting my listening experience - but I'd always opt for over 100dB SINAD in my buying choices as long as it was priced OK.

Re, your 5th paragraph, single sentence on research - that could be an interesting inclusion into the site, it could be interesting if there was maybe a seperate section on HiFi News that could contain anything interesting re new products or new research......it might dilute the purity of the site though in being a review site......but the research side of "what's happening" now and in future would be interesting.

Your last paragraph re AVR reviews - I agree there could be a greater emphasis on real world experience or real world features rather than relying just on the current suite of measurements. AVRs are complicated beasts, and I'm sure there's more to their experience than just the SINAD numbers. The ability of the entire solution to create a perhaps measurably & subjectively positive experience at the listening positions would be an interesting addition. There'd be a lot of time investment I imagine to thoroughly review an AVR. I don't actually own an AVR, but for me they're an aspirational somewhat impractical aspiration - I haven't married the concept of 2-channel high quality music playback with a practical/affordable AVR solution, I'm currently stranded (happily) on a 2.1 channel quality (ASR measured for the speakers) system for TV/Music/Movies....but I know from experience what even an old relatively inexpensive properly setup 5.1 AVR can do for movies!
 

heatwave

Member
Joined
Oct 28, 2022
Messages
6
Likes
3
I would recommend doing a little research and discovering a little about the science of sound. Or, I guess you could try and tell engineers, scientists, and educated hobbyists, how they’re wrong based upon your own emotions.
It makes perfect sense for the engineers to concern themselves with measyrements, but not the average consumer. It might if measurements could guarantee performance, but they do not. This is where spec heads fall of the rails with their argument every time - they cannot answer the question of what does it matter what the specs are if it sounds great? Or why are spec's so important to a consumer if they do not guarantee performance?
I get the impression such people are just out to try to shame the manufacturer if their product doesn't measure well (regardless of who good the sonic results are). Tube amplifiers don't measure well, but the good ones sound sublime...or at least allow the speakers to sound sublime. In a way solid state cannot hold a candle to.
 

heatwave

Member
Joined
Oct 28, 2022
Messages
6
Likes
3
So you've come to Audio Science Review to tell everyone that measurements don't matter and trust your ears
Measurements matter to engineers, and for good reason. Consumers are not so good at explaining their fixation with measurements, when what matters most is sonic performance - if indeed how something sounds means anything to the consumer.
When I started to reaize a product which hasn't measured well could perform impressively, I became skeptical about what the measurements were really telling us about performance.
If the engineer gets the product to perform in a way which really pleases him or her, they have the choice of reducing the perofrmance for the sake of pleasing the spec heads, or leaving the mearurements where they are to please those who want the product to perform like a champ.
If my system - which measures really well - doesn't impress me, I would be a fool to think it's a good system because I am safe in the knowledge it measures well.
 

Blumlein 88

Grand Contributor
Forum Donor
Joined
Feb 23, 2016
Messages
20,523
Likes
37,056
Measurements matter to engineers, and for good reason. Consumers are not so good at explaining their fixation with measurements, when what matters most is sonic performance - if indeed how something sounds means anything to the consumer.
When I started to reaize a product which hasn't measured well could perform impressively, I became skeptical about what the measurements were really telling us about performance.
If the engineer gets the product to perform in a way which really pleases him or her, they have the choice of reducing the perofrmance for the sake of pleasing the spec heads, or leaving the mearurements where they are to please those who want the product to perform like a champ.
If my system - which measures really well - doesn't impress me, I would be a fool to think it's a good system because I am safe in the knowledge it measures well.
I see the circle of confusion is strong for you. Measurements can break that circle, and if your preference is for something else it can be changed to suit your preference. Otherwise the cliche of throwing the baby out with the bathwater applies.
 
Top Bottom