Rtings. Worth a sub for audio measurements?

[bachatero]

Earlier this year, Rtings switched to a paywall to access objective measurements for all their tests. This was claimed to be because of AI crawlers.

However, ASR is still free and open for everyone and the only cost to members is an optional donation. I'm a supporter of the idea of paying for ongoing costs (tests of new equipment) but I don't like how Rtings scrubbed their entire backlog so now it's harder to access past reviews without paying up.

Do you think it's worth it to pay for Rtings tests or do you prefer something more like ASR's model?

 

[Buckchester]

I didn’t find their methods to be the best for audio. Maybe for video.

 

[staticV3]

Rtings vs ASR ist Apples vs Oranges:
https://www.rtings.com/company/about-us

I get why they did it.
Running an operation as big as theirs on optional donations is most likely not feasible.

 

[Curvature]

The measurements of headphones, TVs and other household devices are useful. The soundbar measurements, before they were locked down, were not very useful relative to what we get with Amir or Erin and a few other places that provide full anechoic measurements.

 

[Chrispy]

I've only used their tests on tvs for the most part. Took a peek at their audio just now, not much there, particularly if I need to pay for it.

 

[bachatero]

The measurements of headphones, TVs and other household devices are useful. The soundbar measurements, before they were locked down, were not very useful relative to what we get with Amir or Erin and a few other places that provide full anechoic measurements.

This is exactly my experience with Rtings too. Their setup downright looks like a prison cell with giga reflections off the walls and it's not clear what kind of adjustments they're making for that.

 

[MAB]

Do you think it's worth it to pay for Rtings tests or do you prefer something more like ASR's model?

No thank you. What problem at ASR would this solve?

 

[Hemi-Demon]

Their TV reviews are excellent, but requiring a log in, and a fee, to view "any" of the analysis is a bit much. I support most of the sites I visit, but not as a necessity. Good luck to them but I will move on.

 

[Curvature]

This is exactly my experience with Rtings too. Their setup downright looks like a prison cell with giga reflections off the walls and it's not clear what kind of adjustments they're making for that.

I'm vaguely remembering some smoothing or averaging. The setup was multiple mic positions over a couch or something similar.

 

[Redacted]

Is it all just more made up nonsense for money? I don't know these days.

 

[kemmler3D]

Is it all just more made up nonsense for money? I don't know these days.

No, they do real tests, just not quite with the rigor precision and technical angle that Amir does, they're more consumer-oriented.

I guess the answer to OP's question depends on whether you're actually shopping something and whether they have data you can't get elsewhere. I don't think there is anything wrong with supporting their business model. It beats the "say nice things about snake oil for money" model our least-favored "reviewers" use.

 

[VintageFlanker]

just not quite with the rigor that Amir does

I would have say the exact opposite. Amir is surely more extensive and technical about raw signal measurements, but regarding everything else, whole RTINGS reviews are much, much more rigorous (and strictly cohesive across hundreds/thousands of DUTs).

 

[Chrispy]

I would have say the exact opposite. Amir is more extensive and technical about raw signal measurements, but regarding everything else, RTINGS reviews are much much more rigorous (and strictly cohesive across hundreds/thousands of DUTs).

Can you expand on why rtings are much much more rigorous and cohesive? I've only glanced at their site once in a while, their fixtures/procedures I don't particularly remember. You talking about various consumer electronics or audio in particular?

 

[bachatero]

Can you expand on why rtings are much much more rigorous and cohesive?

whole RTINGS reviews are much, much more rigorous (and strictly cohesive across hundreds/thousands of DUTs).

they're more consumer-oriented.

Is it all just more made up nonsense for money?

I'm vaguely remembering some smoothing or averaging.

How about we look at an actual Rtings review of something familiar: https://archive.is/nupF7

Verdict: Their testing methods are different to the standard anechoic chamber kind. However, it's not obvious that this is in fact a problem, rather that their metrics are probably good at comparing speakers in their test portfolio and not between theirs and ASR's.

Also, look at that GNARLY frequency response!

(Left: vertical orientation, right: horizontal orientation)

 

[kemmler3D]

I would have say the exact opposite. Amir is surely more extensive and technical about raw signal measurements, but regarding everything else, whole RTINGS reviews are much, much more rigorous (and strictly cohesive across hundreds/thousands of DUTs).

That's fair actually. They do a lot of testing in a very systematic way. I haven't dug into the RTINGs tests recently but I think what's a bit problematic is their scoring / rating system, which being quite detailed also includes some decisions or weightings I don't personally agree with, or that I at least think aren't uncontroversial. It's been a long time so I don't even know if they're still doing it that way.

They should just get a klippel though!

 

[VintageFlanker]

Can you expand on why rtings are much much more rigorous and cohesive?

The simple fact that all reviews (whatever the type of DUT) follow strictly the exact same run of tests, pics, data presentation over and over. That's just not the case here (which BTW is also a good thing). We're comparing apple and oranges. Amir is a single person doing what he does on his free time, which is highly commendable.

I think what's a bit problematic is their scoring / rating system, which being quite detailed also includes some decisions or weightings I don't personally agree with

Yep, same thoughts.

rather that their metrics are probably good at comparing speakers in their test portfolio and not between theirs and ASR's.

Agreed, but that wasn't my point. RTINGS reviews are much more extensive that just acoustic measurements (which BTW would be obviously less accurate than what we have here with a NFS). I'm talking about their reviews from start to finish.

 

[Curvature]

How about we look at an actual Rtings review of something familiar: https://archive.is/nupF7

Verdict: Their testing methods are different to the standard anechoic chamber kind. However, it's not obvious that this is in fact a problem, rather that their metrics are probably good at comparing speakers in their test portfolio and not between theirs and ASR's.

Also, look at that GNARLY frequency response! View attachment 555921
(Left: vertical orientation, right: horizontal orientation)

The minimum I would expect would be some attempt at presenting the 360 horizontal and vertical responses. Single curves say close to nothing, even when "averaged and compensated".

 

[JohnnyNG]

I've subscribed for a couple years and find their review of TVs and appliances quite useful and deep. I don't pay too much attention to the speaker (mostly bluetooth?) reviews but did buy a soundbar based on their rec. and it's been excellent.

 

[Chrispy]

The simple fact that all reviews (whatever the type of DUT) follow strictly the exact same run of tests, pics, data presentation over and over. That's just not the case here (which BTW is also a good thing). We're comparing apple and oranges. Amir is a single person doing what he does on his free time, which is highly commendable.


Yep, same thoughts.


Agreed, but that wasn't my point. RTINGS reviews are much more extensive that just acoustic measurements (which BTW would be obviously less accurate than what we have here with a NFS). I'm talking about their reviews from start to finish.

Thanks, but is the run of tests, pics, data presentation valid in itself? What are they? I appreciate that for the same type of DUT they do the same thing, but is it the best way?

 

[VintageFlanker]

Thanks, but is the run of tests, pics, data presentation valid in itself?

So far, yes.

What are they?

Honestly, there're way too much things to count. The best is that you would have a look of an entire RTING review, which at the time is, I believe, impossible without being a subscriber (which I am). I'll try to PM you with something...