I figured I would share some charts. My feeling is that the best we can do to truly objectively observe a lossy codec is through a spectrogram. Group ABX testing is fine and all, but it's far from objective. From what I gather, lossy audio is best when it keeps anything under ~15KHz untouched compared to the source material. I've found that classical music to be the hardest for codecs to manage, and most EDM/pop is easy for lossy codecs.
My criteria for a good sounding lossy codec is as follows:
- Good visual similarity between lossless source and lossy codec, especially below 15KHz. This means, same amplitude and intensity for the meat of the music. Nothing added or lost.
- No new transients and harmonies that were not existent on the source material.
- No masking of "air" in the 6-13KHz range.
- Aggressive omission of non-transient information (noise) only above 15KHz. Most content above here is only harmonic transients and noise anyway.
- If lossy omission removes anything, it should be during louder parts of a track. When the track has less masking events, it should not cut high frequency information.
I really thought AAC would be considerably better than MP3, but follow along with my interesting findings.
Opus 320Kbit codec v1.3.1
Outstanding performance. Almost zero change below 20KHz. No modification of harmonies, and it leaves noise between those harmonies alone. The harmonies don't have any exaggerations or attenuation. I can almost guarantee that you will not be able to tell the difference between this and a FLAC. No spectral holes are visible. It's probably due to how the codec re-synthesizes some of what it removes. Just Magic.
Note: I ran 320Kbit both CBR and VBR, but they appear identical. I think I recall reading something about how this codec is always VBR no matter what.
View attachment 269678
Apple CBR AAC 320Kbit Apple iTunes encoder
Applies some sort of gradual NR from 6KHz and up, and then has some sort of noise/smearing between harmonics and some of the harmonies are amplified. Sure, it preserves higher frequency transients, but I'd argue that they are a waste of information when the most perceptible part of the audio is below 15KHz.
View attachment 269679
MP3 CBR 320Kbit Lame encoder 3.101
Looks rough at first glance, but most of the lossy omission is above 16KHz. This may actually be better than Apple AAC, despite it looking kind of rough/grainy from 16-20KHz. Almost nothing below 16KHz is touched, which means it's unlikely to be perceptible. I'm actually surprised by this, as I though AAC would blow MP3 away. I'm sure a lot of this is due to LAME's great encoder.
View attachment 269680
MP3 VBR V0 lame Lame encoder 3.101
Applies aggressive de-noising above 16KHz, but also appears to infrequently remove noise between loud harmonies from 6-16KHz. Really good results considering it's just an MP3. The other cool thing is that it restores high frequency noise up to 22KHz during silent parts of a track that wouldn't be masked by louder parts of the track. I may actually start encoding my portable libraries for my car in this format since my car doesn't support OPUS. I'm extremely surprised by this result.
View attachment 269681
So, what are your thoughts? Any requests for lower bitrates?