• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

Plexamp adds AI driven library and playlist features for Plex Pass users

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
The below is the copy from the following article: https://www.plex.tv/blog/super-sonic-get-closer-to-your-music-in-plexamp/

"Super Sonic: Get Closer to Your Music in Plexamp!
Today we’re announcing a massive server upgrade for Plex Pass subscribers who have discovered our awesome dedicated music app, Plexamp. We’ve added a sophisticated neural network which analyzes your music library, powering amazing new features and improving existing ones. Skip down to the “Get Started” section to learn how to turn it on, or continue reading for all the gory and delightful details.
A Peek Under the Hood
Once you enable Sonic analysis on a music library, all tracks, albums, and artists are processed in order to place them in a Musical Universe (math nerd? This musical universe consists of points in N-dimensional space). This allows us to see how “close” anything in your library is from anything else, where distance is based on a large number of sonic elements in the audio.
So what can we do with this new-found power? Quite a bit, it turns out…
Sonic Similarity
The most obvious way the sonic data is useful is for showing similar artists, albums, and tracks. While we are already using metadata for similar artists (and albums as well, although tbh we didn’t get a lot of data for this), needing to rely on metadata has two big downsides: There is a lot of music out there without metadata (think obscure Bandcamp artists or your high school band). Secondly, doing sonic analysis ensures that the similarity reflects the actual music you have. For example, if you only have the last two hipster-folk Taylor Swift albums (for shame, her early stuff is great too!), Sonically Similar Artists will reflect that fact (what are the odds that the Lana Del Rey similarity is related to the fact that Jack Antonoff contributed to both artists?)

As a cool example of how eerily well this can work, consider Neil Young, an artist with a diverse catalog of musical styles over the last five decades. If you look at Mirror Ball, you’ll see the fascinating fact that one of the most similar albums is Pearl Jam’s Vitalogy, which is notable because Pearl Jam played as the backing band on Mirror Ball!

Want another cool example? In the sonically similar albums for Richard Edwards’ most excellent Lemon Cotton Candy Sunset you’ll notice a Margot & the Nuclear So and So‘s album there. Why is that interesting? Because it’s Richard Edwards’ old band! I guess the musical apple doesn’t fall far from the tree.

We’re so hooked on this feature, every time we add new music, the first thing we do is see what each album is sonically similar to.

It’s also fun to see what tracks are sonically similar. Clearly the Wu-Tang Clan has a pretty unique sound!

Related Tracks
We’ve added a section for Sonically Similar tracks in Plexamp’s Related tab. Quickly and easily queue up similar tracks!

Track + Album Radios
We were forced to remove Plex Mix a few years ago because of a metadata provider change, and people definitely missed it. For a while now we’ve been talking about ways to replace it, and it turns out this new Sonic data provides a superb basis for building our new Track Radio.

But why stop at track radio? Some people (looking at you, Random Album Radio users!) really like their music to be in units of albums, so we’ve also added Album Radio, which plays the selected album and then follows it up with sonically similar albums.

Mixes For You
We love building a wide gamut of music experiences: From Library Radio to style and mood radios, to Mix Builder, and now with Track Radio and Album Radio, you have an incredibly diverse range of options for getting those tunes playing. With all that tasty sonic data, we decided to add a new one we call Mixes For You. Your server analyzes the albums you’ve had on heavy rotation recently, cluster them into mixes, and then sprinkle in sonically similar albums. For good measure your server looks back further in time and makes a few historical mixes based on your past habits.

Bonus Feature: Album Types
Not every album is an “album”. Some are live, some are demos, some are EPs. And from today, we’ll now organize albums by type on the artist page. You can also use the powerful new filters to search for all your live albums, or all your EPs from the 80s. The world is your album oyster.

Bonus Feature: On This Day
There’s no better way to feel really old nostalgic about your music than to be reminded of every album’s meaningful birthdays. So wake up, have some coffee (flat white please!), and see what albums were released 20, 30, or even 50 years ago."
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
Its been a spell since i used plexamp. Definely some nice improvements since i last used it. The UI is gorgeous. It now has a graphic equalizer as well so you can eq in the app which is nice for us folks following Amirs work and wanting to eq our headphones. Moods, genres, auto generated artist, album, track "radio stations. If you are a Tidal subscriber and linked accounts it shows recommendations based on your tidal favorites as well. Nice work Plex folks.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
I haven't been able to check out the AI driven Sonic Similarity features yet as my Plex Server is still processing all the music through the ML models during it's regular scheduled task cycle. Once all the albums and tracks are complete I should start to see the features pop up on Plexamp on my Android phone.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
It's been about 8 hours and still 1329 albums out of 1569 to process. So this is going to take a few days.
 

cyruz

Active Member
Joined
Sep 13, 2020
Messages
100
Likes
83
Location
Italy
It's a nice piece of software but the absence of ASIO support and resampling it's a bit of a dealbreaker. I asked for these features 1 year ago and I was being told they were planned though...
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
Agreed. Also would like a PEQ application built in like Roon in the player apps as well as the ability to use the player apps as DLNA/Upnp control points like bubble upnp. Also a USB audio out driver for Android like UAPP to get bit perfect to an external DAC. Then it starts becoming my only player solution on my mobile devices and my home system remote control.

Maybe with the recent round of funding raised they will bring that feature "above the line."
 

alpha_logic

Active Member
Joined
Aug 16, 2021
Messages
126
Likes
196
This musical universe consists of points in N-dimensional space

Translation: K-means clustering in Euclidean space? Nice feature, I guess I need to rebuild my plex docker image - thx for sharing!
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
It's been about 8 hours and still 1329 albums out of 1569 to process. So this is going to take a few days.
706 albums to go. I have my scheduled tasks opened up to 23 hours per day. It's only using 2 of my 6 cores running 2 analyzer processes. They are single threaded so you will be limited by the number of cores and your single core single thread processing speeds.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
395 albums to go. Still Chugging along. I sometimes see 5 Analyzer processes running at 99% CPU each (single thread) so it's ramping up and down depending on my MacOS's CPU management decisions.
 

Bastia

Member
Joined
May 12, 2021
Messages
16
Likes
18
700 albums to go for me... My collection isn't that big yet, but it will already take a few more days (23 hours a day) to process everything.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
mine seems to have completed (no albums processing in the plex activity monitor) but the Music Analyzer processes still seem to be running. currently 4 instances running at 100% CPU each in my MacOS activity monitor. No sign yet of "sonically similar" section in my Plexamp app. There must be a post processing step to create the relationships once all the albums are "listened to" by the ML models.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
Starting to see some interesting "Sonically Similar" items show up in my artists list.

Examples of unexpected Sonically Similar artist connections:
1) Alabama Shakes yields "vampire weekend" as sonically similar.
2)Audioslave yields Simple Mischief and The Tragically Hip as sonically similar.
3)311 yields Mighty Mighty Bosstones as sonically similar.
4) Arcade Fire yields Stereolab as sonically similar.
5) Claude Debussy yields Bruckner, Rachmaninoff, Mahler, and Dmitri Shostakovich as sonically similar.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
Grateful dead track Dire Wolf is sonically similar to mark chestnuts bubba shot the jukebox from the album your room.
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
One potential problem. I have 500 unrelated single tracks in a folder and the Analyzer is processing these as a single "album" and it's taking hours and hours to process. I am not sure if this is going to cause problems for the Analyzer or not since the tracks are unrelated to each other.
 

maverickronin

Major Contributor
Forum Donor
Joined
Jul 19, 2018
Messages
2,527
Likes
3,311
Location
Midwest, USA
One potential problem. I have 500 unrelated single tracks in a folder and the Analyzer is processing these as a single "album" and it's taking hours and hours to process. I am not sure if this is going to cause problems for the Analyzer or not since the tracks are unrelated to each other.

It doesn't process them by tags? :facepalm:
 

Berwhale

Major Contributor
Forum Donor
Joined
Aug 29, 2019
Messages
3,957
Likes
4,963
Location
UK
I've enabled the feature, I have 18,966 FLACs in my collectio (805GB) which is 1476 albums according to Plex. I suspect that this might take some time...

(Plex Server running on virtualized Synology OS (with 4 vCPU) running on ESXi on a 4 core Xeon Server).
 
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
OP
B

Beershaun

Major Contributor
Forum Donor
Joined
Oct 3, 2019
Messages
1,877
Likes
1,922
I've finally finished. I had to move a folder with about 350 unrelated single tracks out of the library temporarily to simplify the scan. It was just not finishing that folder of singles. Now I'm seeing for every artist and album a section of "sonically similar" items. Another interesting connection. Soul Coughing El Oso yields David Bowie Blackstar as sonically similar, which Gorillza also says is sonically similar. Whoa...
 
Top Bottom