• WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!

3Blue1Brown video on Transformer Neural Networks (like ChatGPT)

RandomEar

Senior Member
Joined
Feb 14, 2022
Messages
365
Likes
885
Youtube creator 3Blue1Brown published an interesting and well crafted video on the inner workings of transformer NNs like ChatGPT:


It's more of a high level overview without diving into the deeper math and focuses on understanding the logic behind the main elements of "AIs" like ChatGPT. For people not familiar with the tech behind neural networks, the explanations of word embedding (a.k.a. translating the meaning of words and word chunks into vectors) and the final step of unembedding are the most interesting, I think.

The video is part of a loosely connected series on NNs in general and more episodes on transformer NNs will follow in the next couple of weeks.
 
Thank you for the tip!

I liked the video so much that I'll be watching the entire playlist.

 
Back
Top Bottom