3Blue1Brown video on Transformer Neural Networks (like ChatGPT)

[RandomEar]

Youtube creator 3Blue1Brown published an interesting and well crafted video on the inner workings of transformer NNs like ChatGPT:

It's more of a high level overview without diving into the deeper math and focuses on understanding the logic behind the main elements of "AIs" like ChatGPT. For people not familiar with the tech behind neural networks, the explanations of word embedding (a.k.a. translating the meaning of words and word chunks into vectors) and the final step of unembedding are the most interesting, I think.

The video is part of a loosely connected series on NNs in general and more episodes on transformer NNs will follow in the next couple of weeks.

 

[Rednaxela]

Thank you for the tip!

I liked the video so much that I'll be watching the entire playlist.

Neural networks

Learn the basics of neural networks and backpropagation, one of the most important algorithms for the modern world.

youtube.com

 

[RandomEar]

The next one just went up:

Also, chapter 6 was available a couple days after my original post: