RandomEar
Senior Member
- Joined
- Feb 14, 2022
- Messages
- 365
- Likes
- 885
Youtube creator 3Blue1Brown published an interesting and well crafted video on the inner workings of transformer NNs like ChatGPT:
It's more of a high level overview without diving into the deeper math and focuses on understanding the logic behind the main elements of "AIs" like ChatGPT. For people not familiar with the tech behind neural networks, the explanations of word embedding (a.k.a. translating the meaning of words and word chunks into vectors) and the final step of unembedding are the most interesting, I think.
The video is part of a loosely connected series on NNs in general and more episodes on transformer NNs will follow in the next couple of weeks.
It's more of a high level overview without diving into the deeper math and focuses on understanding the logic behind the main elements of "AIs" like ChatGPT. For people not familiar with the tech behind neural networks, the explanations of word embedding (a.k.a. translating the meaning of words and word chunks into vectors) and the final step of unembedding are the most interesting, I think.
The video is part of a loosely connected series on NNs in general and more episodes on transformer NNs will follow in the next couple of weeks.