Last updated: March 18, 2026
This is not my list and I have taken it from https://www.linkedin.com/posts/raj-abhijit-dandekar-67a33118a_i-am-glad-i-returned-to-india-after-my-machine-activity-7326939074135564288-4J4j/?utm_source=share&utm_medium=member_android&rcm=ACoAAAPsW64BNtxodzQe3M_H7WwpWaac2Y0ycAQ
To build the foundational capacity of countries in building LLMs, countries need to know the nuts and bolts of how DeepSeek was assembled.nThere are 20 lectures in this playlist:
(1) DeepSeek series introduction: https://lnkd.in/gRcNE-sg
(2) DeepSeek basics: https://lnkd.in/gEUzFtrC
(3) Journey of a token into the LLM architecture: https://lnkd.in/gUnabApX
(4) Attention mechanism explained in 1 hour: https://lnkd.in/gSVXDn2e
(5) Self Attention Mechanism - Handwritten from scratch: https://lnkd.in/gN85qVSK
(6) Causal Attention Explained: Don't Peek into the Future: https://lnkd.in/gNPwCJWT
(7) Multi-Head Attention Visually Explained: https://lnkd.in/gPr-XrwE
(8) Multi-Head Attention Handwritten from Scratch: https://lnkd.in/gzb6Xvy6
(9) Key Value Cache from Scratch: https://lnkd.in/gn8zgdc7
(10) Multi-Query Attention Explained: https://lnkd.in/gvt3AyRh
(11) Understand Grouped Query Attention (GQA): https://lnkd.in/geFFq_95
(12) Multi-Head Latent Attention From Scratch: https://lnkd.in/g3z8PkCZ
(13) Multi-Head Latent Attention Coded from Scratch in Python: https://lnkd.in/g9drDgGZ
(14) Integer and Binary Positional Encodings: https://lnkd.in/eC3USqBF
(15) All about Sinusoidal Positional Encodings: https://lnkd.in/e_6CAdnk
(16) Rotary Positional Encodings: https://lnkd.in/emHARqyP
(17) How DeepSeek exactly implemented Latent Attention | MLA + RoPE: https://lnkd.in/esbk5SGR
(18) Mixture of Experts (MoE) Introduction: https://lnkd.in/emYCfZuc
(19) Mixture of Experts Hands on Demonstration: https://lnkd.in/eRnRcYxF
(20) Mixture of Experts Balancing Techniques: https://lnkd.in/ef4qeqPy
This is 16 hours of the most in-depth content out there. The videos have received a great response so far. If you want to build a state of the art foundational model, all the content is right here. You don’t need fancy university titles or pay huge amounts of money! You need a laptop and a notebook. The sky is the limit.
Thanks to Invideo AI for sponsoring this series. Great to work with Ancy Verghese on this collaboration.