
Build DeepSeek from Scratch
Dormant Last read · last published · next check
Read 3 days ago and current, but nothing has been published for 16 months.
Latest videos
Saves to your Watch queue, to pick up on another day or another device.


Integer and Binary Positional Encodings | Journey towards Rotary Positional Encodings (RoPE)

Multi-Head Latent Attention Coded from Scratch in Python

Multi-Head Latent Attention From Scratch | One of the major DeepSeek innovation

Understand Grouped Query Attention (GQA) | The final frontier before latent attention

Multi-Query Attention Explained | Dealing with KV Cache Memory Issues Part 1

Key Value Cache from Scratch: The good side and the bad side

Multi-Head Attention Handwritten from Scratch

Multi-Head Attention Visually Explained

Causal Attention Explained: Don't Peek into the Future!

Self Attention Mechanism - Handwritten from scratch

The Attention Mechanism 1 hour explanation

LLM Architecture in 1 hour | Journey of token through the LLM Architecture

DeepSeek Basics

