
Building LLMs from scratch
Dormant Last read · last published · next check
Read 3 days ago and current, but nothing has been published for 23 months.
Latest videos
Saves to your Watch queue, to pick up on another day or another device.


Lecture 14: Simplified Attention Mechanism - Coded from scratch in Python | No trainable weights

Lecture 13: Introduction to the Attention Mechanism in Large Language Models (LLMs)

Lecture 12: The entire Data Preprocessing Pipeline of Large Language Models (LLMs)

Lecture 11: The importance of Positional Embeddings

Lecture 10: What are token embeddings?

Lecture 9: Creating Input-Target data pairs using Python DataLoader

Lecture 8: The GPT Tokenizer: Byte Pair Encoding

Lecture 7: Code an LLM Tokenizer from Scratch in Python

Lecture 6: Stages of building an LLM from Scratch

Lecture 5: How does GPT-3 really work?

Lecture 4: What are transformers?

Lecture 3: Pretraining LLMs vs Finetuning LLMs

Lecture 2: Large Language Models (LLM) Basics

