Welcome to the world of AI - Learning about the Decoder-Only transformer - From scratch with PyTorch

In this third in this series post, we build on what we did in the previous post to now build GPT from scratch. We will leverage Andrej Karpathy Makemore series . Where as Andrej used Tiny Shakespeare, we will use the baby names dataset that he used in one of his earlier trainings Import the libraries import torch import torch.nn as nn import torch.nn.functional as F import matplotlib.pyplot as plt…