Recent content in About on Junu Park
Understanding Transformer 
 How can one learn Transformer? 
The Transformer Architecture (introduced in the paper Attention is All You Need ) is one of the most successful models in deep learning and the backbone of what made the “ChatGPT moment” possible. Because of its importance and impact, there are already many high-quality explanations of what the model is , how it works , and even…
Introduction 
 In Lab02, We are going to look at how Jupyter/Colab Notebook models, codes are actually deployed as a service. 
 
 
 This is a simple chatbot called simple chat which is containerized in Docker and run on FastAPI. 
 We will build and deploy this chatbot using DialoGPT as the model, use FastAPI to create API endpoints, and deploy it with Docker. 
 The goal of…
This is a simple experiment to just get a feel of the abstraction PyTorch provides, and all the internal complexity hidden below. We will also compare the performance of basic vector addition between PyTorch, Triton, and CUDA. 
 Note: This experiment was done in NVIDIA RTX 3050ti laptop GPU 
 Vector Addition in PyTorch 
 import torch 
 
 size = 128 * 128 
 a = torch . randn…
Today, I am going to talk about how to not regret. This is important to many of us, since we spend lots of time regretting our past, suffering about the future, and blaming our current selves. 
 The answer to this is quite straightforward: Do your best in the given situation. I know, it sounds predictable and perhaps a bit cliché, but please, keep reading. You think you’ve failed and…