RSSAmplifier

Blog

Can Candan

Personal website of Can Candan. All rights reserved.

/RSS feed ↗2 posts

Latest posts

Some CUDA programming fun in Julia

Suppose we want to draw a batch of images, where each image is made up of randomly positioned and colored triangles, that are blending. It will look like this:

minGPT in Julia using Flux!

Introduction Components Weight Decay and Optimiser Loss and Gradient Calculation Making it Fast Try it yourself Introduction As a learning exercise, I tried to port Andrey Karpathy’s awesome minGPT , which is based on Python and PyTorch to Julia and Flux. GPT is a language model, that is trained by the error signal of its prediction for the next element of a given sequence. Karpathy runs the model…