Some CUDA programming fun in Julia
Suppose we want to draw a batch of images, where each image is made up of randomly positioned and colored triangles, that are blending. It will look like this:
Personal website of Can Candan. All rights reserved.
Suppose we want to draw a batch of images, where each image is made up of randomly positioned and colored triangles, that are blending. It will look like this:
Introduction Components Weight Decay and Optimiser Loss and Gradient Calculation Making it Fast Try it yourself Introduction As a learning exercise, I tried to port Andrey Karpathy’s awesome minGPT , which is based on Python and PyTorch to Julia and Flux. GPT is a language model, that is trained by the error signal of its prediction for the next element of a given sequence. Karpathy runs the model…