$ tail -f /var/log/life.log
I ve been thinking about binary neural networks lately, and specifically how to do it without computing full precision gradients. Broadly, there are two camps in binary neural networks. The most prominent (and effective) way to train binary neural networks is to keep the weights in full precision and binarise during forward pass. I d say BitNet Continue reading On training binary neural networks
When I was at Amazon s LLM pre-training team, our pre-training jobs used to run for weeks. Being impatient as I am, it was frustrating to wait for a whole week to see if the changes we made (mostly to the data) worked. The magic number was 1 trillion tokens, and even a smallish model (eg: Continue reading Thinking aloud: Can we speed up model training by using binary weights?
Disclaimer: I do not know why PyTorch + MPS is faster (yet) I recently came across Apple s MLX framework. It is a numpy-like interface that will let you run computations on Apple s own GPUs if you have a Mac with an m-series chip. It uses Apple s metal API under the hood. I wanted to see Continue reading matmul() using PyTorch s MPS backend is faster than Apple s MLX
I recently launched TweetScreenr. Going completely serverless kept the cloud costs low during development. I used the serverless framework to deploy my python flask API end points as AWS lambda functions. However this slowed down the development speed and I ran into tricky issues and limitations. Continue reading Lessons learned from making a SaaS* completely serverless**
Disclaimer: The post is more about understanding LUTs and HaldCLUTs and writing methods from scratch to apply these LUTs to an image rather than coming up with CLUTs themselves from scratch. Outline What are film simulations? CLUTs primer Simple hand-crafted CLUTs The identity CLUT HaldCLUTs Applying a HaldCLUT Notes and further reading There is also Continue reading Film simulations from scratch…
Disclaimer: All I ve done is write a few config files. This is for you if: Your python IDE of choice is PyCharm You wish you had a command-line replacement for PyCharm on all the places you ssh into You wish you had access to at least some of the niceties of PyCharm when editing a Continue reading VimCharm: Approximating PyCharm on vim
TL;DR: Buy a kindle already. Reading multiple books at a time is surprisingly productive. I now read while I eat. There's a list at the end comparing the amount of reading I got done before and after I switched to a Kindle I love smelling books. I also like stacking my books on a table, Continue reading Yet another kindle vs paper books post
A few years ago, very early into my programming career, I came across a story: The ceramics teacher announced on opening day that he was dividing the class into two groups. All those on the left side of the studio, he said, would be graded solely on the quantity of work they produced, all those Continue reading Programming: doing it more vs doing it better
Matchertools is my hello world project in rust, and I have been chipping away at it slowly and erratically for the past couple of months. You can now find my humble crate here. The crate exposes an API that implements the Gale-Shapley algorithm for the stable marriage problem. Read the wiki. No really, read the Continue reading Announcing matchertools 0.1.0
TL;DR: Learning to play the violin introduced me to western classical music, amateur orchestras, and deliberate practice. Even though I will never seriously pursue music, it was well worth my time. Some background I have been taking violin lessons as an adult beginner from 2016 December till now. I have stopped my lessons temporarily since Continue reading Lessons from learning to play the violin