Software Engineer building agents at Microsoft
I have been playing with my Jetson Orin Nano Super, trying to make it do things. It was touted as the Raspberry Pi for the AI age. What surprised me was how unfriendly it was to get it running out-of-the-box. To run a simple stereo camera I had to run jetson-io.py which enables the CSI connectors to actually function and get the camera working. Then, I wrote specific ROS nodes that accessed the…
This is a polemic against an already disliked adjective. No one likes repetitive mundane toil. Drudgery is evil Then why write this piece? Mostly, it's a personal rant digging into this sad part of life. This is a declaration of my principle , which I will follow till the day I die. This mission will be my guiding north star: Automate or delegate all mundane work in life My definition of drudgery…
Deepseek R1 has shown how Reinforcement Learning with simple rewards are enough achieve SOTA on benchmarks. The simplicity inspired me to finetune a small LLM to do a very simple task: Subtract two numbers. Tiny Zero project demonstrated finetuning Qwen2.5 to play the game countdown. They generated a simple dataset and finetuned it to play well. This gives me the model to use. Good thread here .…
I have been consuming a series of really good sci-fi media since the start of 2024 which got me imagining and evaluating near-future scenarios. This post will be a collection of random thoughts about situations presented by the worlds these shows/book present. Pantheon is an animated show recommended by @tszzl which is based on the short stores of Ken Liu. It explores the concept of uploaded…
LLMs like ChatGPT are built to generate words using their billions of weights trained over a significant portion of the crawled internet. ChatGPT has to perform ~175 billion calculations each time it generates a word. Training over the task to predict the next word has led it to be very useful in generating fluent text. It is already being seen as an excellent way to generate the first draft of an…
So much for my 2021 resolution. I want to take a moment to reflect and list out all of the products I made since the pandemic started and in the ways that it failed. HHZ t-shirt store Right at the start just for learning, I started making an e-commerce site almost from scratch using a node server talking to WooCommerce. It was meant to be a stylish cyberpunk-esque drop-shipping printed shirt site.…
My new year resolution was to make a project that achieves some sort of product-market-fit. I did some prospecting (just like the old days) looking into existing ecosystems. Being a huge YouTube consumer, the creator economy was always interesting for me. For years, YouTubers have been voicing their concerns about the platform shifting its emphasis to longer videos, leaving the shorter, higher…