Minesweeper bench
Minesweeper seems to make all LLMs go through hell. They fail consistently through it. I think this is because its out of their training data.
snats
Get ocassional cool stuff in this RSS feed.
Latest posts
Lobotomizing some models
Using metaheuristics to prune layers from AI while mainting model performance.
I want to break some laws too
I made an automated pipeline to clean data. The idea started from a paper called Minipile. This led me to a rabbit hole. If you’re careful about the data you use for training, you can break the scaling laws. Who knew being a data snob could be so rewarding?
Classifying all of the pdfs on the internet
Classifying all of SafeDocs through the metadata.
Boom box!
Boom box a tool for drawing bounding boxes.
Shallow Theory
Only 1% of all the actual posters on the internet are good at publishing and promoting.
Differential Evolution + CLIP = Image Generation
Generate images with just a CLIP model and no training*.
From Bigram to Infinigram
I have been considering a lot more how n-grams are amazing tools to show some of the fundamentals of language models.
Enhancing Lecture Notes with AI
I have been trying a new workflow for my lecture notes in university.
Making: Check CPU (CCPU)
Learning Rust by making a small TUI to check my CPU usage.
You (Might) Only Need a Microcontroller (and a Server) for Computer Science
Using telnet from a Microcontroller to connect to a computer.
Created contextito
I recently played the online game called contexto.me. I was intrigued by how it worked so I created a tiny clone.
Feature Selection using Genetic Algorithms
I implemented Feature Selection through Genetic Algorithms.
Chico, a spanish dataset
I wanted to create a dataset that was focused on spanish.
Created m2h
I created a simple markdown to html parser called m2h. I wanted to implement the basic markdown syntax, I implemented it over a weekend.
Finish things
Go and experiment. Create and finish projects. This way, you can experiment, but get new knowledge for new areas.
Understanding my country from outside
My thesis was that people outside of my country can be more objective of what happens inside. They are a third party. They should be able to tell fact from fiction.
Efficiency Engineering
... There is another type of engineer that could exist. A master at making things more efficient.