Habits
A working list of habits that have worked for me.
Ben Bolte
A blog about robotics, AI and the future
Latest posts
All Ghost, No Shell
Aesthetic for the artificial age
Hominem Te Esse Memento
On passion and regret.
Fatherhood
Some thoughts about being a father.
Neuron Models
Interactive visualizations of various types of neuron models.
The Tension
Stream-of-thought writing about tension.
AI Market Makers
Framework for thinking about a type of startup that might succeed.
Reinforcement Learning Papers
Reading list of modern reinforcement learning papers.
K-Scale Business Plan
The business plan I wrote up for K-Scale.
The Embodied Internet
In the same way that a free and open internet laid the foundation for most of AI today, a free and open "robonet" will lay the foundation for the future of embodied AI.
On Competition
Some unstructured thoughts on what it means to be competitive.
Affine Transforms
A perpetual pain point for people working on computer vision is dealing with affine transformations. This post provides a simple example of how to reason about them.
Why K-Scale Wins
A copy of the business plan I wrote for K-Scale Labs when I was initially raising money.
Starting a Startup, Reloaded
My "Starting a Startup" post from a few months ago needed a refresh. This is a new version with my updated thoughts about what a successful startup looks like.
The Sand Mandala
A vignette about purpose.
Monotonic Attention
Idea for an implementation of monotonic attention using a probabilistic graphical model.
Retentive Networks and RWKV
A short, hand-wavy explainer for the mathematical intuition behind faster attention mechanisms.
Miscellaneous Azure Notes
Miscellaneous notes about various Azure-related things.
Miscellaneous AWS Notes
Miscellaneous notes about various AWS-related things.
Streaming Convolutions
Working out the math for streaming convolutions.
Diffusion verses Flow Matching
An accessible introduction to diffusion and flow matching models.
Fast Attention Implementations
A reference collection of fast attention implementations.
Starting a Startup
I left FAIR to start a startup a few weeks ago, and figured I should describe what we're actually doing.
RWKV Language Model Math
Math behind the RWKV model, plus a discussion of numerical stability.
Types of Electrical Connectors for Batteries
A collection of the different types of electrical connectors that might be relevant for robotics.
Types of Gears
A reference for the different types of gears that might be relevant for robotics applications.
Possible Ideas for Robotics Startups
A list of ideas for robotics startups, focusing on things that are feasible right now and things that will likely become feasible in the next few years.
Getting Started with ROS 2
An actually good guide to getting started with ROS 2.
Robotics Pre-training Idea
A collection of my ideas relating to robotics pre-training.
PID Controller Explainer
Simple overview of what a PID controller is, how it works, and how to make one yourself.
Life in the Big Apple
Miscellanous update about various life things.
Three Months of Daily Journaling
Meta-journal about journaling for more consecutive days than I initially thought I would, and whether or not it is a worthwhile habit to cultivate.
Monitoring Background GPU Usage
Python code snippit for doing background GPU monitoring using `nvidia-smi`.
What I've Been Up To Lately
Short post about what I've been up to lately.
Numpy Array Stream to Video
Short post with code snippits for creating videos from Numpy arrays in Matplotlib.
Visiting the United Kingdom
Reflections on our time in the United Kingdom during the Covid-19 pandemic.
Engagement
I got engaged to a really wonderful girl.
Useful bash / zsh Profile Additions
Some functions I found useful to add to my bash and zsh profile.
Optimized Log-Sum-Exp PyTorch Function
A walkthrough of how to optimize the log-sum-exp function in PyTorch.
Torch CUDA Extension Tricks
Some tricks I found useful for writing CUDA extensions for PyTorch.
HMMs and CRFs
A comparison of Hidden Markov Models and Conditional Random Fields, two kinds of probabilistic graphical models.
"The Decadent Society" Book Review
Summary and thoughts about The Decadent Society: How We Became the Victims of Our Own Success by Ross Douthat.
Coding the Viterbi Algorithm in Numpy
A demo of how to code the Viterbi algorithm in Numpy.
Roaming through Japan
Exploring the Land of the Rising Sun for 19 days by train, through Tokyo, Nikko, Sendai, Sapporo, Kyoto, Osaka and Nagoya.
How I Spent Spring Break in Cuba
A field guide to traveling to Cuba, written by naive college students for naive college students, mostly as exposition.
Using Gensim Word2Vec Embeddings in Keras
A short post and script regarding using Gensim Word2Vec embeddings in Keras, with example code.
Restricted Boltzmann Machines
Building on the Recurrent RBM for sequence modeling. This post relates to what I am doing for my Master's thesis.
Touring the United States and Canada
Narration from my trip through Nashville, Chicago, Toronto, Montreal, and Washington DC.
Question Answering using Keras
An in-depth introduction to using Keras for language modeling; word embedding, recurrent and convolutional neural networks, attentional RNNs, and similarity metrics for vector embeddings.
Atlanta Craft Beer Reviews
Some facts and very sarcastic opinions regarding craft beers that can be bought at the Krogers near my apartment.