Adrian Caruana's Blog

Adrian Caruana's Blog

adriancaruana.com ↗RSS feed ↗13 posts

Latest posts

Subtracting Yourself from Attention

Apr 21, 2026

When a Lookup Table Beats a Neural Network

Apr 16, 2026

Giving Transformers Multiple Residual Streams

Apr 7, 2026

Shrinking the KV Cache by 10× with Polar Coordinates

Apr 1, 2026

It Works On My Machine

Nov 30, 2022

How I Run Experiments for My PhD from Anywhere

Oct 2, 2022

Cursed (lambda) For Loops

Aug 9, 2022

mustalgia.me

Jan 7, 2022

Pythagorean Triads, with Lambda Calculus, in Python

Aug 29, 2021

The Case for DIY Software

Jan 10, 2021

Is Music Getting Better or Worse Over Time?

Sep 2, 2020

How Does a Mountain Know When It's Peaked?

Aug 2, 2020

A Scarcity Mentality - Thinking like the Silicon

Sep 29, 2019