RSSAmplifier

Blog

Alex Becker's Blog

Blog posts by Alex Becker

alexcbecker.netRSS feed ↗34 posts

Latest posts

Inventing Transformers

A branching tech tree of the Transformer: the path of innovations from 2012 to 2017 - AlexNet, Word2vec, Attention, ResNet and more - drawn as glowing nodes on a skill-tree diagram, each one unlocking the next on the way to the architecture behind modern AI.

The Myth of Deterministic Software

How I've come to terms with LLM non-determinism in software and abandoned the comforting lies we've been telling ourselves about traditional software.

More Thoughts on Falling Surplus

The feeling of poverty amidst wealth stems from less opportunity to realize surplus. Bespoke goods are bid up, and market opportunities narrow for consumers & producers.

Rationalism's Lamprey

How Steve Sailer wormed his way into Silicon Valley's hivemind through Slate Star Codex.

How Claude Changes My Code

Claude writes all my code now, but the bigger shift is in *what* code I produce.

What's Next for Prompt Injection

Prompt injection requires training LLMs with robust 'untrusted content' primitives, viewing it as a solvable cybersecurity problem distinct from jailbreaking.

Don't Compensate with Equity

It is in startups' interest to pay employees cash and save their equity to sell to VCs.

Boldness Alone is no Virtue

Silicon Valley backs Trump for 'bold action,' because America's problems require it. But why aren't his bold actions aimed at addressing those problems?

Why Everyone Feels Poor

Why do rich Americans feel poor? Is inflation understated, or are feelings driven by relative wealth, materialism, the rise of unattainable luxury goods, and a crisis of meaning?

Benchmarking Prompt Injections in Agents

I built a new prompt injection benchmark for AI agents because the existing ones are not great.

USENIX Security '25 Round-up

USENIX Security '25 roundup on LLM security topics: prompt injection, data leaks, CAPTCHA bypasses, and model misbehavior.

Searle's Sleight-of-Hand

The Chinese Room argument is flawed because it ignores the practical speed and scale of computation, misguiding our intuition about AI intelligence.

The Hard Problem of Prompt Injection

Prompt injection, where untrusted input overrides LLM system instructions, is a hard problem with no reliable defenses yet.

Nobody Knows Anything About These Models

LLMs display 'generalized intelligence,' yet research lacks a theoretical explanation for their capabilities, how they work, or their inherent limitations, and there is no clear path to fixing this.

Understanding Transformers

Writing stuff down about the Transformer architecture and training methods to solidify my own understanding.

AI and the Future Economy

AI's economic future is debated. I explore 5 scenarios based on differing AI cognitive & robotic progress assumptions.

Democrats Lost, What's Next?

Democrats lost due to inflation & immigration. To win again, they need stronger central leadership, to shed toxic stances, and to prioritize pragmatic solutions on key issues.

Israel/Palestine

Israel holds nearly all power in the conflict. A two-state solution is the most realistic and moral path, primarily requiring Israeli action despite limited external influence.

Satoshi's Mistake

Satoshi's Bitcoin, intended for freedom, has failed to realize Finney's ambitions and instead empowered global crime, scams, and human trafficking.

AI and the Future of Work

AI will transform work, replacing some jobs & enhancing others, but its crucial impact lies in the 'signaling problem,' where AI-generated content devalues human competence.

A Machine for Burning Cities

'Nuclear' bombs aren't all equal. Fusion weapons are exponentially more destructive than fission bombs—a vital distinction missed in public understanding of global threats.

Basic Data Science — Projecting User Growth

How to project SaaS user growth? This post shows why simple median/mean models of monthly user *change* are often best.

In Blockchain We Trust

Blockchains promise 'trustless' transactions, but they actually require new forms of trust in value and network security, making them vulnerable to major attacks.

Electronic Health Records Considered Harmful

Electronic Health Records (EHRs) harm patient care & raise costs due to bad design, lack of interoperability, and government mandates.

A Front-End Debugging Adventure

Debugging a front-end Firefox bug: A double-click race condition caused `mousedown` to overwrite an element's reference before `mouseup` could remove it.

What Mathematics has Lost

Mathematicians often fail to share the human intuitions behind their work, leading to a profound loss of understanding, exemplified by Mirzakhani's death.

Please Lie

Fight back against pervasive surveillance & exploitative algorithms: lie about your data to disrupt models that stereotype, entrench poverty, and reinforce corporate power.

The Cult of Averages

We often think in terms of the mean even when this is ill-defined. Medians are usually better, but there is no substitute for looking at the full distribution.

Lessons from Milo

Violent protests against Milo Yiannopoulos ironically did his work for him.

Against AI Risk

Grey goo scenarios obscure the more imminent and likely risks: military AI, inequality-fueling tech, and other powerful tools society already struggles to control.

You Are Probably Misusing Opacity

Designers often misuse opacity for text, leading to unreadable stacking effects and CSS bugs like new stacking contexts. Use fixed colors instead!

Analyzing the Effects of Voting

An individual vote has never tipped an important election, so why vote?

Towards Universal HTTPS Adoption

Why is HTTPS adoption so slow? Strict browser mixed-content policies. A 'No-Security-Claim' header could simplify partial security & boost web encryption.

Django is Dangerous

This post argues Django is dangerous due to fundamental flaws in data integrity and dynamic templating that worsen as projects scale.