RSS Amplifier

Blog

killerstorm’s blog

wat

/RSS feed ↗5 posts

Latest posts

A connection between capability-based security and lambda calculus

Motivation

METR’s time-horizon of software engineering tasks does not mean what you think it means

Consider: METR: Measuring AI Ability to Complete Long Tasks

The future of LLMs: cognitive core + cartridges?

Andrej Karpathy introduced a concept of a “cognitive core”:

Experiments with automated ML experiments

How far is AI from being able to improve itself?

Can LLMs actually represent meaning? / Getting over the impenetrable wall

A discussion of AI and LLM often hits an impenetrable wall: “But it’s just a statistical model, and thus it cannot really …”. The variations of the “stochastic parrot” arguments assert that being trained on a language, LLM can capture only the surface aspects of the language (e.g. that word X often follows a sequence (W1, W2, W3)), but not the underlying meaning.