RSSAmplifier

Blog

The Horenberger Zone

Cite me in your thesis

horenbergerb.github.ioRSS feed ↗10 posts

Latest posts

Timescales in the Brain and Hierarchical Reasoning Models

Hierarchical reasoning models: Very cool What is Autocorrelation? How does autocorrelation relate to neuroscience? Observable timescales in the brain Deep dive on autocorrelations of neuron spike counts Anything else? Conclusion and what’s next Hierarchical reasoning models: Very cool Recently there has been discussion about a new ML architecture, hierarchical reasoning models. Although it’s too…

More interesting links

On Sid Meyers’s Alpha Centuri Estrogen: A Trip Report I love phenomenological reports like this. It’s always a good reminder that there’s a lot of nuance to human experience that can be qualified by just being more attentive. I need to be more mindful of this; it’s a nice hobby that can be practiced anywhere, any time. I can almost envision everything on our street coming apart piece by piece like…

Paper Review: How much do language models memorize?

Intro Setup Memory definitions Toy Example Prior, dataset, and model Preliminary entropy calculations Total entropy $H(X)$ Conditional entropy $H(X\vert\Theta)$ Memory calculations Mutual Information (Total Memorization) Unintended Memorization (Rote) Intended Memorization (Generalization) Discussion $\text{mem}_I > \text{mem}_U$: what it doesn’t mean Last look at the memory math The rest of the…

Nobody reads my blog

Where are the modular forms enthusiasts? How many people are thinking about modular forms? How many modular forms enthusiasts have a web presence? The math shows that I am alone Comparison with my website’s analytics Academia is hogging all the writers What am I supposed to do? Enough rambling. Wrap it up. Where are the modular forms enthusiasts? When I was doing my undergrad, I studied modular…

Astral Fugue: A space adventure RPG

What is this? Astral Fugue is a game about traveling the stars on a research mission. You and your ragtag team are in search of scientific anomalies so that you can further the knowledge of all humankind. It’s also kind of your last chance to prove yourself as a captain. The game revolves around traveling to different star systems and coming up with research missions regarding the planetary…

Workshopping Astral Fugue

I’ve been thinking about making something kind of like Caravan but in space. This is my first sketch of some basic concepts. I really like the aesthetic. Try clicking on some of the colored stars. TODO: Fix drag to pan on mobile

(Beta Test) An explorable LLM-generated world

Map of Aldreon How to use it About this demo Map of Aldreon THIS IS JUST A BETA TEST. How to use it Explore the world by traveling to different destinations and reading the lore. Click on nodes to travel to them. This will show you a summary of the location. You can expand the summary for a detailed description. New nodes become visible once you visit one of their neigbhors. Zooming out will let…

Differential Geometry Visualization Test

Funky plot Funky plot This was just an experiment to see if I could render 3D surfaces and do things on them. Here you’ll see $\sin{\sqrt{x^2+y^2}}$ plotted in 3D, which is cool. You can click and drag to rotate it. Additionally, anywhere you click, it will trigger a “march” along the surface moving parallel to a particular axis. The length of the march along the surface is fixed. I originally…

Structured world generation with LLMs

Introduction: LLMs for creative tasks Why is this even hard? World Generation with LLMs An interactive world graph for a fantasy world How do you generate it? The prompt Sampling (this is the secret sauce) Other implementation notes Shortcomings What can you do with this? Conclusion More world generation examples A cyberpunk city A prison for people with superpowers Introduction: LLMs for creative…

Visualizing Phase Fluid and Liouville’s Theorem

Introduction Harmonic oscillator phase diagram Estimating area of a region in phase space Conclusion Todos Introduction I’ve been trying to make sense of symplectic geometry again. I know that it originates from classical mechanics, particularly Hamiltonians, but I’m not totally clear how. I came across a very interesting Reddit post that made the following remark: if we imagine many nearby points…