The Loop Problem

This is Part 3 of a series. For the axiomatic foundation, see Part 1: Three Types and a Funeral . For the VOI-gated text adventure agent, see Part 2: Teaching Zork to a Bayesian . Every reinforcement learning agent that has ever played a text adventure has, at some point, tried to take the lantern fifty times in a row. Not because it&rsquo;s stupid. Because its state representation makes…