Variational Inference in POMDPs

The goal of this post is to explore from first principles the learning of belief models in partially observable MDPs. We will start with a quick refresher on variational inference, and apply it to state estimation in POMDPs. Specifically, we will derive the update rule used to train Dreamer-like models. Variational Inference In this post, we are interested in latent variable models. We consider…