RL Bite: Computing the Value Function

Abstract Link to heading In the last RL-Bite I wrote about Bellman&rsquo;s Equations and the Value Function and now we will figure out how we actually apply these equations to compute the Value Function! Known World Model Link to heading Let&rsquo;s start with the simple case, and make an assumption that the underlying World Model of the Markov Decision Process is known, and we have finite…