Hamilton-Jacobi-Bellman Equation: Reinforcement Learning and Diffusion Models

Why the HJB is Bellman's equation in continuous time, why continuous time matters, and how to solve the resulting control problem with neural policy iteration.