Learning a Toy-roidal World Model

I decided to try out a transformer based architecture after my initial explorations into world modelling with a U-Net based diffusion…