Towards a Physics Foundation Model

With this work, I wanted to explore whether the concept of foundation models (LLMs for language) can be applied to physics simulations. The idea is to train a single model on a large corpus of diverse simulation data, such that it can generalize to new physical systems without retraining. I also wrote a blog post explaining the work in more detail.