World Models and Consistent Mistakes in LLMs

LLMs make consistent mistakes when given prompts that are rephrased or in another language. However, when given a substantially different prompt that relies on the same information, LLMs often give inconsistent answers.