Large Language Mind-Reading

AKA, can LLMs predict their own thoughts and actions?