Why LLMs Can't Shut Up

Speculating, hypothecating, contemplating the mechanisms that make it impossible for GPT to stay silent, even when explicitly told to shut up.