How catastrophic is your LLM?

A new framework provides a statistical method for estimating the likelihood of catastrophic failures in large language models in adversarial conversations.