
Evaluating AI capabilities
Evals tell us what AI can do, but shouldn't be taken at face value
Humanity has a coordination problem. Torchbearer Community has a plan for that.
Live Last read · last published · next check

Evals tell us what AI can do, but shouldn't be taken at face value

This season flew by but there's still time to get familiar with key concepts and writings from influential people in the AI safety and policy space.

Politicians, CEOs, and leading researchers have called for international coordination on AI, but what are the mechanisms that lead to meaningful changes that last?

How AI is rewriting privacy, security, and encryption and what organizations can start doing today to prepare.

In this post we’re focusing on one of the progress of Samuel Buteau, an AI safety scientist based in Canada. He is a founding member of Torchbearer Community (TBC) and currently supports ControlAI.

Member story from Kathleen about how it feels at times being one of the few people in her friend/family group paying attention to the implications of achieving AGI.

Walls that keep us relatively safe have been breached + steps to patch and reinforce them

The hidden civilizational invariants we rely on are not guaranteed, especially in the age of AI.

How unknown capabilities in AI models may undermine most AI safety frameworks.

Unfortunately, there's a precedent, and the technology is quickly making this scenario alarmingly plausible.