Literally Nobody Understands AI. That’s bad.

AIs have weird failure modes that we don't understand yet. That's likely because the industry has not been rigorously studying them yet. We need to recognize the reality of where we are so we can minimize risk of disasters.