Training AI to be better at correctness than persuasion

I continue to believe we should pause frontier AI development. Any discussion of alternative strategies should be thought of as planning for contingencies. “Super-persuasive” AI is dangerous because a misaligned ASI could persuade humans to help it take over. But setting that aside, even if we manage to make ASI friendly, it may provide super-persuasive but mistaken guidance that permanently sets…