The Cognitive Advantages of Being of Two Minds, or Twelve, or Twelve Hundred

I was of three minds, Like a tree In which there are three blackbirds. [from Wallace Stevens, Thirteen Ways of Looking at a Blackbird ] The literature on superintelligence and AI alignment tends to assume that an intelligent AI will have one set of values, one reward function, and consistent, determinate preferences. But speaking for myself, I'm not as consistent as that. You aren't either, I…