Notes on phenomenal consciousness in simulators and simulacra

When people ask me whether I think LLMs are phenomenally conscious I often prefer to start by answering a different question: "if they were phenomenally conscious, should we expect them to be phenomenally conscious in a way we could reliably conclude from our interactions with them?". I think that, if we are talking about the underlying neural networks, the answer to this second question is no.…