Will LLM alignment scale to general AI alignment?

Some reasons to be skeptical, and some reasons to be optimistic. Anthropic has released some new research about reward hacking in language models , showing that taking steps to reduce reward hacking also reduces of other "misaligned" behavior (e.g. deception, sabotage). As with other promising LLM alignment results, this has prompted some speculation about what the results means for AI alignment…