Changing the language of an LLM response with a vector addition

It’s surprisingly easy and entertaining to isolate and then apply additive steering vectors for LLMs. Let’s say we wanted to modify a model’s parameters such that, without changing anything about the prompt, it elicits certain desired behaviors. In this post, we’ll explain how to isolate such a steering vector for responding in German rather than in English, and evaluate how well such a vector is…