Why Role Labels Matter More Than You Think and Why ChatML's assistant role is kinda bad

FYI, Writing at night and I haven't gotten this reviewed by friends So it's been a while since I've thought about chat formats. It's not really the biggest thing I think about when training LLMs, but as I've had to deal with more and more weird-ass chat templates, I've given a bit of thought to what someone in my circle said: "ChatML having assistant role tags can introduce biases when training…