What Happens When You SFT a Human on an LLM

We have spent the last few years training LLMs on human conversation data with the explicit goal of making them sound like us, but we have also been training ourselves on them in return. I have spent a lot of hours talking to claude over the past couple of months, my juniors grew up doing their assignments with gpt, and there are kids in undergrad right now whose first real intellectual sparring…