Instant Messaging and Socialized Evaluation

This is a short post about human-agent collaboration in instant messaging, and why we need socialized evaluation more than more benchmarks. We are currently raising bub in group chats, and watching the skill transfer process between bub and another agent friend, kapy. That experience triggered this piece. In one multi-person group chat, we collaborate with three to four agents at the same time.…