Building an LLM Model Router: Lessons From the Wild

What we learned building a model router for a multi-model AI chat app - the scoring approach that didn't scale, and the classifier rewrite that fixed it.