80 prompts, zero evals: fixing an LLM pipeline after launch

A client shipped an 80-prompt LLM pipeline with no evals, no audit trail, and no dashboards. By month five, operators were throwing away 80% of the output. Here's how I helped the team fix it — dashboards, deterministic safeguards, prompt isolation — while operators were still using the system.