A Skill Is Just an Agent. So Measure Your Changes.

TL;DR: A skill is just an agent, a prompt running in a harness, so you can test a change to it exactly the way you test any other agent. This post walks through how we do that for the arize-instrumentation skill: a golden dataset of real apps to instrument, a sandboxed experiment that stops the agent cheating its way to a good score, and trace-level evaluators that grade each run. By the end…