Floor plan area micro-eval

I made an LLM agent micro-eval where I asked the agent to compute the square footage of an apartment given a floor plan of the apartment. This involved two steps: determining the scale of the floor plan by looking at room dimension labels (e.g. 20’ x 12’), and marking the parts of the floor plan that count as square footage (interior areas and exterior walls, but not exterior areas like…