When the Numbers Lie: Statistical Modeling in Ad Tech

A new ad design 'won' overall — until we broke it down by segment. Two groups actually converted better on the old design. Aggregate metrics hide where your model actually fails.