Spot check random samples of your data

It&rsquo;s hard to get around the need to manually inspect real inputs and outputs when working on a data pipeline. Unit tests with well-formed synthetic rows won&rsquo;t save you if the actual source data look like this: | ticket_id | category | source | ... |-----------+-------------+----------+---- | 32 | bug | customer | ... | 1 | BUG | customer | | 47 | feature | internal | | 16 | feat.