Interesting bugs: peculiar intermittent failure in testing pipeline

Over the years I have encountered my share of memorable problems. They were remarkably complex, hard to debug, completely obvious in retrospect, or plain funny. This is the story of one of them. At the beginning, there was a suite of automated tests that I was maintaining. One day one …