Using local ClickHouse for data processing

I did a lot of data engineering work in my career. When you work a lot with data, you often get quick requests to extract some cold data and process it. Since the data is cold, it usually resides on S3. For example, one of the typical requests in the past was to count unique values from an old MongoDB backup or CSV dump with 100GB of compressed data. I quickly learned that using throwaway Python…