Pitfalls using Buffer Tables in ClickHouse Cloud

Asynchronous inserts and buffer tables ClickHouse is known for being able to handle large amounts of data that are inserted in near real time. However, each insertion creates at least one new data part, which leads to frequent writes and requires a lot of background merges. Therefore, larger batches of at least 1000 rows are recommended . But what if you cannot or don’t want to batch up data in…