Fluent Bit workers stuck on malformed records
Records missing the routing field poisoned the S3 output.
Posts on bx2@blog
Recent content in Posts on bx2@blog
Latest posts
Building a session logger for Claude Code
A skill that extracts learnings from coding sessions into your journal. Breadcrumbs for pattern recognition, not documentation.
More fun with named collections in Clickhouse
This post builds upon another post of mine about named collections - check references for deets.
I Kept Explaining What the Code Does Instead of What It Should Do
My personal framework for debugging and issue investigation. Created on the 23rd of December 2025 after being frustrated with the customer issue I was solving last night. Feel free to adapt to your individual needs!
Debugging OpenResty under high load
Tracing 100% CPU to exhausted ephemeral ports from Redis connections.
Re-trigger S3 events to SQS without re-uploading files
Re-trigger S3 events without re-uploading using --metadata-directive REPLACE.
Clickhouse's hidden built-in dashboards
Clickhouse ships with hidden web tools on port 8123. No installation needed.
Diagnosing high parts count in Clickhouse
How to diagnose high parts count warnings and identify ingestion pipeline problems.
Investigating Linux server hangs after reboot
Checklist for investigating unexpected server reboots.
Clickhouse diagnostic queries cheatsheet
A collection of diagnostic and monitoring queries I use regularly. Bookmark this.
Clickhouse timezone gotchas in reporting queries
A timezone bug where filtering works but display shows UTC data.
Local OpenResty development with Docker
Local OpenResty development with Docker for testing Lua code.
Period-over-period comparisons in Clickhouse with gap filling
Using WITH FILL to generate complete date ranges for period-over-period comparisons.
Understanding AdTech metrics through supply and demand
A mental model for programmatic advertising metrics: think supply (publishers/SSPs) and demand (advertisers/DSPs).
Route53 zone export to BIND
Export Route53 zones to BIND format with aws cli and jq.
Linux SSD health check
Using smartmontools to check SSD health via SMART.
List processes in a Clickhouse cluster
List running queries across all nodes in a Clickhouse cluster using clusterAllReplicas.
Clickhouse read-only mode
Why readonly=1 prevents changing query settings and how readonly=2 solves it.
Linux hardware identifiers
Commands for gathering hardware details: manufacturer, model, serial numbers.
Profiling in Golang
Getting started with Go's built-in pprof profiling tools.
Lightweight delete in Clickhouse
Explaining lightweight deletes: marks rows as deleted without immediate physical removal.
SSL certificates for local development
Using mkcert to create locally-trusted SSL certificates.
Check database size in Clickhouse
A query to get table sizes, row counts, and active parts.
Named collections in Clickhouse
Store and reuse credentials for remote Clickhouse connections.
Moving processes to another PTY
Using reptyr to move running processes to a new terminal or tmux.
Configure Wasabi with S3 CLI
Configuring AWS CLI to work with Wasabi storage.
Check what runs on a port (linux & macos)
Using lsof to check what process runs on a specific port.
Copy ssh key to a remote server
Using ssh-copy-id to install your public key on remote servers.