It's always DNS (LLM edition)

Our Kubernetes cluster's DNS recently experienced partial degradation. We noticed it via DNS resolution errors in Sentry mostly when calling internal services. This incident took a bit to root cause - not that it was particularly thorny in retrospect, per se, but it involved diving into the guts of things one doesn't normally care much about. While this isn't the only interesting incident that…