From PR Review Bot + ATAI CLI to an Autonomous Work Queue
Taking our CLI, a Kubernetes Cluster and an Orchestrator to build an autonomous AI developer agent.
karlstoney.com
A personal blog, from a techie, platform engineer, tinkerer, coder. Playing with Kubernetes, Istio, Grafana, Prometheus and so on. Generally breaking things and sharing the fixes here.
Latest posts
Building ATAI: Our Opinionated CLI for Copilot at Scale
How we wrapped Copilot, to accelerate the use of AI engineering tools at Autotrader
Building a PR Review Agent
Building a PR review agent using Gemini CLI on Kubernetes
Building an AI Gateway
Building an AI Gateway to centralise common LLM use case cross functional requirements, to accelerate LLM product development.
Moving to Native Sidecars
Upgrading all our sidecar containers to Kubernetes Native Sidecars, including cloudsql-proxy and istio-proxy.
Retry Policies in Istio
The default retry configuration on Istio is not safe, and can retry requests you may not want retrying!
Upgrading to Istio 1.21.x
Upgrading Istio from 1.20 to 1.21. Issues with JWT auth in dynamicMetadata and AuthorizationPolicies.
Compress your Mesh
How to transparently compress response traffic between your microservices, consistently, using EnvoyFilters in Istio
Incident Summaries using LLMs
How to use llama-2 7b to generate summaries of your incidents, using Cloudflare workers and Workers AI. Including Pirate mode.
Alert and Incident Enrichment
Evolution of Alerting and Incident Management: Navigating Chaos in a Remote Work Era. From Desk Huddles to Digital Collaboration and how we adapted.
To Auto Scale or not to Auto Scale, that is the question
The challenges of Auto Scaling, from cold start impact, tech debt, and cost realities. Prioritising scaling as code and shared responsibility for optimal performance in cloud efficiency.
Scaling the Sidecar
Scaling Istio Sidecars, and how we consider the relationship of Sidecar resources tightly coupled to the application.
Speeding up Jaeger on Elasticsearch
How to improve the performance of Jaeger when using Elasticsearch as the storage backend.
Anomaly Alerting in Prometheus
Exploring how to do anomaly alerting on seasonal data in Prometheus.
Enabling GZIP Response Compression with EnvoyFilter
How to enable GZIP compression of responses using EnvoyFilter