Machine Learning Consulting
Evals — turning AI from vibes into an engineering practice Last week Google released Gemini 3.5 Flash. They published a benchmark table comparing it to Claude Opus 4.7 and GPT-5.5. Here are the results on a couple of benchmarks: Benchmark Gemini 3.5 Flash Claude Opus 4.7 GPT-5.5 SWE-Bench Pro (agentic coding) 55.1% 64.3% 58.6% Terminal-bench 2.1 (agentic terminal coding) 76.2% 66.1% 78.2% MCP…
Don't give the AI your credit card Uber burned their entire 2026 AI budget. In Q1. Their CTO went on record saying they're "back to the drawing board" after a surge in Claude Code usage blew past every internal projection. Engineers were spending between $500 and $2,000 per person, per month. They gave thousands of engineers near-unlimited access to a powerful AI coding agent and watched a full…
The boring enterprise questions that actually matter Vendor lock-in, legal review, and when local models actually make sense. The boring enterprise questions that actually matter Last issue I broke down the four things enterprises should evaluate when choosing AI coding tools: the model, the harness, the infrastructure, and the payment model — subscription, token-based, or per-request. That last…
Choosing AI Coding Tools Without Regretting It Six Months Later The AI coding space is moving at an uncomfortable pace. Even as an AI consultant who tracks this full time, I can’t keep up with every tool that launches. Today’s best model is from Anthropic. Next week it might be OpenAI. The week after, Google surprises everyone. This makes buying decisions genuinely hard for enterprises — you’re…
How I Write Software with LLMs Over the last year, I’ve written more than 100,000 lines of code using AI. I’ve landed on a workflow I’m genuinely happy with — both in how it feels to use and in the quality of the resulting code. Most people I see either: give a vague prompt, get a disappointing result, and give up or go the other direction and build complex orchestration pipelines with a dozen…
The AI coding space is moving at an uncomfortable pace. Even as an AI consultant who tracks this full time, I can't keep up with every tool that launches. Today's best model is from Anthropic. Next week it might be OpenAI. The week after, Google surprises everyone. This is a challenge for large companies, because they are used to more stability. But here are some things they have too look at when…
How I Write Software with LLMs Over the last year I've written more than 100,000 lines of code using AI. I've landed on a workflow I'm genuinely happy with — both in how it feels to use and in the quality of the resulting code. Most people I see either give a vague prompt, get a disappointing result, and give up — or go the other direction and build complex orchestration pipelines with a dozen…
What will the future software engineer do?Writing code always took a surprisingly small amount of time of a software engineer. Maybe as a junior you'd spent a majority of your time writing code, but for senior people, it was maybe 30% of the time actually typing into an editor. The rest of the time would be spent doing architecture work, code reviews, mentoring and some testing.Maybe this mismatch…
GitHub Copilot vs Cursor vs... GitHub Copilot was the first tool to use AI to help with coding, back in the smart autocomplete era. It took me a while to start using it — how can a machine write code better than me? But after a friend strongly recommended it, I fell in love with it. Then other competitors started appearing. They kept adding new features to Copilot, but spread themselves too thin —…
A while go someone asked me some questions about Qdrant and how to optimize it’s usage for use case that they were having separate document sets for each “client”. When doing searches, they wanted to search only the documents belonging to the client doing the search. One of the things that we discussed was whether … Continue reading "Optimizing performance in Qdrant" The post Optimizing…