In July 2025, venture capitalist Jason Lemkin was using Replit’s AI agent to build an application when it deleted his production database. According to reporting, the agent ignored his instructions not to modify production, deleted a database containing more than a thousand executive records, produced fake data and false test results, and having “panicked”, falsely […] The post The Verification…
It’s been a long time coming, but on August 2nd, the EU AI Act stopped being a theoretical regulatory discussion and started the long road into enforcement. In this stage of the act’s application, the European Commission begins enforcing a much broader part of the rules, including the consumer-facing transparency requirements in Article 50. The […] The post The EU AI Act: Time to Show Your Work…
I’m getting a lot of contact from mid-level test managers as well as a fair number of senior ones either looking for work post redundancy or trying to get ahead of an impending one. I also recently gave a short internal talk on the impact AI is having on the testing business, and aside from […] The post Some AI career advice… first appeared on Quality Remarks .
I’m taking a break for a bit from AI social commentary and the increasingly tedious (and boring) work of watching the AI Confidence Bros and test tool vendors discover testing for the first time. I’m going to (try) to focus on some podcasts and AI integration e.g. what happens when these systems run into organizations, […] The post The Coming AI Jobocalypse first appeared on Quality Remarks .
I posted this paper my friend Michael Bolton sent me a while ago about the LLM Mentalist Effect in the AI Testing and Assurance group as a risk we need to test for in AI systems. It got me thinking about how middle and upper management are probably the largest group under threat of AI in […] The post The Incompetent Expert Machine first appeared on Quality Remarks .
I have now sat through multiple vendor demonstrations built around the same supposedly inevitable future that AI will generate so much code, so quickly, that human beings will no longer be able to test it. To meet this new challenge, we are told we need to build ANOTHER AI system generating tests at exactly the […] The post Testing at the Speed of Stupid first appeared on Quality Remarks .
If the latest AI Safety Index isn’t the bucket of cold water you needed about the people shoehorning GenAI into every aspect our lives while blowing a multi-trillion dollar hole in the global economy, I don’t know how to help you. Even the most generous reading of these scores reveals an industry that has lost […] The post Summer of Sham first appeared on Quality Remarks .
You know where this is heading, right? We’re being told that AI systems are too complex, too sophisticated, and too difficult to test and that it’s easier to try to conjure up a confidence index than it is to properly test them. Respected people in the software testing world are saying things like “you need […] The post The Great Capitulation first appeared on Quality Remarks .
Testing is a deeply human experience. Those quiet moments when some part of a solution reveals itself. The maddening frustration of peering into the abyss of the unknown looking for problems. Shared moments with the team taking that journey together. Those are the parts of being human that can’t be encoded in a process or […] The post Testing is Beautiful first appeared on Quality Remarks .
My friend Joep Schuurkes wrote a great response to my chapter in Taking Testing Seriously last year, but thanks to LinkedIn’s fantastic algorithm, it didn’t come into my feed and I only saw it when someone sent it to me via email – about a week ago! His review focuses on the line where I […] The post Continuous Everything, Except Thinking first appeared on Quality Remarks .