RSS Amplifier

The AI Cookbook with Malcolm Werchota · Oct 10, 2025

The Austrian AI Security Disaster That Nobody Saw Coming (Part 1 of 3)

0
Sign in to vote or save

Malcolm Werchota · The AI Cookbook with Malcolm Werchota

This is the story of how an Austrian AI company promising “local and secure” data processing became one of the biggest security disasters in recent AI history. Over the next three days, I’ll walk you through how a simple demo account exposed the confidential data of banks, government agencies, tax advisors, and prosecutors—and how one curious IT consultant accidentally became a whistleblower. Massive credit to Günter Born from BornCity for the incredible technical reporting on this. Today: how it all began.

The Perfect Setup

It’s September 2025. Marcus Reinhardt is sitting in his tax advisory office in Vienna, in the 7th district, staring at his screen. Obviously, he is a tax advisor since 20 years.

He has millions of revenue flowing through his systems every single quarter. Now, what is he doing? He is reading Microsoft’s terms of service for Copilot, for the 4th or the 5th time. And his partner walks in and says, Marcus, Hamas (come on), which means Marcus, are we ready? And Marcus puts his foot down and says, I’m not sending our data to the US.

Look, in this moment, let’s understand something. Marcus is not paranoid. He is not a conspiracy theorist.

He is just one of these so-called Datenschutz-Dinosaurier (data protection dinosaurs) that we always talk about. What is he actually doing? Actually, he is doing exactly what every single compliance consultant tells him to do. Look, we need an AI, his partner says.

The Steuerberater (tax advisor) down the road is already using it for client summaries. But we need it for more. Now, Marcus says, I know.

There must be a European solution. Something local. Something GDPR-compliant.

Something that doesn’t send Frau Huber’s Einkommensteuererklärung (income tax return) through a data centre in Virginia. It must be here in Austria. They start typing in the internet, Austria AI providers, on-premise GDPR.

And the first result that pops up, LocalMind, GmbH. Oh, that’s interesting, he says. It’s in Innsbruck, Austria, his partner says.

The Perfect Pitch

And what do they read? Your AI, trained on your data, hosted on German and Austrian servers. My god, every single word sounds like music to his ears. He hears 100% GDPR compliance.

He hears full data sovereignty and local and secure. He clicks himself through the website and there is even a blog post from their sister company, Morgan Digital. The dark side of AI and how to avoid data protection risks.

Marcus laughs. These guys get it. He calls a number.

And obviously somebody answers with an Austrian accent. What do they say? Well, look here. In 4 Wochen Hamas (in 4 weeks, come on).

So in 4 weeks we will implement this for you. It’s going to be hosted here in Austria and your data will not leave the European soil. Marcus sleeps well.

But in this moment he has no idea that every single client file that he has uploaded is already sitting on the server that any random person on the internet can access with a demo account. And today’s story is no hacking required. No sophisticated attack.

Enter Thomas

Just somewhere in Germany, a curious IT professional is about to become a detective. His name doesn’t really matter. Imagine we call him Thomas.

Thomas is always the good guy. In my friends of Circles, all the Thomases I know are just really good guys. Imagine Thomas is running a small IT consulting company in Bavaria.

He has 10-12 employees and he specialises on helping the Mittelstand, so these SMEs, to evaluate new software. And just a week ago he gets a call from an Austrian customer saying, ja, what do you think about this Austrian AI platform, ja, LocalMind. Now Thomas does what a good consultant does.

He says, I’m not quite sure. Let me find out and I’ll get back to you. In the evening he switches on his light.

Typical coder, they start working at 11 at night when it’s quiet, so he goes on their website, he clicks try demo and he registers with his work email. Now what’s already interesting to him is, you don’t need any email verification, there is no approval process and he gets instant access. Fantastic.

He logs in, looks slick, nice interface, clean design and up there he sees a button. Admin panel. Well, this is interesting.

I thought I’m in a demo account. Why is there an admin panel? OK, he clicks on the button and he sees the entire user list of the company, LocalMind. Hundreds of organisations, Stadt Kiel, it’s a German city administration, Berliner Volksbank, a bank, no, let’s continue, Staatsanwaltschaft, a German public prosecutor’s office, and even an insurance company.

The Moment of Realization

He understands in this moment, these aren’t demo accounts, these are real customer accounts. Now Thomas thinks, OK, there must be a mistake. He sits in his chair and he says, this is probably a sandbox environment.

Sandbox environment is, it’s not real data, it’s play data, often that developers use to be able to work on the product safely. So he just clicks on one of the accounts and he says, OK, let me look at this German city administration AI workspace. He sees the entire chat history, their files and their documents.

OK, Thomas thinks, I am hallucinating. So he closes an entire browser and he opens it again, still there, still admin access. And now he switches on his hacker brain.

He’s not a hacker, but a hacker is somebody who understands what needs to be done. So what does he do in this moment? Because maybe it’s a mistake. He starts documenting everything, screenshots, notes, timestamps.

Then he starts exploring. He does not want to damage anything. He just wants to understand how bad is this really? And what he finds out over the next 48 hours will keep the entire AI community awake for the next months to come.

Tomorrow: Thomas discovers the full extent of the disaster - and it’s worse than anyone imagined.

No posts

Read the original on malcolmwerchota.substack.com

Comments

Nothing yet. Say the first thing.

    Sign in to join the conversation.