RSS Amplifier

SURFACING WISDOM · Aug 15, 2026

AI Can Tell You What's Likely. Wisdom Tells You What's Worth Doing.

0
Sign in to vote or save

SJ King · SURFACING WISDOM

There is something AI cannot do. I want to be precise about what it is, because the usual way of framing this — “AI can’t replace human judgment” — is vague enough to be useless, and the people who say it most confidently are often the ones who’ve thought about it least.

Here is the specific thing. AI can tell you what is likely. It cannot tell you what is worth doing.

I made that claim in the spring, in [AI Isn’t Wise—It Needs Us](https://surfacingwisdom.substack.com/p/ai-isnt-wiseit-needs-us). I am not going to re-argue it here. What I want to do instead is give you the decision frame that follows from it — because a claim you agree with and a frame you can use on Monday morning are not the same thing.

The frame is this. Every decision you make has two layers. The likely, and the worth doing. AI has taken the first layer and made it cheap. It can predict your customer churn with 87% accuracy. It can optimize your supply chain to reduce costs by 12%. It can tell you which version of the onboarding email will perform better with your thirty-five-to-fifty-four demographic. These are genuinely useful capabilities, and they are all about execution — means, not ends. They help you do a thing more efficiently. They leave the second layer exactly where it has always been. With you.

The Burmese fishermen who died in the 2004 tsunami were not stupid. They were experts. They could find squid in water other fishermen couldn’t read. AI is a squid-catcher of extraordinary power — more data, faster, correlations a skilled analyst would need years to surface. That is real value, and I am not dismissing it. But the fishermen didn’t die because they lacked data. They died because they couldn’t read the wave.

The wave is always at the second layer. AI cannot tell you that the churn rate is rising not because of pricing, but because the company has quietly traded its founding character — the thing that made customers feel something about the brand — for operational efficiency. It cannot tell you that the engineers are leaving not over compensation, but because the CEO’s brilliance has filled all the oxygen in the room. It cannot tell you that the merger integration is failing because two organizations with fundamentally incompatible identities are trying to share a habitat, and one of them is going to devour the other. It can hand you the pattern. It cannot hand you the meaning of the pattern, and meaning is what you actually decide from.

From the same conversation that produced the May piece: AI can recognize the pattern, but it cannot give you meaning, judgment, forgiveness, or altruism — and those are the four things a hard decision actually runs on.

The danger is not that AI is limited. All tools are limited. The danger is that AI creates the illusion of completeness — the feeling that because you have run the analysis, you understand the situation.

Here is a scenario I have seen play out more times than I can count, in different industries, with different companies. The data shows customers are leaving. The model identifies pricing as the primary driver and recommends a 15% discount. The projected impact: churn drops by 22%. You implement. Churn drops by 18%. Close enough — you call it a success.

But look at who stayed and who left. The customers who stayed are price-sensitive. The customers who left were the ones who valued something else — something harder to name, something in the texture of the relationship with the brand. The model optimized for retention. You retained the wrong people. Six months later you have more customers, lower lifetime value, higher churn velocity in the next pricing cycle, and no idea why the discount that worked last time is working less well this time.

The AI did exactly what you asked it to do. You asked the wrong question. And you had no way of knowing you were asking the wrong question, because the tool that was supposed to tell you what was happening couldn’t see the layer where the actual problem lived. That is not a technology failure. It is a decision failure, and it happened before the model ran — in the moment you decided what to optimize for.

Wisdom is not a gift. It is not an esoteric capacity reserved for people with the right temperament or the right amount of gray hair. It is a trained perception — the capacity to see at the level where causes live rather than symptoms, and then to decide from that level.

The Moken elders who moved their communities to high ground did not have more data than the Burmese fishermen. They had an interpretive framework, taught over generations: what the silence of the cicadas meant, what it meant when the sea pulled back in a particular way. They understood what the system was doing, not just what it appeared to be doing.

Most executives are trained to operate at the level of symptoms. This is not an insult — it is structural. Business school trains you to analyze data, model scenarios, and execute strategy. All valuable, all operating at the level of what is happening and how to optimize it. None of it trains you to ask what you are trading when you make a decision that looks efficient in the spreadsheet and feels wrong in the room. That question has no model behind it. It has only you, and whatever you have learned to notice.

Every leader I know is using AI now. Most of them are using it well. And most of them have not asked themselves the question the technology cannot ask: what are we optimizing for, and is that actually what we’re here to do?

That is the whole decision frame in one sentence. It is the question Andrew Grove was asking when he walked out of his own office in 1985 and asked: if we got kicked out and the board brought in a new CEO, what would that person do? Not what should we do — what would someone unconstrained by our history, our sunk costs, our identity commitments actually decide? He was trying to see Intel from the outside, to read its character without the distortions of proximity. No amount of data would have produced that question. It required a man willing to imagine his own replacement.

AI cannot ask you that. It cannot create the distance from yourself the question requires. It cannot tell you that the thing you are optimizing for is not the thing that made you worth optimizing in the first place.

That gap — between what you are measuring and what actually matters — is exactly where wisdom lives. And it is exactly where AI stops.

The tools are extraordinary. Use them for the likely. But the worth doing is still yours, and it always will be, because the wave doesn’t show up in the data until it is already too late to move.

Read the original on surfacingwisdom.substack.com

Comments

Nothing yet. Say the first thing.

    Sign in to join the conversation.