Knowing When Not to Use AI May Become the Next AI Skill

Years ago, we had an intern who went on a casual all employee company outing. We played golf, then went to a tavern for lunch. It wasn’t a fancy restaurant. Everyone was casually dressed. Most people ordered burgers, sandwiches, or wings. The intern ordered the most expensive item on the menu: surf and turf.

Technically, no rule had been broken. The company was paying. The option was on the menu. But everyone understood something the intern did not.

Just because you can order the surf and turf doesn’t mean you should.

I don’t condone reducing an intern to one lunch order. But the story came to mind because it showed how much context maters when using shared company resources.

Just because the most expensive AI is on the menu doesn’t mean every task calls for surf and turf.
Just because the most expensive AI is on the menu doesn’t mean every task calls for surf and turf. Illustration created by ChatGPT.

AI may become its own version of the company lunch. The most powerful model may be available. The advanced tool may be on the menu. Someone else may even be paying. But judgment still matters.

  • Sometimes the work calls for surf and turf.
  • Sometimes a burger is enough.
  • Sometimes you pack your own lunch.

That matters more now because more companies and people are starting to realize AI is not a free lunch. The real costs of tokens, advanced models, and agentic workflows are beginning to show up in budgets, usage caps, and renewal conversations.

The next AI skill is not simply knowing how to use the most powerful tool. Its knowing whether the job calls for AI, what level of AI it calls for, and when the work should stay human.

AI Felt Unlimited, But The Limits Are Starting To Show

For many users, AI has felt frictionless. You type a prompt, and the answer appears. Maybe you pay a monthly subscription. Maybe your university or company provides access. Maybe you use a free version and only occasionally hit a limit. The meter was mostly invisible.

But the meter was always running. Free users are seeing more, “You’ve reached your free messages.” Businesses are blowing through AI budgets faster than expected.

The real economics behind the helpfull chat boxes are becoming harder to ignore.

Every prompt uses tokens. Every long conversation, file upload, agentic workflow, image request, or coding session uses compute. For now, many of those costs have been hidden, subsidized, bundled, or absorbed by companies trying to grow adoption. But that may not last long.

In his newsletter, Christopher S. Penn put token economics in blunt terms. He estimated that a $200/month Claude Max 20 plan can provide roughly $8,000 worth of token output or a 97.5% discount. No business can sell its product at that discount forever.

AI has felt unlimited because someone else has been absorbing much of the cost. But that may beginning to change.

A TechCrunch article described companies starting to balk at the price of AI as token usage grows. Uber reportedly burned through its 2026 AI coding budget by April. Microsoft pulled back some developer access to Claude Code months after enabling them.

There is an environmental side to this, too. The compute behind AI has energy, water, and infrastructure costs. Using AI more efficiently is not only better for budgets. It is also part of using the technology more responsibly.

The Hidden Cost of “Use AI”

Need ideas? Use AI. Need a summary? Use AI. Need an email? Use AI.

Need a spreadsheet formula, campaign plan, research question, presentation outline, or first draft? Use AI. Sometimes that’s the right choice. But “use AI” can also become too frictionless.

The danger is losing the pause and questions that used to happen before work began.

What am I trying to do? Do I understand the problem? Or is AI even needed? What should I think through myself first?

If the person using AI doesn’t understand the underlying work, will a more powerful model help produce better work, or simply produce a polished version of weak thinking they’re not able to judge anyway?

That last question matters for higher education. Students need to learn how to use AI, but they also need to learn how to work when AI is not available, not allowed, too expensive, or not right for the task. If student learning depends too much on AI they may price themselves out of the jobs they’re preparing for.

When Skills Depend on a High Token Budget

A student who can only produce good work with unlimited access to the most powerful AI is not as AI-ready as they may think. They may be AI-dependent.

This applies to basic communication, too. If students never learn how to write a clear email, organize a simple slide deck, summarize a source, or explain a recommendation, they may have to spend tokens every time they communicate.

They’re not more efficient because they know AI. They become more expensive because they depend upon AI.

This will matter more as organizations start managing AI costs more carefully. Employers may not always give every employee unlimited access to every model. They may expect employees to know when a task requires, simple AI, advanced AI or no AI.

Business Insider reported that Coinbase CEO Brian Armstrong is trying to keep AI costs roughly flat while token usage grows by routing prompts to cheaper models to match the task to the right level of AI. That’s not only a technical skill. It requires understanding the work.

Someone who knows the subject can often get a useful answer from a smaller, cheaper model because they know what to ask, what context matters, and how to judge the output. Someone who doesn’t understand the work may need a more powerful model, more attempts, and more tokens just to get close. In that sense, human skill becomes part of AI efficiency.

Tokenmaxxing was short lived, the next metric will be tokenminning.

Prompt skills may matter more when AI is no longer treated as free and unlimited.

Prompting Is Not a Substitute for Knowing

On the other hand just knowing prompting skills isn’t enough. Shallow AI literacy says: “I know how to prompt.”

A deeper version says: “I understand the work well enough to know when AI can help, how to ask for that help, what kind of model is needed, what the output is worth, and when I should do the thinking myself.” That’s the skill employers will be seeking and higher education should be developing.

In marketing, that might mean knowing when AI can help generate alternative versions of a positioning statement but not replace the hard work of the human insight into the market and target audience.

In advertising, it might mean using AI to explore headline territories but still knowing which line has a real idea behind it or will resonate with how people really think or talk.

In research, it might mean using AI to summarize possible sources while still opening the article, reading the methodology, and deciding whether the evidence supports the claim.

In design, it might mean using AI to produce quick visual directions while still grounding the work in human observation, user needs, constraints, and context.

The important skill is not using AI. Its knowing what kind of human judgment the task requires before deciding what kind of AI assistance is useful.

The Most Expensive Answer Is Not Always the Best Answer

One reason this matters is that more AI does not always mean better work.

A study, “How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks”, found AI agents can consume vastly more tokens than simpler AI workflows. Agentic tasks can use up to 1,000 times more tokens than code reasoning and code chat, and that higher token use doesn’t always translate into higher accuracy.

It’s easy to assume more AI means more capability. But more is not always better.

Sometimes a smaller model with a better prompt is enough. Sometimes a search engine is enough. Sometimes a conversation with a colleague is better. Sometimes sitting with the problem for ten minutes is the fastest path to a better idea.

That may sound old-fashioned, but it’s also practical. Burning AI tokens on a task a simple Excel formula could handle is not maxing your value to your employer.

If AI becomes part of the cost structure of work, using the most powerful model for every task may become like ordering Surf and Turf for every meal. Eventually someone notices the bill.

A Guide To Using The Level Of AI V2

Click on the image to download a PDF of this guide. Graphic created by ChatGPT.

Human Plus AI, Not AI for Everything

AI should amplify what students and professionals can do, not become the only way they can do it. That means the best AI users won’t be the ones who use the most AI. They’ll be the ones who know when to think, when to prompt, when a smaller model is enough, and when the work should stay human.

The same caution I offered writers and readers applies here. Don’t abdicate your human discernment to AI companies that have incentive to make AI feel frictionless, indispensable, and unlimited.

As AI becomes more powerful, organizations will measure it more closely. The people paying for these tools will want to know whether AI is saving time, improving quality, reducing risk, or simply moving cost from payroll to tokens.

That is why AI literacy needs to be taught in the classroom and on the job. Not just how to use AI, but when to use it, how much to use, and when not to use it. And that takes human judgment.


AI use disclosure: The central idea for this post was mine. It came from thinking about AI writing, AI detection, and the growing cost of token-based AI use. I used ChatGPT as a thought partner to develop the structure, test the higher-education angle, and identify possible supporting sources on AI token costs, model routing, and agentic AI workflows. I opened and checked sources before using them. I then rewrote, reorganized, added, cut, and edited the draft to reflect my own experiences, views, and voice. The stories, examples, and final decisions are my own.

When AI Detection Becomes a Digital Scarlet Letter

A Guide To Using AI Detection Cautiously

A tool designed to flag authors writing without human judgment can remove human judgment from the reader using it turning a detection score into a digital scarlet letter.

In a recent post, I wrote about how AI can flatten writing when writers outsource too many decisions. That includes the subtle choices authors give away to AI that make a piece recognizably theirs.

But there’s a second kind of flattening that may be even more subtle. This one happens to readers.

AI detection tools can be useful. I use them. Educators need help identifying cases where students submit work they didn’t do. Publishers need to protect readers from synthetic articles produced at scale. The internet and social media is already flooded with low-effort AI content, or what some call AI slop.

But the important question isn’t only whether AI detection can identify patterns in writing. We also need to ask,

What happens when a detector score or label becomes a shortcut for judgment?

What AI Detection Can and Can’t Tell Us

Pangram is one of the more sophisticated AI detection tools. Rather than flagging a few suspicious phrases, it looks for patterns across a full piece of writing — what CEO Max Spero describes as identifying “mode collapse,” the tendency of large language models to make similar structural choices repeatedly.

The company claims a false-positive rate of one in 10,000. That does matter because few detectors perform at Pangram’s level. A 2024 higher-education study tested six AI text detectors and found a baseline accuracy of only 39.5%.

Most people, though, are not making decisions with the best detector under ideal conditions. They’re using whatever tool is built into an LMS, SAAS, found by search, avaible for free. Accuracy varies widely by tool, text length, writing context, and whether the writing has been revised, translated, or mixed with human work.

Yet even if Pangram performs better than most, the level of accuracy still doesn’t address an uderlying concern with AI detection..

When A Signal Becomes A Verdict

A useful signal  can become a problem if people treat if as a final verdict. A label can tell us something about patterns in prose. It cannot tell us whether an author had something real to say, whether the experience is authentic, whether the judgment is sound, or whether the writing is worth reading.

That part still requires a human reader. We already read in enviroments shaped by algorithms. Our feeds descide what rises, what disappears, and what we are likley to see at all. We’re already not fully in confrol of what worthy reading reaches us.

AI detection adds another layer. It doesn’t just shape what appears in front of us. It can shape what we trust once it gets there.

The contrast shows up in my classroom. As a professor, I don’t look at AI detection scores before reading student papers. I read them first, forming my own opinion about the writing, argument, and thinking.

If something raises a concern (such as voice that doesn’t match a student’s earlier work, a structure that feels imported versus developed, or a stat that feels unbelievable) then I may consult a detection tool and do further checking on my own.

When evidence points to AI use in a way not permitted in the assignment, that becomes a teaching moment. I explain why using AI for that task was not allowed, how it affects the grade, and how it impacts their learning and skill development.

AI detection tools should support human judgment. They shouldn’t replace it.

Universities are beginning to see this underlying issues. Vanderbilt disabled Turnitin’s AI detector after raising concerns about false positives, transparency, privacy, and the possibility that non-native English writers could be disproportionately flagged. Washington State University canceled its Turnitin AI Detection contract in 2026, citing concerns about false positives, student distress over false accusations, and lack of transparency.

The problem is made harder by the detection-evasion arms race. AI detectors try to identify machine-generated pattersn, while AI writing and “humanizers’ tools promise to make AI-assisted text sound more natural. For example, Grammarly, now offers both an AI detector and an AI humanzer that it sells to both universities and students. Research has found that humanizing tools can make AI-generated text harder to detect.

That does not mean AI detection has no value. It means institutions are starting to ask the same question individual readers should ask: Is this tool helping us exercise better judgment, or is it tempting us to outsource judgment to a score?

The Label Appears Before You Read

Professors can see AI scores before reading student work. Editors and publichser can run manuscripts through automatic screening tools before considering the argument. Reviewers, managers, or readers may be a label or score before they have formed their own judgement.

Pangram’s new Chrome extension brings the same concern into broader public view.

The extension scans posts as you scroll, automatically labeling them human, AI-assisted, or AI-generated. Green means the writing appears human. Yellow means AI-assisted. Red means AI-generated.

You don’t have to stop, open a separate tool, paste the text, and consider the result. The judgment appears instantly, automatically, and without your involvement.

AI detection tools should support human judgement, not replace it.

The concern is the immediacy. The label gets there first. Before you read the opening sentence, before you hear the writers voice, before you consider the argument, the classifier has already suggested how susicious you should be. If you accept that label as a verdict, your judgement has been shaped before the writing has had a chance.

A yellow or red label risks becoming a digital scarlet letter: a visible mark of suspicion that encourages readers to judge the writer before they have read the words.

A Guide To Using AI Detection Cautiously Click on graphic to download a PDF. Graphic created by ChatGPT.

The Pope Leo Moment

As Wired reported, Pangram promoted its new Chrome extension by flagging multiple posts from Pope Leo XIV’s official X account, including posts raising concerns about artificial intelligence.

The irony is hard to miss. A post warning that AI could weaken human discernment was itself labeled AI-generated by an AI detector that can encourage readers to outsource discernment.

Maybe the label was accurate. AI could have played some role in shaping the posts. Public figures have communications teams. Social media posts are often drafted, reviewed, revised, and approved by more than one person.

And in marketing communications, using AI to help adapt, edit, or optimize social posts is becomming part of the normal workflow. Many social media management tools now build AI assistance into the process.

But does that automatically dismiss the importance of the message?

Will we let AI make judgements about other humans and thier message without any thought of our own?

The Pope example became an effective publicity hook for Pangram’s browser extension, drawing articles and reposts. That’s what product launches try to do. But I felt a difference.

A tool built by an AI company was publicly questioning the authenticity of one of the most visible voices on the human risks of AI. That doesn’t make the detector illegitimate. But it does make the judgment around how it is used worth examining.

The tool isn’t simply identifying synthetic spam hidden in the corners of the internet. It’s placing visible labels next to people’s words, encouraging instant judgment as we scroll past them.

What the Pope Said Next

That question became even more relevant a month later when Pope Leo released his first encyclical, Magnifica Humanitas: On Safeguarding the Human Person in the Time of Artificial Intelligence.

In it the Pope warns against fully delegating decisions that affect people’s rights, opportunities, status, freedom, or reputation to automated systems. He also writes that “every technology shapes those who use it.”

That applies to writers. It also applies to readers.

If we automatically skip anything labeled AI-assisted, we’re no longer exercising our own judgment. We’re asking an imperfect AI classifier to decide what deserves our attention before we’ve read the first paragraph.

What’s more, Spero himself notes in the same interview that the tool becomes more reliable the longer the text gets. More words mean more branching decisions to analyze and more pattern data to work with. A post on X is about as short as text gets. Yet the extension applies the same confident color label regardless.

The tool designed to flag writing with little human judgment can end up removing human judgment from the reader.

AI Assistance Is Not Human Replacement

Writers have never worked entirely alone. Books and magazine articles have editors. Academic articles have reviewers. Journalists have fact-checkers. Copywriters have creative directors and proof readers.

I became a better writer because other people challenged my work, questioned my logic, and told me when an idea was not there yet. AI can play a useful supporting role. It can identify an unclear paragraph, find a source, suggest a counterargument, or help a writer get unstuck.

That’s different from publishing thousands of synthetic posts under fake names or filling the internet with auto-generated comments no human thought deeply about.

Disclosure matters. Readers should know when AI played a meaningful role. But collapsing every kind of AI assistance into a single category doesn’t help us think more clearly about authorship.

A yellow label can’t tell you whether a writer spent five minutes, five days, or even five month shaping the final piece. It can’t tell you whether the experience is real, the judgment is sound, or the idea is worth your time.

Pope Leo’s encyclical calls for an “ecology of communication” where reasoned argument and verification carry more weight than immediate reaction. That’s a useful standard, whether you’re a writer deciding how much to lean on AI or a reader deciding what author to trust.

AI can flatten writing when writers outsource too many decisions.

AI detection can flatten reading when readers do the same.

If you want to know whether a writer has something real to say, you still have to read them.

AI use disclosure: The central idea for this post was mine. It began with my reaction to seeing writers quickly dismissed through Pangram’s color-coded browser labels, a kind of digital scarlet letter applied before their work had been read. I used ChatGPT and Claude as thought partners to pressure-test the argument, identify possible supporting sources, and follow new tributaries opened by the Wired article, the 2024 higher-education detector study, and Pope Leo XIV’s encyclical on AI. I opened and checked the sources myself before using them. I then rewrote, reorganized, added, cut, and edited through multiple rounds. The experiences, ideas, opinions, and final decisions are my own. If an AI detector flags this as AI-assisted, I hope readers will still read before judging. I  first had this thought on May 1st, and the research, thinking, writing, and back-and–forth with ChatGPT as my thought partner unfolded over two months. This was not a single-prompt, copy-and-paste article.