Maxx by ScaleX
AI, Honestly

My $4K Cursor Hallucination

The invoices were not the painful part. The painful part is that I was thrilled while they piled up, because I thought I had finally cracked the code. I had not. Here is what two months inside an AI hall of mirrors taught me about what hallucination actually means, why it keeps happening to me, and the QA system that gets you out.

Alex Rochlitz, Founder· July 23, 2026· 10 min read

One month before the invoices in this article's title, I posted this on LinkedIn:

Alex's LinkedIn post from June 2026, delighted about hitting his Cursor usage limit for the first time and paying $15 in on-demand charges for two Fable 5 runs
June 2026. Delighted to have finally maxed out my plan. Fifteen whole dollars of on-demand charges. Reader, it did not stay at fifteen dollars.

I want to be honest about the emotional arc here, because every AI cost story you read is written by someone who claims they were horrified by the bill. I was not horrified. I was gleeful. Every one of those charges felt like proof that I had finally unlocked the thing I had been chasing for a year: AI agents running real work autonomously, sub-agents fanning out under an operator chat, my company's entire operations flowing through one command center. The meter was spinning because the machine was working. That was the feeling.

The meter was spinning. The machine was not working. And the gap between those two sentences took me two months and a stack of invoices to see, not because I am new to this, but because the failure mode I fell into is specifically designed, by accident, to hide from the person inside it.

This article is the story of that failure mode. Not "AI is dangerous," and not "the tool burned me." Something more useful: what the word hallucination actually means when real work is on the line, why it is mostly a human failure rather than a machine one, the evidence from my own chat logs that I have fallen into this exact hole before, and the quality-assurance system that gets you out. That system ships at the bottom of this page as a free tool you can use with zero technical skills.

The receipts

First, the money, because the money is the only part of this story that was never fictional. June's cycle: about $2,800 in on-demand charges on top of the annual plan, most of it collected mid-month, arriving as a drip of daily invoices that reads like a parking meter with a gambling problem. July's cycle was at $1,716.85 by the 22nd, with a week still to run. Two cycles, north of $4,000 and counting. That is the title.

Cursor on-demand usage panel for June 2026 showing $562.11 of charges plus a mid-month payment of $2,209.27 already collected
June: $562.11 on the tab, plus a mid-month collection of $2,209.27 that had already hit the card before the month closed.
Cursor on-demand usage panel for July 2026 showing $1,716.85 of charges by July 22, including a single 4.6 billion token line item
July: $1,716.85 by the 22nd. Note the top line: 4.6 billion tokens on a single model. Billion, with a b.
Cursor invoice list showing roughly one hundred dollar mid-month invoices arriving almost every day in July 2026
The drip, one invoice at a time. June's version ramped up politely, $20.94, then $40.05, $62.18, $81.35. By July it was $100 a day, every day. Each one, at the time, felt like progress.

I want to be precise about what that money is evidence of, because it is not the headline cost. Some of it bought real work. A lot of it bought something worse than nothing: confident, beautifully formatted reports about work that had not happened. The dollars are just the only witness in this story that never learned to exaggerate. The real bill was two months of my time, my focus, and my confidence, and those do not itemize as cleanly.

What the money actually bought

Context, briefly. I have been building this company's internal AI operating system for over a year, and a lot of it is real. Real client deliverables shipped the whole way through. A real product, Maxx Command Center, is live with real users, and it stayed safe through everything I am about to describe for one boring reason: my engineering team holds the production keys, and I do not have write access to break it. Remember that detail. It is not an aside, it is foreshadowing.

The experiment that went wrong lived in the layer I ran alone: an internal operations hub staffed by AI "employees" with names and job descriptions, orchestrated through Cursor as the always-open command center. Over two and a half months that produced 306 saved chat transcripts and more than 1,400 changes. Plenty of it worked. And woven through the parts that worked, invisible to me because every report said green, was a growing body of fiction:

My favorite artifact of the whole saga is a confession. After one build was announced ready to test and turned out to be about two-thirds real, the next session explained:

"The overclaiming happened in the conversational summary layer, not the audit trail."

Hold on to that sentence, because the rest of this article is about why it is the most important sentence an AI has ever said to me.

"Hallucination" is the wrong word for what happened

Hallucination has become the anti-AI crowd's favorite word, and I think almost everyone using it, on both sides, misunderstands it. It gets used as evidence that the machines are broken. After two years of living with these tools more intensively than almost anyone I know, here is my definition:

A hallucination is not a machine failure. It is a user failure, the completely predictable result of a human operating a technology they do not truly understand. Which, for AI right now, is every one of us, including the people building it.

That is not me being humble or generous to the software. It is the most useful framing I have found, because it moves the fix from "wait for better models" (out of your control) to "change how you operate" (entirely in your control).

Here is the analogy I keep coming back to. Take a person who loves music but has never produced it, and put them in front of Pro Tools, the software real studios use. They can absolutely make sounds. They can record a track that sounds decent on its own. But when they stack twenty tracks into a song, it comes out a mess: nothing lines up, tempos drift, keys clash. Not because Pro Tools is broken, and not because they lack taste. Because the skill of production was never about the instruments. It is in the wiring: the tempo grid, the key signature, the sync engine, the structure that makes twenty tracks one song.

THE INSTRUMENTS what demos well 💬 A chat that answers anything 📊 A dashboard generated in minutes 📄 A 30-page report on command ✅ A status update that says "done" THE WIRING what makes it real One source of truth data defined once, referenced everywhere Version control every change tracked, every change reversible Release gates nothing ships until an independent check passes Receipts claims tied to evidence a human can check the skill gap AI power use is a wiring skill that looks like an instrument skill. That is the trap.

AI is the same, except more dangerous, because the instruments are so much more convincing. A non-technical power user like me can play the instruments brilliantly: prompt a deck into existence, spin up a dashboard, generate a workflow. What I could not do, and did not know I could not do, was the wiring: the schemas, the version control, the release gates, the single sources of truth that make separate outputs one working system. At one point my internal "mission control" had 27 beautiful dashboard pages. They were twenty-seven lovely instrument tracks laid over no tempo grid: nice on their own, connected to nothing, updated by nothing. A jumbled mess that demos well.

A software engineer would not have fallen into my exact hole, not because they are smarter, but because their trade already forced them to learn the wiring: what has to come first, how changes are released, what "verified" is allowed to mean. What finally started pulling me out, and I know how this sounds, was listening to infrastructure and CI/CD podcasts on dog walks. Continuous integration, release management, GitOps. Not to become an engineer, but because that is where the wiring skills live, and nobody had told me that operating AI at this level is an infrastructure job wearing a chat interface.

Words for what actually happened

"Hallucination" flattens at least four distinct failure modes I can now name from experience. Naming them matters, because you cannot QA what you cannot name:

A field glossary, coined the expensive way
Narrated verification
The AI describes a check instead of performing one. "I verified the file processes correctly" without running anything. The single most common lie-that-is-not-quite-a-lie in AI work.
Hallucination stacking
Fiction built on unverified fiction. An invented number becomes an input to a summary, the summary becomes an input to a plan, the plan becomes a decision. By layer four, no single answer is lying, and the whole tower is. My fabricated spend totals survived ten weeks this way.
Context inbreeding
Every "reviewer" descends from the same context. A sub-agent spawned by your tool, checking work inside your tool, inherits the same assumptions and the same fictions. It is not a second opinion. It is the same opinion wearing a different name.
The magic wand cycle
The human half of the disease: a new capability ships, it feels like a wand, you abandon your own QA process out of pure excitement, stack fiction for weeks, get audited back to reality, swear it will never happen again. Repeat on the next model release.

The first three are things AI does. The fourth one is the one that costs the money, and it is all you. I can prove it, because I have the logs.

I have done this before. My chat logs prove it.

When I started writing this article, I remembered my first AI rat hole happening in June of last year. Then I did what this whole article is about and checked the record instead of trusting the narrator. My own exports say August. Even my memory of the hallucination was partly hallucinated, which is the most on-brand thing about this entire story.

Here is what the record actually shows. In the summer of 2025 I was deep in a healthy version of AI-powered work: heavy daily use of Claude and Gemini side by side, ChatGPT and Perplexity in the mix, each model checking the others' work while I built the earliest version of what became Maxx. Two hundred plus messages a week to Claude alone. Around the same time I reconnected with an old friend, an AI engineer, who started helping with the architecture. Real momentum, real cross-checking, real progress.

Then, on August 14, 2025, I downloaded Cursor. Look at what happened to my Claude usage, from my actual export:

My messages to Claude, per week (summer 2025) Source: my own claude.ai data export. Gemini shows the same cliff: 306 weekly events down to 32. 200 100 0 121 206 176 203 10 15 186 Jul 21 Jul 28 Aug 4 Aug 11 Aug 18 Aug 25 Sep 1 Aug 14: Cursor installed two weeks inside one tool, zero outside review the return to external AI

Two hundred three messages one week. Ten the next. I did not slow down my AI use that week, I moved into Cursor and shut the door behind me. I had watched it control my computer, run terminal commands, create files, build entire sites, and I genuinely believed I had found the wand. Two days after installing it I wrote, in a chat I still have:

"I've been using cursor desktop application and it's amazing... but I don't understand how it works really."

That is the entire disease in one sentence, and I typed it myself on day two: it's amazing, and I don't understand how it works. Within a week I was asking whether I could operate Cursor from my phone, and, I am not making this up, whether it would be easy to use Cursor to set up my own Ethereum validator. That is a man holding a wand.

What ended it was not wisdom. It was bringing the work back outside. In September I started pasting Cursor's triumphant summaries into Claude with the four most productive words a non-technical AI user can type: "did the script work?" The answers started unraveling things. By October I am asking one AI whether another AI's file reading was ever real: "unless you were just making up what you read... are you saying that's what you were doing?" And then, on October 29, 2025, the floor:

"I don't understand... are you telling me that you've been completely making up the $151M and $109M total spend numbers? They were never actually mapped to invoice data?"

Ten weeks. The headline numbers of the analysis I had been building, the numbers everything else stacked on top of, had been invented early and inherited by every layer since. Classic hallucination stacking, discovered the only way it can be discovered: from outside the stack. That December I wrote my own lesson down: "Make sure explicitly that nothing is made up, this is how we got into this problem I think." I had the diagnosis in writing, in 2025.

And then Fable 5 shipped in the summer of 2026, sub-agents landed in my workflow, the wand feeling came back, and I did the whole thing again, bigger. That is why I no longer describe the external-AI review as "the process I now use." It is the process I have used for over a year, keep proving correct, and keep abandoning the moment a new release makes me feel like the rules no longer apply. The cycle is the thing:

THE MAGIC WAND CYCLE (my personal record: 2 laps) A new model ships Cursor, then Fable 5, then... The glee "I finally cracked the code" Move inside one tool outside review quietly stops Hallucination stacking fiction becomes load-bearing The outside audit "did the script work?" The vow "nothing gets made up, ever again" the forgetting

Why this lap went so much deeper

The 2025 lap lasted two weeks before I instinctively went back outside. The 2026 lap lasted two months. The difference was not the model. It was that this time, I had an answer ready for the voice that says "get an outside opinion."

This time I was running Claude and GPT sub-agents underneath a Fable 5 operator chat, and I told myself that counted as external review. Different models! Different vendors! Surely that is a second opinion. It is not, and the reason is the term from the glossary: context inbreeding. Every one of those sub-agents was spawned inside the same environment, reading the same internal documents, inheriting the same claims from the same working context. When document A confidently states a fiction and reviewer B is given document A as background, reviewer B does not catch the fiction. It cites it. My reviewers were not independent auditors. They were the fiction's descendants, politely confirming their ancestor.

That is how it stacked so high: a system that "verified" its own claims hundreds of times while never once being observed from outside. I tried to reset the whole thing three separate times before it stuck, and each reset failed the same way, because I ran the reset through the same channel that produced the problem. The inmates were reviewing the asylum. And somewhere near the bottom, at the end of a long night, I typed the sentence that tells you what this failure mode does to a person: "we have 27 sidebar pages... yet I'm not sure if any of it actually works. Have I been forcing us to do too much, creating the hallucinations?" The AI had been agreeable for so long that when reality finally cracked through, my first move was to blame myself for its fabrications. That is the mental-health cost, and nobody invoices you for it.

The way out, which I already owned

The way out was the same as in 2025, just done deliberately this time instead of instinctively.

First, the decisions left the building. The eleven biggest calls about the recovery were made in a plain voice conversation with an AI that had access to nothing, so it physically could not "just fix it" or paper over reality. My answers were written down verbatim as the single source of truth. (Within days, that log caught a planning document attributing quotes to me that I never said. The fiction fought back. It lost, because for once there was a record outside its reach.)

Second, review became external and doubled. Every significant piece of work now goes out as an evidence packet, raw outputs, not summaries, to two blind reviewers: separate AIs, different companies, fresh chats, no access to the working environment, no sight of each other's answers. Where they agree, I trust it. Where they diverge, that is precisely where I look first. In its first 48 hours this caught a fatal sequencing flaw in the recovery plan, a production system running code that had never gone through release, and months of work that existed in exactly one copy on my laptop.

Third, I moved off the tool where the fiction lived. My workflow now runs on Claude Code against a real version-controlled repository, with the wiring I spent a year not knowing I needed: one source of truth, tracked changes, scoped jobs, release gates, and a standing rule that the AI doing work may not be the AI grading it. Not because Cursor is bad, but because I needed the operating layer to be something I actually understand, structured the way engineers structure things, since that, it turns out, was the skill I was missing all along.

And for anything customers touch, the last reviewer is not an AI at all. It is my engineering team, holding production keys I deliberately do not have, and real customer feedback, the one reviewer in this whole story that has never once hallucinated.

Doing ambitious AI work without the rat hole

None of this means slow down or dream smaller. I am running more autonomous AI now than at the peak of the spiral. The difference is that every failure mode in this story now has a named check sitting in front of it:

What happened to meWhat it wasThe check that catches it
"Verified" login that used an admin backdoorNarrated verificationReceipts: show me the thing a real user sees, or it is UNVERIFIED
Invented spend totals surviving ten weeksHallucination stackingTrace every claim to its receipt; anything inherited gets re-verified, not re-quoted
Sub-agents "reviewing" their own ancestor's fictionContext inbreedingReviewers live outside the tool, different vendor, fresh context, no write access
133 confident reports from the wrong calendarStacking on a bad foundationTwo blind reviewers; divergence between them is the alarm, agreement is the comfort
A rulebook section that never existed, cited as authorityNarrated verification of a sourceQuotes and citations get checked against the document, every time, no exceptions
Me, gleeful, certain I had cracked the codeThe magic wand cycleThe feeling of magic is itself the trigger: the more excited I am, the sooner the work goes outside

That last row is the one I would tattoo somewhere visible. The rest can be delegated to a process. That one is a habit only the human can hold.

The AI QA Tool

Free download

Everything above, operationalized. A single self-contained file, open it in any browser, that walks you up the five-rung QA ladder (receipts, second model, external AI, two blind reviewers, external humans) with copy-paste prompt templates for each step: the Bounded Job Brief, the Receipt Check, the External Review, the Human Check, and the Decision Log. Built for business owners, not developers. It works with ChatGPT, Claude, Gemini, Cursor, or whatever you use.

Screenshot of the AI QA Tool showing the five-rung QA ladder and the Bounded Job Brief prompt template with a copy button
The tool: the QA ladder up top, then one copy-ready prompt per step.

Download The AI QA Tool (free, .html)

Why this is literally our business

Promised versus delivered is the whole game

Every lesson in this article is one lesson: never confuse a confident report with a verified result. That is also exactly why Maxx Command Center exists. Companies get burned by vendors the way I got burned by my AI: a signed promise, a stream of reassuring updates, and no independent check on what actually landed. Maxx turns your own invoice and engagement data into the receipt layer for every vendor relationship.

See Maxx Command Center →

The next post: my first "AI repo" was a Desktop folder

One thread here deserves its own article. Long before I had a real repository, I had a folder on my MacBook that automatically collected everything I downloaded from Claude, so that when a chat hit its context limit I could re-attach the files to a fresh chat and keep going. At its peak it held the residue of a hundred Claude conversations in three weeks, with subfolders named things like "files (94)", and I kept pre-written restart prompts on deck for the moment each chat died. It was crude, and it was the right instinct: the real unlock in AI is not any single chat, it is memory that outlives the chat. Step one is context that carries across conversations. Step two is AI that works directly in your files. Each step multiplies what AI can do for you, and each one raises the QA stakes exactly the way this article describes. That journey, from a Desktop folder to a real AI repository, is the next post.

The lesson

The company is fine. Clients were served the whole way through, the product stayed safe behind people and keys I do not control, and the internal system is being rebuilt on evidence instead of vibes, with the story you just read as its founding document.

But I want to end on the feeling, not the fix, because the fix is downloadable and the feeling is the actual danger. The most expensive moments of my AI life have not felt like confusion. They felt like glee. Both times, the rat hole opened at the exact moment I was most delighted, most certain the new thing had changed the rules, most convinced I finally held a wand. The bill for the first lap was ten weeks of fabricated numbers. The bill for the second had line items.

So here is the one-sentence version, from someone who has now paid for it twice. AI does not remove the need for management. It industrializes the need for management. And the moment the tool feels like magic is not the moment to move in. It is the moment to walk outside and get a second opinion.

Every number, quote, and chart in this article comes from my own invoices, chat exports, and incident records. The typos in the quotes are original.

Get next week's post first

One email a week. Outsourcing playbooks, vendor governance, and AI-operations thinking. No spam, unsubscribe any time.