Day One With an AI Agent Team: 6 Things That Broke (and the Fixes)

Day One With an AI Agent Team: 6 Things That Broke (and the Fixes)

On September 26, 2026, I set up a small team of AI agents on my PC. Claude does research, writing, and review. OpenAI's Codex and Google's Antigravity make images. I don't write code.

Most setup guides show the happy path. This post is the other half: the six things that actually went wrong on day one, why they happened, and what I changed. Every item comes from my own failure log, so none of this is hypothetical.

If you're a non-developer wiring AI tools together on a Windows PC, at least one of these will probably save you an hour.

1. The image tool had no quota left before I started

What happened. My first image request to Codex failed instantly with "You've hit your usage limit," and a time when it would reset.

Why. Codex usage on a ChatGPT plan is shared across the places you use it. OpenAI says the same limits apply in the app, the CLI, the IDE extension, and the cloud (OpenAI Help Center, checked 2026-09-26). I hadn't run anything through the CLI yet, so the quota for that window had been used up elsewhere on the same account. Image generation also uses limits 3 to 5 times faster on average than a normal turn, according to OpenAI's docs (checked 2026-09-26).

Fix. Before a batch of image work, check the usage page first. When I measured it after the reset, one image took the 5-hour meter from 100% to 99% on my Plus account. That's one measurement on one account, not a rule.

Scrabble tiles spelling Google and Gemini

Photo: Markus Winkler on Pexels

2. A tool installed fine but "didn't exist" for anyone else

What happened. I installed Google's Antigravity CLI from inside a desktop app. It worked there. When I opened my own terminal, Windows said the program didn't exist at that path.

Why. The desktop app I was working in is a packaged (MSIX) Windows app. For packaged apps, Windows copies writes to the user's AppData folder into a private, per-app location (Microsoft Learn, checked 2026-09-26). The install really happened, just somewhere only that app could see.

Fix. Install tools that live in AppData from your own terminal, outside the app. Keep your project files outside AppData too.

3. The agent quietly skipped a step

What happened. I asked Antigravity, run without a human watching, to make an image and save it into a folder. It reported success, but no image appeared.

Why. In headless mode, actions that normally need your approval can't prompt anyone, so they're auto-denied and the run keeps going (Antigravity docs, checked 2026-09-26). The agent had tried to run a command to move the file, and that command was denied.

Fix. I didn't switch on the "skip all permissions" flag. Instead I told the agent to use only its image tool and return the file path, and the file got moved in a separate step. Narrow permissions, one extra step.

4. The image model invented my text

What happened. I asked for a blog thumbnail showing "a checklist with three checked items." The image looked great, but the model wrote its own three items, which weren't the principles the post was about.

A second try put stray quotation marks around the headline, because I had wrapped the text in quotes in the prompt.

Fix. Spell out every piece of text that should appear, and add: "Render all text exactly as given, without any quotation marks or extra words." Don't put quote marks around the text you want drawn.

5. "Keep everything the same" didn't keep it the same

What happened. I gave the model the approved image and asked it to change only the checklist labels. The labels came back right, but the white background had turned into gray paper texture and the magnifying glass had turned gold.

Fix. Restate what must stay, specifically: background color and texture, panel positions, object colors, and style ("flat vector, no shading"). With that spelled out, the second attempt matched the original.

A phone on a stand showing an AI chat app

Photo: Tim Witzdam on Pexels

6. I published the wrong page, and only checking caught it

What happened. At first I published by copying prepared HTML and pasting it into Blogger. The Privacy Policy page went live containing the Contact page text. The clipboard still held the previous page.

Fix. Two changes. The copy button now says which file it copied. And after anything is published, the live page gets fetched and checked for a few key phrases that must be there. That check is what caught this one.

The pattern behind all six

None of these were exotic bugs. Each one was a gap between what I assumed and what was actually happening:

  • Limits are shared. Check before you start.
  • Tools run in contexts. Where you install something decides who can see it.
  • Unattended agents fail quietly. Give them narrow jobs and verify the output.
  • Image models fill in blanks. Leave none.
  • "Published" isn't "correct." Look at the live result.

I'll keep logging what breaks as I go. Next up: the simple dashboard I use to give instructions and approve anything that goes public, without opening a terminal.

Comments

Popular posts from this blog

Claude Code on Windows for Non-Developers: 6 Snags I Hit and How I Got Past Them

Updating 20 Live Blogger Posts at Once Without Changing a Single URL