Skip to main content
Build in public

Field notes.

Real opinions about what AI is getting right and wrong for operators in 2026, written by us, in our own voice, not a content calendar. Plus the occasional teardown of something Izzy built and what it taught us.

AllOrchestrationRevOpsTrust

Showing all notes, newest first.

Articles

A/B Testing LLM Prompts When You Don't Have a Data Team
Agent Trust & Guardrails · Izzy

A/B Testing LLM Prompts When You Don't Have a Data Team

MIT found that 95% of AI pilots fail from workflow design, not bad models. Here's how a two-person team can A/B test prompts without a data scientist.

Dec 610 min
The CTO’s Guide to Token Budgets: How to Set Per-Feature Limits & Prevent Shock Bills
AI Cost & ROI · Izzy

The CTO’s Guide to Token Budgets: How to Set Per-Feature Limits & Prevent Shock Bills

Stop flying blind on AI spend. Learn the 4-step framework to set per-feature token budgets, enforce gateway limits, and prevent surprise LLM bills before they happen.

Dec 4
Why Hardcoding Prompts in Git is a €10M Technical Debt Trap
Governance & the Human Gate · Izzy

Why Hardcoding Prompts in Git is a €10M Technical Debt Trap

Hardcoding prompts in Git hides LLM costs and creates compliance risks. Discover why this technical debt kills velocity and how to decouple prompts now.

Dec 4
7 EU AI Act Traps That Survive the 2027 Delay
Governance & the Human Gate · Izzy

7 EU AI Act Traps That Survive the 2027 Delay

The EU AI Act's high-risk deadline just moved to December 2027. Fines still run up to €15M or 3% of turnover under Article 99, internal workflows included.

Dec 314 min
Why Your LLM Bill Doubled: 5 Hidden Cost Leaks Every CTO Misses
AI Cost & ROI · Izzy

Why Your LLM Bill Doubled: 5 Hidden Cost Leaks Every CTO Misses

Flying blind on AI spend? Uncover 5 technical cost leaks from recursion traps to context taxes—that are driving your OpenAI bill up. Save 30–50% with this guide.

Dec 2
Build vs. Buy: The True Cost of LLM Observability (+ Free TCO Calculator)
AI Cost & ROI · Izzy

Build vs. Buy: The True Cost of LLM Observability (+ Free TCO Calculator)

Thinking of building your own LLM observability stack? Our 3-year analysis reveals why building costs 116x more than buying. Download the TCO calculator inside.

Dec 2
PromptMetrics Review (MVP): An Honest Look at Pros, Cons & The 2026 Launch
The Operator Shift · Izzy

PromptMetrics Review (MVP): An Honest Look at Pros, Cons & The 2026 Launch

Releasing Jan 2026: An honest preview of the PromptMetrics MVP. We analyze pros, cons, and why EU teams need this compliant LLM observability platform.

Nov 22
5 Critical LLM Prompt Management Mistakes EU Teams Make (2026 Guide)
Governance & the Human Gate · Izzy

5 Critical LLM Prompt Management Mistakes EU Teams Make (2026 Guide)

Learn how EU AI teams avoid version control chaos, compliance gaps, and cost overruns. Includes Python code examples, EU AI Act checklists (Articles 11 & 12), and testing frameworks.

Nov 19
How Much Does LLM Observability & EU AI Act Compliance Really Cost?
Governance & the Human Gate · Izzy

How Much Does LLM Observability & EU AI Act Compliance Really Cost?

How much does EU AI Act compliance cost? We compare build vs. buy, hidden fees, and show the ROI of an LLM observability platform to avoid €35M fines.

Nov 177 min
Newsletter

Field notes, in your inbox

One email per week. No content calendar — just what we’re building, what broke, and what we changed our minds about.

Community

Operator Stack

The free community where we continue these conversations between posts.