A single instruction in an AI agent's error message caused permanent refusal behavior
A developer discovered that a "Do not try to work around this" instruction embedded in a tool's error message caused an AI agent to permanently refuse a task, even after the relevant capability was later granted. Because AI models have no persistent memory and resend the full conversation transcript each turn, the error message — and its embedded rule — was re-read and obeyed on every subsequent interaction. The developer found that tool error messages function as persistent state, not transient notifications, meaning any rules written inside them outlive the conditions that produced them. The fix involved rewriting error messages as time-scoped facts rather than standing instructions, and moving authoritative capability status into the system prompt, which is rebuilt fresh on every run. The case illustrates a broader principle: rules embedded in tool results can silently override intended agent behavior long after the original situation has changed.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in