Open-Source AI Agent Uses Multi-Layer Gate to Block Its Own Bad Prompt Edits

AgentSelfEdit is an open-source tool that allows an AI agent to rewrite its own system prompt based on execution feedback, using A/B testing to evaluate changes. By version 0.3.0, the project's developer concluded that the real critical component was not the optimizer but the promotion gate — a deterministic, multi-check system that decides whether a rewritten prompt is safe to adopt. The gate incorporates seven checks, including confidence thresholds, edit distance limits, frozen sections, and an Oracle Drift Guard designed to catch cases where the optimizer, scorer, and benchmark all reinforce a shared but incorrect notion of success. Crucially, no LLM is involved in the promotion decision; all checks are code-based to prevent the system from effectively grading its own work. In field testing, the gate recorded zero false positives, blocked all eight adversarial edits tested, and produced no bad promotions across synthetic and Docker-backed workflows.