AI自己改自己,先过审计关
会自我进化的 AI 有个隐患:它给自己改的每一版看起来都更好,但「看起来」是它自己评的,而且只跟上一版比——退步可能藏在更早的基线里。这篇把「生成改动」和「批准改动」拆开:候选先冻结,再拿新样本做配对审计,必须在事先定好的主指标上有实打实的提升,同时用非劣检验守住原有能力不许掉,过了这几关才允许小范围灰度上线。他们还给出一套统计下界,专门对付「候选越多、评估者越乐观」这种系统性偏差。作者自己说清这是模拟实验,不是对真实部署智能体的评测,也不保证通用安全。它不是你明天能用上的东西——但如果你在等「AI 自己迭代自己」这件事变得可信,这是把闸门装上去的那类工作。
📄 原文摘要(英文)
Autonomous agents modify prompts, memories, tools, workflows, and policies using interaction histories. Yet a plausible modification is not necessarily suitable for persistent adoption: candidate selection is adaptive, evaluators may be imperfect, and local gains can hide degradation against an earlier baseline. We introduce Evidence-Governed Evolution (EGE), a framework for governing adoption of self-generated agent modifications. EGE separates candidate generation from confirmatory adoption, evaluates frozen candidates on fresh paired audits, requires meaningful improvement on a prespecified primary objective, protects declared capabilities through reference-relative non-inferiority tests, and applies governance constraints before bounded canary deployment. We establish an evaluator-calibrated simultaneous lower-bound construction for a countable sequence of adaptively generated candidates. It combines candidate-wise Hoeffding bounds with independent calibration samples comparing the operational evaluator with a prespecified reference procedure. We also formalise reference replacement through bridge tests, derive a cumulative degradation bound along a versioned reference lineage, and provide an audit-planning condition relating effect-size margin, sample sizes, and acceptance probability. A Monte Carlo stress test illustrates calibration under candidate-dependent evaluator optimism; it is a stylised statistical experiment, not an evaluation of a deployed agent. The guarantees are conditional on bounded paired scores, fresh sampling, a valid reference-evaluation construct, and declared evaluation distributions; they do not establish universal agent safety or robustness to arbitrary distribution shift.