AI 开始自己研究自己了
过去是科学家手动拆解 AI 的“黑箱”,现在 AI 自己动手了。研究者造了个叫 Mechanist 的智能体,让它自主提出关于模型如何思考的假设、设计实验验证、并给出干预方案。它先发现了一个反直觉的安全隐患:看似无害的训练数据,可能让模型跨模态传递危险特质;随后又发展出一套“信念机制”理论,解释模型如何表征世界知识、推断他人信念,并把这些洞见转化为实际改进,甚至能引导模型生成指定属性的 DNA 序列。这不是你明天能用的工具,但它标志着 AI 研究的一个转折:理解 AI 这件事,正在从人类的手工活变成 AI 的自动化流水线。
📄 原文摘要(英文)
AI models have achieved remarkable success across diverse domains, yet the mechanisms underlying their capabilities and the risks they may pose remain poorly understood. As AI development becomes faster and increasingly automated, mechanistic exploration remains largely manual, widening the gap between what models can do and our ability to understand and control them. To bridge this gap, we introduce Mechanist, an agentic system that uses AI as a scientific instrument for the autonomous discovery of mechanisms underlying AI intelligence. To support autonomous mechanistic discovery, we construct an interpretability-focused knowledge graph of approximately 13,000 papers and integrate it with a multidisciplinary database of 43 million papers spanning 26 fields. We further curate a library of 32 foundational methods for mechanism analysis, causal intervention, and validation. Compared with Claude Code and existing AI-scientist systems, Mechanist generates more valuable mechanism hypotheses and executes experiments more reliably. Mechanist also demonstrates a progression from discovering model behaviors to explaining and controlling AI models. Specifically, Mechanist first uncovers a counterintuitive safety risk in scientific laboratories, showing that unsafe traits can transfer across modalities through apparently safe training data. Mechanist then develops a mechanism theory of belief, revealing how models represent world knowledge, form beliefs, infer the beliefs of others, and how these mechanisms emerge during pretraining. Finally, Mechanist translates these mechanistic insights into practical interventions that improve model performance across diverse scenarios and steer scientific foundation models toward generating DNA sequences with specified properties.