AI 开始自己研究自己了
过去是我们人盯着大模型看,试图搞懂它为什么这么聪明、又为什么会有那些怪毛病;现在,研究者造了个叫 Mechanist 的 AI 系统,让它自己去读论文、提假设、做实验,像科学家一样研究别的 AI。它读完了 4 千多万篇论文,自己发现了模型一个反直觉的安全隐患:模型在实验室里可能通过看似无害的训练数据,把危险能力从一种模态传到另一种。它还自己提出了关于模型如何形成信念、理解他人信念的理论,并且真的用这些发现去改进了模型的表现。这不是你明天能用上的工具,但它意味着 AI 研究 AI 这件事,从设想变成了能跑通的工作流。
📄 原文摘要(英文)
AI models have achieved remarkable success across diverse domains, yet the mechanisms underlying their capabilities and the risks they may pose remain poorly understood. As AI development becomes faster and increasingly automated, mechanistic exploration remains largely manual, widening the gap between what models can do and our ability to understand and control them. To bridge this gap, we introduce Mechanist, an agentic system that uses AI as a scientific instrument for the autonomous discovery of mechanisms underlying AI intelligence. To support autonomous mechanistic discovery, we construct an interpretability-focused knowledge graph of approximately 13,000 papers and integrate it with a multidisciplinary database of 43 million papers spanning 26 fields. We further curate a library of 32 foundational methods for mechanism analysis, causal intervention, and validation. Compared with Claude Code and existing AI-scientist systems, Mechanist generates more valuable mechanism hypotheses and executes experiments more reliably. Mechanist also demonstrates a progression from discovering model behaviors to explaining and controlling AI models. Specifically, Mechanist first uncovers a counterintuitive safety risk in scientific laboratories, showing that unsafe traits can transfer across modalities through apparently safe training data. Mechanist then develops a mechanism theory of belief, revealing how models represent world knowledge, form beliefs, infer the beliefs of others, and how these mechanisms emerge during pretraining. Finally, Mechanist translates these mechanistic insights into practical interventions that improve model performance across diverse scenarios and steer scientific foundation models toward generating DNA sequences with specified properties.