AI Pulse
📄 论文解读

让聊天模型顺手折个蛋白质

一个通用大模型现在能直接吐出蛋白质的三维结构,而且靠的是它自己内部的「残基状态」,不是外挂一个专门的折叠模型。做法是:Qwen3.5-9B 读入带 ESM2 特征的氨基酸序列,当它决定折叠时,就发出一个特殊 token,调用一个预训练好的结构头;这个结构头只能通过 Qwen 的残基状态看到这条蛋白,信息全从语言模型这边过。在固定折叠请求下,结构头在 FoldBench-334 开发集上平均 TM-score 0.808,CASP16 结构域 0.635,CAMEO 风格 PDB 集 0.900。和「ESM2-3B 编码 + 微调 SimpleFold-3B 头」的基线比,100–299 残基的链三组配对置信区间都跨零,300–600 残基则平均低 0.044、0.160、0.025。另外四种英文请求都能稳定触发折叠;但蛋白训练把 MMLU-Pro 350 题子集从 77.4% 拉到 70.3%。复合物预测、结构理解、以及语言推理到底怎么影响坐标,都还没做。它不是你明天能用上的东西:长链还不如专用模型,通用能力还掉了分,离「一个模型什么都会」还有距离。

📄 原文摘要(英文)

Biomolecular foundation models predict the structures of proteins and their complexes accurately, and large language models (LLMs) reason in natural language, but the two remain separate: the abilities of the former are not part of a general-purpose LLM, and the reasoning of the latter does not enter a structure prediction. Calpha aims at one general model that folds proteins and complexes, understands protein sequence and structure, and lets its language reasoning influence the structures it predicts. This report covers the first step, in which an LLM outputs single-chain protein structures. Qwen3.5-9B reads a sequence enriched with ESM2 residue features. It can respond in text or emit a token that invokes a pretrained SimpleFold structure head, which receives information about the protein only through Qwen's residue states. Under a fixed folding request, the head achieves mean TM-scores of 0.808 on the FoldBench-334 development set, 0.635 on CASP16 domains and 0.900 on a CAMEO-style PDB set. We compare these predictions with a baseline in which ESM2-3B encodes the sequence and a fine-tuned SimpleFold-3B head predicts the coordinates. The two systems also differ in trainable weights, training duration and crop length. For chains of 100--299 residues, all three paired confidence intervals include zero. At 300--600 residues, the mean differences are -0.044, -0.160 and -0.025, respectively. In a separate test, four English request types triggered folding on every evaluated example. Protein training reduced accuracy on a 350-item MMLU-Pro subset from 77.4% to 70.3%. An LLM can therefore output single-chain structures from its own states, with lower long-chain scores in the current comparisons and reduced accuracy on the evaluated MMLU-Pro subset. Complex prediction, structure understanding and the effect of language reasoning on the predicted coordinates remain future work.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新