AI Pulse
📄 论文解读

开会一小时,AI终于能数清谁在说话

现在的会议转写系统有个隐藏天花板:模型出厂时就固定了「最多几个人说话」的槽位,来第 5 个人它就装不下了。这篇不重训模型,而是等槽位用满后,在槽位内部再聚类,把「谁在说」和「什么时候说」拆开处理——槽位头继续管发言和重叠,身份则靠聚类不断修正。结果是说话人数不再有上限,一小时的会开下来也不会像旧系统那样错误越积越多,每次更新的成本还不随会议变长而涨。同一套做法还能把四槽的旧模型直接变成不限人数的系统。它离你最近的场景是:会议纪要、访谈整理、以及把大批录音档案按人串起来——这些活儿以前要么人数一多就崩,要么贵到做不起。

📄 原文摘要(英文)

Meetings last up to an hour, and nobody knows in advance how many people will speak. Neural diarizers with a fixed number of output slots, such as Streaming Sortformer and Nemotron-3, are accurate and run online, but they cannot name more speakers than they have slots. We remove this limit without retraining. The slot head keeps deciding who is active and when speech overlaps, and speaker embeddings are clustered inside a single slot, with the official e-means algorithm, only after every slot has been used. In the streaming system, re-clustering is confined to a bounded window, labels are revised for a few seconds, and identities are anchored to the slots of the head. The resulting system has no limit on the number of speakers and stays accurate when speakers outnumber the slots, where fixed-slot models break down. On meetings that grow to an hour it stays far more accurate than Streaming Sortformer, which accumulates errors, and its cost per update does not grow with the meeting. The same recipe turns the four-slot Streaming Sortformer into an open-speaker system. Across recordings, e-means makes it affordable to link the speakers of a large archive frame by frame, a task that arises when conversational corpora are prepared, and it reaches the clustering quality of Lloyd's k-means several times faster. The method needs little tuning, and e-means runs with its default recipe from a few hundred to more than a million embeddings.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新