AI Pulse
📄 论文解读

AI写作越费劲,答案越可能错

扩散式AI模型写东西时,每写一个词要花几次“思考”,而这次数不是固定的:抄写或小改输入很便宜,自由创作很贵——同一个模型,写故事比改语法要多花3倍以上的力气。更反直觉的是,这个“费力程度”还能当测谎仪用:同一道数学题,答错的答案比答对的更费劲;用解码速度给候选答案加权,比简单多数投票准确率高4.2分,还不用额外算力。它不是你明天能用上的,但给了一个新思路:AI的“犹豫”本身,就是判断它可不可信的免费信号。

📄 原文摘要(英文)

Diffusion language models can write several tokens in one forward pass, and they decide during generation how many passes to spend. Two outputs of the same token length can therefore vary a lot in cost. To understand the underlying factors of this cost variation, we analyze two diffusion models across 10 tasks. We find that the number of forward passes per token depends heavily on the task. Text copied or lightly edited from the input is cheap, while open-ended writing is costly. In DiffusionGemma, generating a token for story writing requires more than three times as many forward passes as for grammar correction. Two output properties explain much of this gap: how much of it is new relative to the input, and how rare its words are within the task. The same holds within a single response when thinking is involved. The final answer is cheap when it repeats the model's reasoning trace and costly when it adds something new. In multilingual generation, we find that highly tokenized languages also require more passes per token, adding to the cost they already pay with more tokens. Finally, cost tracks correctness: on the same math problem, wrong answers take more passes per token than correct ones, and weighting candidate answers by decoding speed beats majority voting by up to 4.2 points at no extra cost. Taken together, our results show that diffusion's computational advantage depends on how much of the output is already determined, while its decoding effort offers a practical signal for making inference more efficient and reliable.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新