谷歌开源Gemma 4：小模型也能思考推理
谷歌刚开源的Gemma 4系列模型，最反直觉的一点是：最小的模型只有2.3B参数，却加入了“思考模式”——在回答前先生成推理链条。这意味着你可以在手机或笔记本上跑一个会“先想后答”的AI，而不必依赖云端巨模型。Gemma 4提供了多种架构：从2.3B到31B参数，既有传统的密集模型，也有更高效的混合专家模型。其中12B版本采用统一的无编码器架构，能直接处理原始音频和图像块，无需单独的视觉或音频编码器。所有模型都改进了视觉和音频编码器，并优化了推理速度、内存和长上下文能力。在STEM、多模态和长上下文基准测试中，Gemma 4性能大幅提升，甚至能媲美更大规模的开放模型。它不是你明天就能直接用的产品，但标志着开源AI在效率和推理能力上的重要一步——小模型也能具备深度思考能力。
📄 原文摘要(英文)
We introduce Gemma 4, a new generation of open-weight, natively multimodal language models in the Gemma model family. Designed to advance compute efficiency and reasoning, the Gemma 4 model suite features dense and Mixture-of-Experts architectures, ranging from 2.3B to 31B parameters. Alongside improved vision and audio encoders for all model sizes, we propose a unified, encoder-free architecture for our 12B model, which ingests raw audio and image patches. Furthermore, we integrate a thinking mode, enabling Gemma models to generate reasoning traces prior to responding. We improve inference speed, memory, and compute efficiency, as well as long-context abilities through critical design choices. Gemma 4 establishes a leap in performance across STEM, multimodal, and long-context benchmarks, and rivals larger, frontier open models in human-rated tasks.