小模型也能干大活：GraphRAG引擎用7B模型击败32B
GraphRAG（图检索增强生成）是让AI结合结构化知识回答问题的技术，但现有系统一次提取就建知识图谱，噪声多、检索脆弱。RAGU引擎把提取和整合分开：先两阶段提取实体和关系，再用DBSCAN去重、LLM总结、社区检测，每一步都更干净。关键发现是：提取和推理所需的语言技能，模型大小影响不大，不像事实知识那样需要大模型。于是他们训练了一个7B参数的小模型Meno-Lite-0.1，在知识图谱构建上比32B的Qwen2.5-32B还强12.5%，在GraphRAG任务上持平。在医疗基准上，RAGU的证据召回率最高达0.84，而其他方法≤0.76。它不是你明天就能直接用的工具，但说明了一个趋势：未来AI系统可能不需要一味堆大模型，小而精的专用模型配合好架构就能超越大模型。
📄 原文摘要(英文)
Graph retrieval-augmented generation (GraphRAG) enhances large language models with structured knowledge, yet existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU, an open-source modular GraphRAG engine, addresses this by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection. A key insight motivates a compact extractor: the skills an in-pipeline LLM needs - comprehension, extraction, reasoning over context - are language skills that grow only weakly with model size, unlike factual world knowledge. Accordingly, we train Meno-Lite-0.1, a 7B model optimized for language skills, which outperforms Qwen2.5-32B on knowledge-graph construction (+12.5% relative harmonic mean) and matches it on English GraphRAG tasks. On GraphRAG-Bench (Medical), RAGU retrieves the most complete context at every factoid level (evidence recall up to 0.84 vs. leq0.76) and overtakes HippoRAG2 on synthesis tasks; on multi-hop factoid QA, the apparent HippoRAG2 advantage is shown to be largely an answer-format artifact. RAGU is installable via pip install graph_ragu, runs on a single GPU, and is released under MIT. The source code is publicly available at https://github.com/RaguTeam/RAGU, and the Meno-Lite-0.1 model can be obtained from https://huggingface.co/bond005/meno-lite-0.1.