Current models combine both raw intelligence and factual knowledge in the same weights. Future models will likely separate that, offloading a lot of knowledge to tool calling.
极具前瞻性的金句与架构预判。当前大模型将“推理”与“记忆/知识”耦合在参数中，导致模型臃肿且易产生幻觉。作者指出未来趋势是知识外挂化（通过RAG和工具调用），这不仅能大幅缩小本地模型体积，也是下一代AI架构设计的核心演进方向。