Token efficiency is the number I actually optimize for — resolution rate matters, but a harness that burns 30% fewer tokens on equivalent tasks gives you more iterations and richer context before hitting limits. Would be interested to see this breakdown per-model rather than per-harness; same harness with different models can have very different efficiency profiles.
5 Matching Annotations
- Last 7 days
-
www.reddit.com www.reddit.com
-
-
There's no point in comparing that. As long as you use a model and harness from the same company, it will always be cheaper than relying on middlemen like Microsoft. But the more expensive AI gets, the more people will do Bring Your Own Key or host their own models. In that case, the efficiency of the harness is very important to know.
-
- Sep 2026
-
periodic.com periodic.com
-
Periodic Neon is an early example: using our lab data, we trained a trillion-parameter model that outperforms GPT-6 Astra on a critical scientific analysis task using relatively little compute.
【数据】这一声明提供了具体的性能比较数据,表明他们的1T参数模型在特定科学分析任务上优于GPT-6 Astra,且计算资源消耗较少。这暗示了针对科学领域优化的模型可能比通用大模型更高效,但缺乏具体的性能指标提升百分比和计算资源消耗的具体数值,使得这一声称的可验证性有限。
-
- Apr 2026
-
-
Eight out of eight models detected Mythos's flagship FreeBSD exploit, including one with only 3.6 billion active parameters costing $0.11 per million tokens.
这是一个令人惊讶的发现,表明即使是小型、廉价的模型也能实现与昂贵的专有模型相当的安全漏洞检测能力。这挑战了AI安全领域需要最前沿模型的假设,暗示了经济高效的AI安全解决方案的可能性。
-
-
www.tomtunguz.com www.tomtunguz.com
-
In 23 months, the same capability that needed 1.8 trillion parameters now fits in 4 billion parameters. A 450x compression.
大多数人认为AI模型性能提升主要依靠参数数量增加,但作者认为通过算法优化和人才聚集,AI模型可以实现450倍的参数压缩,这挑战了'更大参数等于更好性能'的行业共识。
-