The models are finally ready. Costs of inference are getting optimized with open models, and even on-device models.
大多数人认为AI领域仍然处于早期阶段,模型成本高且实用性有限,但作者认为模型已经'准备就绪',推理成本正在优化,这一观点暗示AI应用可能比大多数人预期的更快进入实用阶段,挑战了行业对AI成熟度的普遍认知。
The models are finally ready. Costs of inference are getting optimized with open models, and even on-device models.
大多数人认为AI领域仍然处于早期阶段,模型成本高且实用性有限,但作者认为模型已经'准备就绪',推理成本正在优化,这一观点暗示AI应用可能比大多数人预期的更快进入实用阶段,挑战了行业对AI成熟度的普遍认知。
We now appear to be entering the era of token rationing.
大多数人认为AI技术会持续扩大应用范围,企业会越来越依赖AI。但作者认为我们正进入'配给token'的时代,这与主流认知中AI技术将无限扩张的观点相悖。这种配给制反映了企业对AI成本效益的重新评估。
The nuances of tuning the carburetors & the timing belts of these complex beasts are tasks better assigned to a few vendors to deliver maximum intelligence per dollar & amortize the costs across a broader population.
作者将AI系统比作复杂的机械,需要精细调整(化油器和正时皮带)。他建议将这种专业任务交给少数供应商,以实现每美元最大智能回报并分摊成本。这反映了AI应用开发的专业化和集中化趋势,对初创企业考虑是否自建AI能力有重要启示。
Even though per-token prices have fallen, the push for more AI adoption and increasingly autonomous agents have driven token consumption higher and higher.
大多数人认为AI成本下降会使AI应用更经济实惠,但作者认为尽管单位token价格下降,但AI使用量激增导致总成本反而上升。这与大多数人对AI成本下降的预期相悖,揭示了行业面临的成本悖论。
At a time when many companies are blowing through their AI budgets, those token cost savings have become a major selling point for the company.
AI budget anxiety is becoming a real enterprise procurement signal — and Glean is one of the first companies to explicitly sell against it. This suggests the AI adoption cycle is entering a cost-optimization phase: the early 'try everything' enthusiasm is giving way to CFO scrutiny of LLM spend, which favors solutions that promise efficiency over raw capability.
Even the most valuable companies in the world cannot afford state-of-the-art intelligence for every conceivable use case.
大多数人认为顶级科技公司有无限资源可以采用最先进的AI技术,但作者认为即使是全球最有价值的企业也负担不起所有场景的最先进AI,因为成本效益比已经变得不可持续。这挑战了'大公司可以无限制采用新技术'的常识认知。
Uber capped employee AI spending after blowing through its budget in four months.
大多数人认为大型科技公司有充足的财务缓冲来支持AI采用,但作者认为即使是像Uber这样的大公司也难以承受AI成本,导致预算迅速耗尽。这挑战了'大公司有无限AI预算'的普遍认知,揭示了AI成本问题的普遍性。
Benchmarks are now measured on two different dimensions, the overall performance & the cost to achieve that intelligence.
大多数人认为AI评估主要关注性能指标,但作者认为评估标准已经转变为双重维度:性能和成本。这挑战了AI行业长期以来只关注性能的评估传统,暗示成本效率将成为与性能同等重要的评估标准。
Even the most valuable companies in the world cannot afford state-of-the-art intelligence for every conceivable use case.
大多数人认为顶级科技公司有无限资源可以采用最先进的AI技术,但作者认为即使是全球最有价值的企业也负担不起在最广泛场景中使用最先进AI,因为AI成本已经变得不可持续。这挑战了'大公司可以无限制采用新技术'的常规认知。
Even the most valuable companies in the world cannot afford state-of-the-art intelligence for every conceivable use case.
大多数人认为顶级科技公司可以无限负担最先进的AI技术,但作者认为即使是全球最有价值的企业也无法负担所有场景下的尖端AI,因为实际使用成本远超预期。这挑战了'大公司有无限资源'的普遍认知,揭示了AI经济性的现实约束。
Running every query through Opus 4.7 is the fastest path to negative gross margins. The best Rest of Oz companies route across tiers of models — frontier models for the hardest tasks, mid-tier for the bulk, smaller custom or fine-tuned models where they've earned the right to use them.
大多数人认为使用最先进的大模型总是最佳选择,能提供最佳结果。但作者认为这是通往负毛利的最快路径。相反,'Oz的其他部分'公司会根据任务难度分层使用不同级别的模型,只为最困难的任务使用前沿模型,为批量任务使用中等模型,为特定工作使用小型定制或微调模型。这种成本优化策略使它们能够提供更具竞争力的价格。
The Scientist AI is going to be trained using essentially the same machine learning techniques: stochastic gradient descent on large neural nets, transformers, whatever works best. It doesn't care about what is the architecture of the neural net. So all of the effort that is currently being done to improve, for example, memory and other properties and continual learning, can just be applied directly to the Scientist AI.
Bengio解释Scientist AI将使用与现有模型相同的基础技术,这意味着实现成本不会显著增加,打破了安全与能力必须取舍的常见假设,为安全AI提供了实用路径。
The benchmark tasks were meticulously constructed to be realistic, involving the hard work of hundreds of experts and likely millions of dollars — placing it among the most expensive economics papers of all time.
作者提到GDPval基准测试可能花费了数百万美元,由数百名专家参与构建。这一数据点显示了AI基准测试的高昂成本,但也暗示了这类测试可能存在资源分配不均的问题。考虑到其成本与实际经济影响之间的差距,这种高投入低产出的现象值得反思。
When our engineers no longer spend time supervising Codex sessions, the economics of code changes completely. The perceived cost of each change drops because we're no longer investing human effort in driving the implementation itself.
大多数人认为AI编程会增加监督成本,但作者认为通过Symphony系统,人类监督成本实际上大幅下降,因为AI能够自主完成大部分实现工作。这个观点挑战了人们对AI编程成本结构的普遍认知,暗示正确的AI编排可能根本性地改变软件开发的经济模型。
Resolution increases make them more expensive, then efficiency gains reduce costs - a sawtooth pattern.
大多数人可能认为AI成本会呈现单调下降或上升的趋势,但作者提出'锯齿状'模式,即精度提升导致成本上升,然后效率提升又降低成本。这种波动性挑战了人们对技术成本发展的常规预期。
This is the part people miss about AI-native companies - the $113k is not a cost, it is your headcount budget allocated differently.
大多数人认为AI成本是额外的支出,但作者认为AI成本实际上是对人力预算的重新分配。这挑战了传统成本会计观念,暗示AI不是成本而是投资,但也可能低估了AI实际成本和维护的复杂性。
The extra tokens bought something measurable. +5pp on strict instruction-following. Small. Real. So: is that worth 1.3–1.45x more tokens per prompt?
这是一个令人惊讶的价值权衡案例。Anthropic用高达45%的token成本增加,只换来了5个百分点的指令遵循提升。这种不成比例的交换表明,在AI模型优化中,'微小但真实'的改进可能需要付出巨大成本,这挑战了人们对技术改进应该'物有所值'的普遍假设。
Eight out of eight models detected Mythos's flagship FreeBSD exploit, including one with only 3.6 billion active parameters costing $0.11 per million tokens.
这是一个令人惊讶的发现,表明即使是小型、廉价的模型也能实现与昂贵的专有模型相当的安全漏洞检测能力。这挑战了AI安全领域需要最前沿模型的假设,暗示了经济高效的AI安全解决方案的可能性。
As the cost of software development falls, trusted partners with broad adoption can expand faster than anyone else.
在开发成本下降的背景下,广泛采用和信任成为扩张的关键因素,这暗示AI时代的赢家可能不是技术最先进的,而是能够最快建立信任生态系统的公司。
未来的评估体系,必须同时考虑:成功率、成本、延迟。这有点类似于对于云计算的考核标准,而不是传统软件。
这一观点揭示了AI技能评估需要引入新的维度,特别是成本因素,这反映了AI时代的独特挑战,也暗示未来技能市场可能会出现基于资源消耗的定价机制,这与传统软件市场有本质区别。
Performance: dev-browser: 3m53s, $0.88, 100% success rate — beats MCP configs, Chrome extensions, 'browser skill' stacks.
令人惊讶的是:这种新技术不仅在功能上超越传统方法,在性能指标上也取得了显著优势,100%的成功率和相对较低的成本显示了其技术成熟度和实用性,这可能会使现有的浏览器自动化解决方案迅速过时。
that's what anthropic says it cost Mythos to find those zero days. per repo.
令人惊讶的是:Anthropic声称每次代码库扫描要花费2万美元来发现零日漏洞,这个价格远高于人们对于代码安全审计成本的预期,揭示了AI安全分析的高昂门槛。
It defines a frontier model as any AI model trained using more than $100 million in computational costs, which likely could apply to America's largest AI labs, like OpenAI, Google, xAI, Anthropic, and Meta.
令人惊讶的是:训练一个前沿AI模型的成本竟然高达1亿美元以上,这凸显了AI研发的惊人投入门槛。只有少数科技巨头能够负担如此高昂的计算成本,这可能正在重塑AI行业的竞争格局,形成新的技术垄断。
Total cost: ~$29 ($20 in CPU VMs, $9 in API calls) over ~3 hours with 4 VMs.
令人惊讶的是:仅花费29美元和3小时,AI代理就实现了显著的性能提升(x86上提升15.1%,ARM上提升5%)。这种低成本高效能的优化方式颠覆了传统认为高性能优化需要大量人力和时间的观念。
Artificial Analysis has also positioned Gemini 3.1 Flash TTS within its 'most attractive quadrant' for its ideal blend of high-quality speech generation and low cost.
令人惊讶的是:这个模型不仅质量高,而且成本效益也非常出色,在'最具吸引力象限'中占据一席之地。这表明Google在平衡AI性能和商业可行性方面取得了显著突破,这对大多数用户来说是意想不到的。
since reasoning models and agentic AI can rack up quite a bill
文章提醒了一个常被忽视的约束条件:AI的使用成本。在讨论AI替代人类时,人们往往默认AI是低成本方案,但推理模型和智能体的高昂算力成本意味着,仅凭能力覆盖并不等于经济上的可行替代,成本收益分析仍是决定性门槛。
The cost of understanding what happens in a video has dropped by a factor of roughly 40, while the quality of that understanding has improved dramatically.
大多数人认为AI视频分析仍处于早期阶段且成本高昂,但作者指出AI视频分析成本已大幅下降40倍,质量反而提升。这一反直觉观点暗示视频分析可能已经跨越了实用性的门槛,将催生全新的应用类别,挑战了人们对AI视频处理能力的传统认知。
By using SAM, the Alta team has been able to process more than 20 million images without incurring exorbitant costs, allowing them to focus on building the best possible product for their users.
大多数人可能认为初创公司需要依赖昂贵的第三方API来处理大量图像,但作者通过使用开源SAM模型,实现了大规模图像处理而不产生巨额成本。这一观点挑战了'高质量AI服务必须昂贵'的行业共识,展示了开源模型在成本效益方面的优势。
For a socially and economically sustainable growth path, the labor displacement in the sectors ofapplication must be counterbalanced by job creation within the same and other sector
it's 2023 and I don't see anyone planning for this massive job displacement, I think that the hollywood strikes are a sign of things to come