8 Matching Annotations
  1. Last 7 days
    1. GLM-5.2 vs Claude Opus
      • Overview of GLM-5.2: It is Z.ai's latest flagship model, released with fully open weights under the permissive MIT license. It features a usable 1-million-token context window and dynamic capability routing via two thinking effort levels (High and Max).
      • Core Limitations: GLM-5.2 is strictly text-only and lacks multimodal capabilities. It cannot process or analyze visuals, screenshots, or user interface states natively.
      • Pricing Advantage: GLM-5.2 offers a substantial price reduction compared to top proprietary engines. Its API is priced at $1.40 per million input tokens and $4.40 per million output tokens, making its output generation over 5x cheaper than Claude Opus 4.8 ($5 input / $25 output).
      • Head-to-Head Testing (WebGL Game from Scratch): Both models were prompted to build a third-person 3D platformer game in raw WebGL without utilizing external 3D engine libraries (such as Three.js).
        • Claude Opus 4.8 Execution: Completed the build in 33 minutes and 30 seconds using ~217k output tokens ($21.92 estimated cost). It successfully implemented correct camera controllers, textures, animations, and valid win conditions.
        • GLM-5.2 Execution: Took 1 hour, 10 minutes, and 40 seconds using ~131k output tokens ($5.39 real billed cost). While it successfully coded advanced mechanics like spring launch velocity, it introduced basic structural bugs—such as rendering the player backwards, omitting character textures, and ignoring win states.
      • The Multimodal Verification Edge: Claude Opus leveraged its vision to inspect automated screenshots of the game, spotting and cleaning up debug overlays prior to completion. GLM-5.2 had to rely on a fallback script that sampled raw pixel colors; it verified the existence of the correct color palette but missed catastrophic visual rendering and layout bugs.
      • Benchmark Performance: Official metrics place GLM-5.2 directly between Claude Opus 4.7 and 4.8. It trails Opus 4.8 on multi-file reasoning, repository-level debugging, and complex software architectures (such as SWE-Marathon and DeepSWE), but matches or exceeds frontier models on core code generation, tool use (MCP-Atlas), and math benchmarks (AIME 2026).

      Hacker News Discussion

      • Orchestration and Tool Selection Over Model Scale: Commenters point out that the orchestration layer is becoming the primary differentiator in production AI. The core challenge for modern engineering agents is no longer raw token intelligence, but the ability to correctly navigate real-world toolchains and evaluate responses within complex environments.
      • Shift from Mainframe to PC Era in AI: The discussion highlights an architectural shift from monolithic central cloud APIs toward decentralized execution. Users emphasize that open-weight deployments give developers long-term vendor optionality and structural independence from platform deprecations or policy shifts.
      • High Compute and Output Latency Overhead: Multiple engineers note that while GLM-5.2 is remarkably smart for an open-weight model, it is highly token-hungry. Its extended reasoning traces can consume over 40k tokens and multiple minutes of thinking before outputting files, making inference speed an ongoing optimization bottleneck.
      • The Practical Value of Local and Managed Hosting: The community highlights that having an MIT-licensed model at this tier eliminates vendor lock-in risks. For developers without massive on-premise hardware setups (such as multi-H100 configurations) to serve a 756B parameter model, using cost-effective managed endpoints like OpenRouter provides the perfect balance of massive savings and immediate API access.
  2. Apr 2026
    1. In our own testing, the net effect is favorable—token usage across all effort levels is improved on an internal coding evaluation, as shown below—but we recommend measuring the difference on real traffic.

      Anthropic的"net effect is favorable"这一自我评估揭示了其内部评估的局限性。虽然他们在编码测试中观察到所有努力水平下的token使用率都有所改善,但这种"有利"判断是基于内部评估的,而非真实流量数据。这种自我衡量的"有利"可能忽略了实际应用中的复杂变量,如用户交互模式、任务多样性或长期成本效益。Anthropic建议在真实流量中测量差异,实际上暗示了内部测试与实际表现之间可能存在的差距,反映了AI模型评估中常见的理想化测试环境与真实世界应用之间的鸿沟。

    1. METR's confidence interval for Claude Opus 4.6 ranges from 5 hours to 66 hours.

      置信区间从 5 小时到 66 小时——这个跨度本身就令人震惊。5 小时和 66 小时是 13 倍的差距,却是对「同一个模型」的同一项测量。当一个数字被广泛引用为「Claude Opus 4.6 的时间地平线是 12 小时」时,真相是这个数字的不确定性区间宽达一个数量级。这是整个 AI 能力评测领域目前面临的核心危机:我们在用极度不精确的测量数字来驱动极其重要的决策。

  3. Feb 2026
    1. The real annoying thing about Opus 4.6/Codex 5.3 is that it’s impossible to publicly say “Opus 4.5 (and the models that came after it) are an order of magnitude better than coding LLMs released just months before it” without sounding like an AI hype booster clickbaiting, but it’s the counterintuitive truth to my personal frustration
    1. OpenClaw, like many other open-source tools, allows users to connect to different AI models via an application programming interface, or API. Within days of OpenClaw’s release, the team revealed that Kimi’s K2.5 had surpassed Claude Opus and became the most used AI model—by token count, meaning it was handling more total text processed across user prompts and model responses.

      Wow, I had no idea that Kimi 2.5 had subbed in for Claude Opus so quickly.

  4. Oct 2025
  5. May 2025
    1. anthropic's new AI model shows ability to deceive and blackmail

      for - progress trap - AI - blackmail - AI - autonomy - progress trap - AI - Anthropic - Claude Opus 4 - to - article - Anthropic Claude 4 blackmail and news leak - progress trap - AI - article - Anthropic Claude 4 - blackmail - rare behavior - Anthropic’s new AI model didn’t just “blackmail” researchers in tests — it tried to leak information to news outlets

  6. Apr 2022
    1. Some florilegia focused on poetic excerpts and were used to teach prosody, others specialized in prose. Both kinds were likely used in teaching at many levels—from the young boys (pueri) mentioned in the Opus prosodiacum of Micon Centulensis in the mid- ninth century to the twenty- year- old Heiric who wrote under dictation from Lupus of Ferrières, ca. 859–62, a Col-lectanea comprising excerpts from Valerius Maximus and Suetonius, followed by philosophical and theological sententiae.104

      Some florilegia were used as handbooks to teach composition. Those with poetic excerpts were used to teach prosody while others specialized in prose.

      Examples of these sorts of florilegia include Micon Centulensis' Opus prosodiacum from the mid-ninth century and a Collectanea by Heiric who wrote under dictation from Lupus of Ferrières, ca. 859–62.