independently reproducing the findings of published scientific papers without being told the answer in advance.
论文复现是个评分主观性很强的任务：选哪些论文、算不算复现成功、允许多少次尝试，都由出题方定。本文的成绩、对照组和评判标准全部来自公司自己的博客与推文，TechCrunch 未做独立核验，也没有第三方榜单可比。当成一次自评 demo 读更稳妥。
7 Matching Annotations
- Aug 2026
-
techcrunch.com techcrunch.com
-
- Apr 2026
-
arxiv.org arxiv.org
-
The results demonstrate consistent improvements over strong baselines, supporting the effectiveness of agent resource management and closed loop self evolution.
虽然大多数AI研究者相信自我演化能带来性能提升，但很少有人能够证明这种提升在多个具有挑战性的基准测试中持续超过强大的基线模型。作者声称他们的AGS系统不仅实现了自我演化，而且这种演化是闭环的、可审计的，这挑战了当前AI社区对自我演化系统的认知，暗示了更加结构化的演化方法可能比开放式的演化更有效。
-
-
www.anthropic.com www.anthropic.com
-
tuning a standalone evaluator to be skeptical turns out to be far more tractable
深刻揭示了LLM自我评价的局限性：生成器难以对自身工作保持批判性。通过解耦生成与评估，并刻意调优独立评估器的“怀疑态度”，能有效打破AI自嗨的闭环。这种对抗式架构是提升输出质量的强效杠杆。
-
- Oct 2023
-
arxiv.org arxiv.org
-
Quantitatively, SPRING with GPT-4 outperforms all state-of-the-art RLbaselines, trained for 1M steps, without any training.
Them's fighten' words!
I haven't read it yet, but we're putting it on the list for this fall's reading group. Seriously, a strong result with a very strong implied claim. they are careful to say it's from their empirical results, very worth a look. I suspect that amount of implicit knowledge in the papers, text and DAG are helping to do this.
The Big Question: is their comparison to RL baselines fair, are they being trained from scratch? What does a fair comparison of any from-scratch model (RL or supervised) mean when compared to an LLM approach (or any approach using a foundation model), when that model is not really from scratch.
-
- Oct 2022
-
physicstoday.scitation.org physicstoday.scitation.org
-
To be a successful physicist requires mastering how to make all 29 decisions, but the reflection decisions (decisions 23–26) are arguably the most difficult to learn.
Of the 29 problem solving decisions identified as important the three "reflection decisions" (23-26 in the list) may be the most difficult to learn as they require metacognition and self-evaluation.
-
- Jun 2020
-
psyarxiv.com psyarxiv.com
-
Spreckelsen, P. von, Wessel, I., Glashouwer, K., & Jong, P. J. de. (2020). Preprint Averting Repulsion? Body-Directed Self-Disgust and Autobiographical Memory Retrieval. https://doi.org/10.31234/osf.io/qhc35
-
-
psyarxiv.com psyarxiv.com
-
Midgley, C., Thai, S., Lockwood, P., Kovacheff, C., & Page-Gould, E. (2020). When Every Day is a High School Reunion: Social Media Comparisons and Self-Esteem [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/zmy29
-