Classic scaling laws assume effectively _unlimited unique data_, no repetition, and no multi-epoch training.
经典缩放定律假设有无限独特数据，这在现实中几乎不可能。初学者常忽略数据有限性对模型训练的影响，导致过度依赖理论预测。实际应用中需考虑数据重复、质量有限等因素对缩放定律的影响。
9 Matching Annotations
- Jun 2026
-
lilianweng.github.io lilianweng.github.io
-
- May 2026
-
cruxevals.com cruxevals.com
-
AI Village gives multiple AI agents their own computer environments and a shared group chat, then tasks them with open-ended real-world goals like fundraising, organizing events, making games, and gaining subscribers.
这个案例展示了开放世界评估的实际应用，每年约5万美元的成本表明这种评估需要相当大的资源投入。相比传统基准测试，这种评估方式更接近真实应用场景，但也因此成本更高，难以大规模实施。
Tags
Annotators
URL
-
- Apr 2026
-
www.theaivalley.com www.theaivalley.com
-
The model reportedly scored 93.9% on SWE-bench Verified and 77.8% on SWE-bench Pro, but its strongest signal came from real-world results, including uncovering a 27-year-old flaw in OpenBSD, a 16-year-old vulnerability in FFmpeg, and autonomously chaining Linux kernel exploits without human input.
这些惊人的安全漏洞发现能力表明AI已经超越了传统安全工具，能够自主发现几十年未被发现的漏洞。特别是能够自主链接Linux内核漏洞的能力，展示了AI在网络安全领域的革命性潜力，这可能彻底改变安全研究和漏洞修复的方式。
-
- Feb 2022
-
twitter.com twitter.com
-
Deepti Gurdasani. (2022, January 10). Lots of people dismissing links between COVID-19 and all-cause diabetes. An association that’s been shown in multiple studies- whether this increase is due to more diabetes or SARS2 precipitating diabetic keto-acidosis allowing these to be diagnosed is not known. A brief look👇 [Tweet]. @dgurdasani1. https://twitter.com/dgurdasani1/status/1480546865812840450
-
- Jan 2022
-
www.nejm.org www.nejm.org
-
Olson, S. M., Newhams, M. M., Halasa, N. B., Price, A. M., Boom, J. A., Sahni, L. C., Pannaraj, P. S., Irby, K., Walker, T. C., Schwartz, S. P., Maddux, A. B., Mack, E. H., Bradford, T. T., Schuster, J. E., Nofziger, R. A., Cameron, M. A., Chiotos, K., Cullimore, M. L., Gertz, S. J., … Randolph, A. G. (2022). Effectiveness of BNT162b2 Vaccine against Critical Covid-19 in Adolescents. New England Journal of Medicine, 0(0), null. https://doi.org/10.1056/NEJMoa2117995
-
-
www.medrxiv.org www.medrxiv.org
-
Tseng, H. F., Ackerson, B. K., Luo, Y., Sy, L. S., Talarico, C., Tian, Y., Bruxvoort, K., Tupert, J. E., Florea, A., Ku, J. H., Lee, G. S., Choi, S. K., Takhar, H. S., Aragones, M., & Qian, L. (2022). Effectiveness of mRNA-1273 against SARS-CoV-2 omicron and delta variants (p. 2022.01.07.22268919). https://doi.org/10.1101/2022.01.07.22268919
-
- Dec 2021
-
www.medrxiv.org www.medrxiv.org
-
Simon, M. A., Luginbuhl, R. D., & Parker, R. (2021). Reduced Incidence of Long-COVID Symptoms Related to Administration of COVID-19 Vaccines Both Before COVID-19 Diagnosis and Up to 12 Weeks After (p. 2021.11.17.21263608). https://doi.org/10.1101/2021.11.17.21263608
-
- May 2021
-
psyarxiv.com psyarxiv.com
-
Westgate, Erin, Nick Buttrick, Yijun Lin, and Gaelle Milad El Helou. ‘Pandemic Boredom: Predicting Boredom and Its Consequences during Self-Isolation and Quarantine’. PsyArXiv, 11 May 2021. https://doi.org/10.31234/osf.io/78kma.
-
- Jan 2018
-
mattheneus-healthcare.com mattheneus-healthcare.com
-
big data solutions for cardiovascular and oncological research.
big data solutions for cardiovascular and oncological research.
-