47 Matching Annotations
  1. Last 7 days
    1. Because a scaling law is only fit on the (relatively small, relatively cheap) models that we can afford to train, and the prediction is _extrapolated_ for a model orders of magnitude larger.

      缩放定律拟合基于小型模型,但预测用于大型模型,这种外推可能导致巨大误差。初学者常低估外推的不确定性,导致资源分配不当。实践时应谨慎使用外推结果,并在可能的情况下进行实际验证。

  2. Jun 2026
    1. Those deals with Anthropic and Google have relatively favorable termination clauses for SpaceX, so if SpaceX's enterprise AI efforts take off and see high demand, it will theoretically be possible to reallocate compute from competitors directly to SpaceX and the Cursor team.

      大多数人认为科技公司之间的合作是稳定的,但作者暗示SpaceX与Anthropic和Google的交易实际上是为未来可能的'计算资源劫持'铺路。这种观点挑战了传统商业合作的互信基础,暗示SpaceX可能利用这些协议作为跳板,最终从竞争对手那里重新分配计算资源,这违背了常规商业合作逻辑。

  3. May 2026
    1. OpenAI选择砍掉视频应用,把算力集中到GPT-5.5的Agent架构和Codex代码工具上

      这反映了OpenAI的资源分配决策,表明他们认为当前视频生成领域的架构效率不足。这一决策暗示了公司对技术路线的判断,即Agent架构和代码工具可能比视频生成更具商业和技术价值。这种战略转向将影响整个AI行业的资源分配和研发重点。

    1. Google fellow John Jumper, who won the Nobel for AlphaFold, is now working on AI coding, not on science-specific AI tools

      大多数人认为像AlphaFold这样获得诺贝尔奖的科学AI工具会继续成为研发重点,但作者暗示Google正在将资源从专门化的科学AI工具转向通用AI代理系统,因为编码能力对自主研究系统更为关键。这表明公司战略正从特定领域解决方案转向更通用的科学AI。

  4. Apr 2026
    1. Commoditizing complements doesn't always work because focus is scarce even for the largest, fastest growing businesses.

      大多数人认为科技巨头拥有无限资源实施各种战略,但作者指出即使是最大、增长最快的企业也面临注意力稀缺问题。这一观点挑战了规模经济理论,暗示过度扩张可能导致核心竞争力的稀释。

    2. Commoditizing complements doesn't always work because focus is scarce even for the largest, fastest growing businesses.

      大多数人认为科技巨头拥有无限资源可以实施任何战略,但作者指出即使是最大的企业也面临注意力稀缺问题。这与对科技巨头的普遍认知相悖,暗示规模优势也有其局限性。

    1. Structure: $500M OpenAI equity plus $4B from TPG, Bain, Advent, Brookfield, and Goanna form a $10B LLC.

      DeployCo的结构显示OpenAI出资5亿美元(占总资金的5%),而PE firms出资40亿美元(40%),形成总计100亿美元的LLC。这种资本结构表明OpenAI虽然拥有超级投票权,但在资金贡献上处于次要位置,主要依靠PE firms的渠道网络来推广其产品。

    1. At our request, the underwriters have reserved up to _______% of the shares of Class A common stock offered by this prospectus for sale at the initial public offering price through a directed share program to certain persons identified by our management and certain long-tenured employees, which may include parties with whom we have a business relationship and friends and family of management and such employees.

      大多数人认为IPO分配应该基于市场机制和机构投资者需求,但Cerebras预留大量股份给管理层、员工及其关系网络。这挑战了IPO公平分配的普遍认知,暗示公司可能优先考虑内部人利益而非最大化股东价值。

    1. The real bottleneck in AI right now is not compute but rather data quality

      这一论点颠覆了当前AI行业对计算资源投入的过度关注,提出了一个令人惊讶的视角:我们可能一直在解决错误的问题。如果数据质量是真正瓶颈,那么整个AI研发的重点需要重新评估。

  5. Sep 2024
  6. Jul 2023
  7. May 2023
  8. Feb 2023
    1. La mise en place d’une telle « allocation d’autonomie » est défendue en France91 depuis la Charte de Grenoble de 1946 par des organisations comme l’Union nationale des étudiants de France, mais n’a jamais été réalisée. La mesure a failli être adoptée en 1951, alors que « la commission de l’Éducation nationale de l’Assemblée nationale avait ainsi adopté à l’unanimité le rapport Cayol en faveur d’une rémunération étudiante92 ». Le refus d’adopter la mesure en France s’expliquerait notamment par l’influence croissante de la théorie du capital humain néolibérale qui présente l’étudiant·e comme un investisseur en lui-même93. Le salariat étudiant était encore revendiqué en 2018 en France (ainsi qu’au Québec par les Comités unitaires sur le travail étudiant94) et l’idée a été notamment reprise par le candidat présidentiel Jean-Luc Mélenchon à la suite de l’immolation d’un étudiant pour cause de précarité (celui-ci avait écrit un texte revendiquant le salariat étudiant avant de poser son geste). Mélenchon proposait dans sa plateforme une allocation de 800 euros par mois95.
  9. Aug 2022
  10. Nov 2021
  11. Oct 2021
    1. Sun, W., Liu, Y., Amanat, F., González-Domínguez, I., McCroskery, S., Slamanig, S., Coughlan, L., Rosado, V., Lemus, N., Jangra, S., Rathnasinghe, R., Schotsaert, M., Martinez, J. L., Sano, K., Mena, I., Innis, B. L., Wirachwong, P., Thai, D. H., Oliveira, R. D. N., … Palese, P. (2021). A Newcastle disease virus expressing a stabilized spike protein of SARS-CoV-2 induces protective immune responses. Nature Communications, 12(1), 6197. https://doi.org/10.1038/s41467-021-26499-y

  12. Aug 2021
  13. May 2021
  14. Jan 2021
  15. Dec 2020
  16. Sep 2020
  17. Aug 2020
  18. Jul 2020
  19. Jun 2020
  20. May 2020
  21. Aug 2017
  22. Jan 2014
    1. Having made these points many times in the last few years, I've realized that the fundamental problem is in the mistaken belief that the type system has anything whatsoever to do with the storage allocation strategy. It is simply false that the choice of whether to use the stack or the heap has anything fundamentally to do with the type of the thing being stored. The truth is: the choice of allocation mechanism has to do only with the known required lifetime of the storage.

      The type system has nothing to do with the storage allocation strategy; the choice of allocation mechanism has to do only with the known required lifetime of the storage.

    1. If we’re in that situation when new memory is allocated then the “high water mark” is bumped up, eating up some of the previously “free” portion of the block. The newly-reserved memory is then usable for the reference type instance that has just been allocated. That is extremely cheap; just a single pointer move, plus zeroing out the newly reserved memory if necessary.