Fisher-Rao Quantization-Aware Distance (FRQAD) -- a new metric on the Gaussian statistical manifold achieving 100% precision at preferring high-fidelity embeddings over quantized ones (vs 85.6% for cosine), with zero prior art.
这项声称100%精度的FRQAD指标令人惊讶，因为它远超传统余弦相似度的85.6%。如果属实，这将彻底改变我们处理嵌入向量压缩和相似度计算的方式，挑战当前广泛使用的余弦相似度在信息检索领域的统治地位。
In 23 months, the same capability that needed 1.8 trillion parameters now fits in 4 billion parameters. A 450x compression
450倍的参数压缩率是一个令人震惊的数字，表明算法优化和模型压缩技术取得了突破性进展。这不仅意味着更低的计算成本，还暗示了我们对AI效率的理解正在发生根本性变化。
I-DLM-8B is the first DLM to match the quality of its same-scale AR counterpart, outperforming LLaDA-2.1-mini (16B) by +26 on AIME-24 and +15 on LiveCodeBench-v6 with half the parameters
这一实验结果令人震惊，表明I-DLM不仅在理论上有所突破，在实践中也实现了重大突破。仅用8B参数就超过了16B参数的LLaDA-2.1-mini，在数学推理和代码生成基准测试上分别提升了26和15分，证明了内省扩散语言模型的高效性和有效性。
The model can reverse-engineer compiled software to detect malware and vulnerabilities without needing source code, aiming to help analysts inspect and secure systems more efficiently.
能够无需源代码即可逆向编译软件检测恶意代码的能力，展示了AI在网络安全领域的突破性进展。这种技术可能彻底改变安全分析师的工作方式，但也可能被滥用，引发关于AI安全与伦理的深刻思考。
Claude just got real browser control. This will change everything. Not screenshots. Not fragile selectors. Not slow MCP loops.
令人惊讶的是：AI浏览器控制已经从简单的截图和选择器发展到实时运行真实浏览器代码的重大飞跃，这代表了人机交互方式的根本性变革，大多数人尚未意识到这种技术范式转变的深远影响。
单张 24GB 4090 直接部署 32B LLM
令人惊讶的是：一张消费级显卡竟然能直接运行320亿参数的大模型，这打破了人们对大模型硬件需求的固有认知。过去需要多张高端显卡或专业服务器才能运行的模型，现在单张RTX 4090就能实现，这标志着大模型普及的门槛大幅降低。
TriAttention matches Full Attention reasoning accuracy while achieving 2.5x higher throughput or 10.7x KV memory reduction
大多数人认为在KV缓存压缩中，准确率和效率之间存在不可避免的权衡，但作者提出的TriAttention方法能够在保持全注意力推理准确度的同时，实现2.5倍的吞吐量提升或10.7倍的内存减少。这一结果挑战了当前领域内的效率-准确度权衡范式，表明可以通过创新方法打破这一传统限制。
both companies are hinting that these models are a real step forward, not just small upgrades.
大多数人认为AI模型的进步是渐进式的，每次迭代只有小幅提升。但作者认为OpenAI和Anthropic即将发布的模型(Spud和Claude Mythos)代表了真正的突破性进展，而非常规升级，这暗示AI发展可能即将迎来一个加速期。
Despite humanity’s ever-expanding knowledge about our physical world, there remains a gap in our understanding when it comes to consciousness. How does it arise from a physical system? Is it limited to our brain? How do I explain my experiences, from aha! to awe, that I know to be true, yet don’t fit any current scientific explanation? Have you ever had a hunch, intuition, or gut feeling that seemed to come out of nowhere? How about an insight on a project you’ve been hard at work on that suddenly comes to you in a dream? Or you’ve thought of a dear friend or loved one, and they instantly called or texted? While it may be easy to chalk up these occurrences to mere coincidence, the greatest thinkers, scientists, philosophers, and artists report that such noetic experiences have been central to their process as well as their great works of art and scientific and cultural breakthroughs.
For every thousand hacking at the leaves of evil, there is onestriking at the root."
Kuhn shows how almost everysignificant breakthrough in the field of scientific endeavor is first a break with tradition,with old ways of thinking, with old paradigms.
used to create the problem. To that I would add, can there be a new mindsetif it is necessary to use the language of the old mindset? I suspect that onewill encounter the same limitations of the old mindset. Who can build a new
for - adjacency - new mindset built on old? - like - scientific breakthrough by forming a new idea
Breakthrough Energy, die Organisation welche dieKlima und energiepolitischen Aktivitäten Aktivitäten von Bill Gates bündelt, reduziert die Aktivitäten Ihres amerikanischen Policy-Teams dramatisch. Damit reagiert die Organisation auf die Politik der Trump-Administration, die die bisherige Form politischer Arbeit weigehend ineffizient macht. Gates will sich in Zukunft auf die Entwicklung von Firmen im Bereich saubere Energien konzentrieren. Diese Aktivitäten passen zu Trumps Ziel einer amerikanischen Energiedominanz. https://www.nytimes.com/2025/03/12/climate/bill-gates-breakthrough-energy-cuts.html?unlocked_article_code=1.3U4.gtug.AAWTHQIZC6Rj&smid=url-share
Value of knowledge in a zettelkasten as a function of reference(use/look up) frequency; links to other ideas; ease of recall without needing to look up (also a measure of usefulness); others?
Define terms and create a mathematical equation of stocks and flows around this system of information. Maybe "knowledge complexity" or "information optimization"? see: https://hypothes.is/a/zejn0oscEe-zsjMPhgjL_Q
takes into account the value of information from the perspective of a particular observer<br /> relative information value
cross-reference: Umberto Eco on no piece of information is superior: https://hypothes.is/a/jqug2tNlEeyg2JfEczmepw
Inspired by idea in https://hypothes.is/a/CdoMUJCYEe-VlxtqIFX4qA
for - social tipping points - breakthrough effect - cascading tipping points - systemiq - Bezos Earth Fund -University of Exeter - social tipping points
report details - title - The Breakthrough Effect - How to trigger a cascade of tipping points to accelerate the net zero transition - authors - Mark Meldrum - Lloyd Pinnell - Katy Brennan - Mattia Romani - Simon Sharpe - Tim Lenton - date - january 2023 - publisher -
Gut recherchierter Überblicksartikel zur zunehmenden Ausbeutung von Erdgas im Senegal und Ländern. https://www.washingtonpost.com/world/2024/01/31/senegal-natural-gas-climate-change/
a series of very successful “Climate Science Translated” videos, pairing top climate scientists with top comedians - the comedians give their version of the science in highly unscientific language and emotion, cutting to the chase and helping the scientists reach a much wider audience (watch here: https://lnkd.in/e2Ed5ukG)
for: climate communication, climate communication - comedians, Climate Science Translated, Climate Science Breakthrough
potential partner
Chadeau-Hyam, M., Wang, H., Eales, O., Haw, D., Bodinier, B., Whitaker, M., Walters, C. E., Ainslie, K. E. C., Atchison, C., Fronterre, C., Diggle, P. J., Page, A. J., Trotter, A. J., Ashby, D., Barclay, W., Taylor, G., Cooke, G., Ward, H., Darzi, A., … Elliott, P. (2022). SARS-CoV-2 infection and vaccine effectiveness in England (REACT-1): A series of cross-sectional random community surveys. The Lancet Respiratory Medicine, 0(0). https://doi.org/10.1016/S2213-2600(21)00542-7
Morens, D. M., Taubenberger, J. K., & Fauci, A. S. (2021). Universal Coronavirus Vaccines—An Urgent Need. New England Journal of Medicine, 0(0), null. https://doi.org/10.1056/NEJMp2118468
Feldman, J. (2021, September 25). All the Ways That “1 in 5,000 per Day” Breakthrough Infection Stat Is Nonsense. Slate. https://slate.com/technology/2021/09/breakthrough-infections-one-in-five-thousand-nonsense.html
Maier, B. F., Wiedermann, M., Burdinski, A., Klamser, P., Jenny, M. A., Betsch, C., & Brockmann, D. (2021). Germany’s current COVID-19 crisis is mainly driven by the unvaccinated (p. 2021.11.24.21266831). https://doi.org/10.1101/2021.11.24.21266831
Regev-Yochay, G., Gonen, T., Gilboa, M., Mandelboim, M., Indenbaum, V., Amit, S., Meltzer, L., Asraf, K., Cohen, C., Fluss, R., Biber, A., Nemet, I., Kliker, L., Joseph, G., Doolman, R., Mendelson, E., Freedman, L. S., Harats, D., Kreiss, Y., & Lustig, Y. (2022). 4th Dose COVID mRNA Vaccines’ Immunogenicity & Efficacy Against Omicron VOC (p. 2022.02.15.22270948). medRxiv. https://doi.org/10.1101/2022.02.15.22270948
Lipsitch, M., Krammer, F., Regev-Yochay, G., Lustig, Y., & Balicer, R. D. (2021). SARS-CoV-2 breakthrough infections in vaccinated individuals: Measurement, causes and impact. Nature Reviews Immunology, 1–9. https://doi.org/10.1038/s41577-021-00662-4
Collier, A. Y., Brown, C. M., Mcmahan, K., Yu, J., Liu, J., Jacob-Dolan, C., Chandrashekar, A., Tierney, D., Ansel, J. L., Rowe, M., Sellers, D., Ahmad, K., Aguayo, R., Anioke, T., Gardner, S., Siamatu, M., Rivera, L. B., Hacker, M. R., Madoff, L. C., & Barouch, D. H. (2021). Immune Responses in Fully Vaccinated Individuals Following Breakthrough Infection with the SARS-CoV-2 Delta Variant in Provincetown, Massachusetts (p. 2021.10.18.21265113). https://doi.org/10.1101/2021.10.18.21265113
Prof Peter Hotez MD PhD [@PeterHotez]. (2021, December 14). 6. I was really hoping we would get the holidays in before the omicron wall hit. Doesn’t look like it https://t.co/X3Kud2ybdQ [Tweet]. Twitter. https://twitter.com/PeterHotez/status/1470895433518133252
ReconfigBehSci [@SciBeh]. (2021, December 10). Useful thread! [Tweet]. Twitter. https://twitter.com/SciBeh/status/1469208352819404805
Benjamin Meyer. (2022, January 14). Here is a bit of a longer explanatory thread on our recent paper on “Infectious viral load in unvaccinated and vaccinated patients infected with SARS-CoV-2 WT, Delta and Omicron”. You can read the full paper here: Https://t.co/R2FSyck6Nn [Tweet]. @BenjaminMeyer85. https://twitter.com/BenjaminMeyer85/status/1482102496764039176
Peña-Hernández, M. A., Klein, J., Malik, A. A., Coppi, A., Kalinich, C., Vogels, C. B. F., Silva, J., Initiative, Y. S.-C.-2 G. S., Peaper, D. R., Landry, M.-L., Wilen, C., Grubaugh, N. D., Schulz, W., Omer, S. B., & Iwasaki, A. (2022). Comparison of infectious SARS-CoV-2 from the nasopharynx of vaccinated and unvaccinated individuals (p. 2021.12.28.21268460). medRxiv. https://doi.org/10.1101/2021.12.28.21268460
Carl T. Bergstrom. (2022, January 8). 1. A thread on the CDC’s recommendation to de-isolate five days after the onset of symptoms or positive test. First, a disclosure: I was paid as a consultant for this work, done in collaboration with @Color Health, which provides COVID testing services and vaccination logistics. [Tweet]. @CT_Bergstrom. https://twitter.com/CT_Bergstrom/status/1479938654579544065
Jonathan Li on Twitter: “There’s a lineage of Omicron that’s gained the R346K mutation (BA.1.1). This one could spell some trouble for the AZ mAb (tixagevimab/cilgavimab, Evusheld) that’s being used for pre-exposure prophylaxis. If you want to learn about tix/cil vs Omicron, read on 1/7” / Twitter. (n.d.). Retrieved February 6, 2022, from https://twitter.com/DrJLi/status/1487479972293853188
Omicron’s sister variant spreads faster. So why did the one we call Omicron hit first? (2022, February 2). STAT. https://www.statnews.com/2022/02/02/omicron-sister-variant-ba2-spreads-faster/
Early data indicate vaccines still protect against Omicron’s sister variant, BA.2. (2022, January 28). STAT. https://www.statnews.com/2022/01/28/early-data-indicate-vaccines-still-protect-against-omicrons-sister-variant-ba-2/
Evershed, N. (n.d.). The simple numbers every government should use to fight anti-vaccine misinformation. The Guardian. Retrieved January 30, 2022, from https://www.theguardian.com/news/datablog/ng-interactive/2022/jan/28/the-simple-numbers-every-government-should-use-to-fight-anti-vaccine-misinformation
U.S. breaks record with more than 145,000 covid-19 hospitalizations. (n.d.). Washington Post. Retrieved January 12, 2022, from https://www.washingtonpost.com/health/2022/01/10/covid-hospitalized-omicron/
Sidik, S. M. (2022). Immunity against Omicron from breakthrough infection could be a matter of timing. Nature. https://doi.org/10.1038/d41586-022-00004-x
Eric Topol. (2021, December 14). Graph of Pfizer 3rd shot (booster) vs Omicron symptomatic infection, restoring to 75% protection, significantly less compared to its effect vs Delta (95%) with 95% CI, @UKHSA data, vs unvaccinated https://ft.com/content/8a6a0ec8-fd07-49cd-a3f5-386a06269a5c by @hannahkuchler @donatopmancini @mroliverbarnes https://t.co/PHMDZGIgDj [Tweet]. @EricTopol. https://twitter.com/EricTopol/status/1470744717398720513
Should the definition of “fully vaccinated” be changed to include a booster shot? (2021, December 11). Los Angeles Times. https://www.latimes.com/science/story/2021-12-11/should-the-definition-of-fully-vaccinated-include-a-booster-shot
Wheatley, A. K., & Juno, J. A. (2021). COVID-19 vaccines in the age of the delta variant. The Lancet Infectious Diseases, 0(0). https://doi.org/10.1016/S1473-3099(21)00688-5
COVID-19 Vaccine Breakthrough Weekly Update—Minnesota Dept. Of Health. (n.d.). Retrieved November 23, 2021, from https://www.health.state.mn.us/diseases/coronavirus/stats/vbt.html
Couzin-Frankel, J. (2021). Antiviral pills could change pandemic’s course. Science, 374(6569), 799–800. https://doi.org/10.1126/science.acx9605
To Plan B, or not to Plan B? (2021, November 2). https://www.thenakedscientists.com/articles/interviews/plan-b-or-not-plan-b
ReconfigBehSci. (2021, November 1). 2/2 from the paper ‘We speculate that the extraordinarily high antibody titers observed in vaccinated individuals who develop breakthrough infections may lead to subsequent long-term protection in those individuals.’ [Tweet]. @SciBeh. https://twitter.com/SciBeh/status/1455104597454954497
Aufrichtig, A., & Walker, A. S. (2021, October 28). Who Had Covid-19 Vaccine Breakthrough Cases? The New York Times. https://www.nytimes.com/interactive/2021/10/28/us/covid-breakthrough-cases.html
Covid booster shots important to stop infection, finds English study | Coronavirus | The Guardian. (n.d.). Retrieved October 14, 2021, from https://www.theguardian.com/world/2021/oct/14/covid-booster-shots-important-to-stop-infection-finds-english-study
Dolgin, Elie. ‘The Tangled History of MRNA Vaccines’. Nature 597, no. 7876 (14 September 2021): 318–24. https://doi.org/10.1038/d41586-021-02483-w.
How contagious is Delta? How long are you infectious? Is it more deadly? A quick guide to the latest science—ABC News. (n.d.). Retrieved October 3, 2021, from https://www.abc.net.au/news/2021-09-29/covid-delta-variant-what-the-science-says/100497804?utm_campaign=abc_news_web&utm_content=twitter&utm_medium=content_shared&utm_source=abc_news_web
Iacobucci, G. (2021). Covid-19: How is vaccination affecting hospital admissions and deaths? BMJ, n2306. https://doi.org/10.1136/bmj.n2306
Wu, K. J. (2021, July 13). “Breakthrough Infections” Is Not a Helpful Term. The Atlantic. https://www.theatlantic.com/science/archive/2021/07/coronavirus-breakthrough-infections/619416/
Coronavirus vaccines cut risk of long Covid, study finds—BBC News. (n.d.). Retrieved September 2, 2021, from https://www.bbc.co.uk/news/health-58410354
Liu, Y., Arase, N., Kishikawa, J., Hirose, M., Li, S., Tada, A., Matsuoka, S., Arakawa, A., Akamatsu, K., Ono, C., Jin, H., Kishida, K., Nakai, W., Kohyama, M., Nakagawa, A., Yamagishi, Y., Nakagami, H., Kumanogoh, A., Matsuura, Y., … Arase, H. (2021). The SARS-CoV-2 Delta variant is poised to acquire complete resistance to wild-type spike vaccines (p. 2021.08.22.457114). https://doi.org/10.1101/2021.08.22.457114
Breakthrough cases aren’t the cause of the US Covid-19 surge—Vox. (n.d.). Retrieved August 11, 2021, from https://www.vox.com/22602039/breakthrough-cases-covid-19-delta-variant-masks-vaccines
Bergwerk, M., Gonen, T., Lustig, Y., Amit, S., Lipsitch, M., Cohen, C., Mandelboim, M., Gal Levin, E., Rubin, C., Indenbaum, V., Tal, I., Zavitan, M., Zuckerman, N., Bar-Chaim, A., Kreiss, Y., & Regev-Yochay, G. (2021). Covid-19 Breakthrough Infections in Vaccinated Health Care Workers. New England Journal of Medicine, 0(0), null. https://doi.org/10.1056/NEJMoa2109072
ReconfigBehSci. (2021, July 28). RT @trishgreenhalgh: ⬇️⬇️⬇️ Cower from this virus, or risk serious complications. It’s not a cold. Https://t.co/CN4hZYQwMw [Tweet]. @SciBeh. https://twitter.com/SciBeh/status/1420913883997360131
Why are fully vaccinated people testing positive for Covid? | Financial Times. (n.d.). Retrieved July 28, 2021, from https://www.ft.com/content/0f11b219-0f1b-420e-8188-6651d1e749ff
Adam Kucharski on Twitter: “Useful data 👇– quick look suggests odds ratio for detection of B.1.617.2 relative to non-B.1.617.2 in vaccinated group compared to controls is 2.7 (95% CI: 0.7-10) after one dose and 1.2 (0.4-3.6) after two...” / Twitter. (n.d.). Retrieved July 2, 2021, from https://twitter.com/AdamJKucharski/status/1400443351908892675?s=20
COVID-19 Breakthrough Case Investigations and Reporting | CDC. (2021, May 28). https://www.cdc.gov/vaccines/covid-19/health-departments/breakthrough-cases.html
Benjy Renton. (2021, May 15). Latest data from CDC on breakthrough cases (out of 115 million people fully vaccinated): - 1,359 hospitalized or fatal cases—52% female, 79% over 65, 21% asymptomatic—794 COVID-related hospitalizations—181 COVID-related deaths https://t.co/NTPBxgpcAV https://t.co/AGQnih2Ggq [Tweet]. @bhrenton. https://twitter.com/bhrenton/status/1393391680292859906
Chen, C. (2021, April 14). A Tiny Number of People Will Be Hospitalized Despite Being Vaccinated. We Have to Learn Why. ProPublica. https://www.propublica.org/article/a-tiny-number-of-people-will-be-hospitalized-despite-being-vaccinated-we-have-to-learn-why?token=4HsRcuNGpEdmAeWz4oEu5Cr56zj5_5OE
Ledford, H. (2020). Coronavirus breakthrough: Dexamethasone is first drug shown to save lives. Nature, d41586-020-01824–01825. https://doi.org/10.1038/d41586-020-01824-5