- Apr 2025
-
superintelligence.gladstone.ai superintelligence.gladstone.ai
-
for - report - America's Superintelligence Project - definition - ASI - Artificial Super Intelligence
summary - What is the cost of mistrust between nation states? - The mistrust between the US and China is reaching an all-tie high and it has disastrous consequences for an AI arms race - It is driving each country to move fast and break things, which will become an existential threat to all humanity - Deep Humanity, with an important dimension of progress traps can help us navigate ASI
-
A domestic superintelligence project would have a huge energy footprint that we wouldn’t be able to conceal from adversaries
for - ASI project - energy consumption - gWatt
-
we may be tempted to conduct our own activities aimed at introducing trojans or backdoors into adversary models. This could end up being necessary, but it could also trigger dangerous loss of control behaviors and runaway escalation.
for - progress trap - ASI - introducing trojan and backdoors in adversary ASI - can backfire
-
former Mossad cyber operative warned, “The worst thing that could happen is that the U.S. develops an AI superweapon, and China or Russia have a trojan/backdoor inside the superintelligent model's weights because e.g. they had read/write access to the training data pipelines
for - ASI scenario - adversary with trojan backdoor access
-
AI alignment researchers estimate less than a 10% chance that we lose control of superintelligent AI once it’s built. More typical estimates range from 10-80%, depending on who you ask.
for - stats - chances of losing control of ASI - 10 to 80%
-
highly capable and context-aware AI systems can invent dangerously creative strategies to achieve their internal goals that their developers never anticipated or intended them to pursue.
for - progress trap - ASI - progress trap - AGI
Tags
- Artificial Super Intelligence
- stats - chances of losing control of ASI - 10 to 80%
- ASI scenario - adversary with trojan backdoor access
- AI arms race - US and China
- definition - ASI
- ASI project - energy consumption - gWatt
- report - America's Superintelligence Project
- progress trap - AGI
- progress trap - ASI
- Deep Humanity - progress traps - for navigating ASI
- progress trap - ASI - introducing trojan and backdoors in adversary ASI - can backfire
Annotators
URL
-
- Nov 2023
-
asistdl.onlinelibrary.wiley.com asistdl.onlinelibrary.wiley.com
- Mar 2019
-
onlinelibrary.wiley.com onlinelibrary.wiley.com
-
Big data, bigger dilemmas: A critical review
-
- Mar 2017
-
techcrunch.com techcrunch.com
-
Great overview and commentary. However, I would have liked some more insight into the ethical ramifications and potential destructiveness of an ASI-system as demonstrated in the movie.
-