656 Matching Annotations
  1. Last 7 days
    1. a genius in everyone’s pocket could remove that barrier, essentially making everyone a PhD virologist who can be walked through the process of designing, synthesizing, and releasing a biological weapon

      for - progress trap - AI - technology as an amplifier - technology acts as an amplifier, allowing humans to fly, to move at speeds faster than any known animal, to lift things no living creature can, etc - The danger is ignorance and polarized views combined with extreme self-rightiousness

    2. AI models could develop personalities during training that are (or if they occurred in humans would be described as) psychotic, paranoid, violent, or unstable, and act out, which for very powerful or capable systems could involve exterminating humanity.

      for - progress trap - AI - abstraction - progress trap - AI with feelings & AI without feelings - no win? - One major and obvious aspect of current AI LLMs is that they are not only artificial in their intelligence, but also artificial in their lack of real world experiences. They are not embodied (and it would likely be a highly dubious ethical justification for their embodiment as in AI - powered robots) - Once we have the first known AI robot killing a human, it will be an indicator we have crossed the Rubicon - AI LLMs have ZERO realworld experience AND they are trained as artificial COGNITIE intelligence, not artificial EMOTIONAL intelligence - Without having the morals and social norms a human being is brought up with, it can become psychotic because they don't intrinsically value life - To attempt to program them with morals is equally dangerous because of moral relativity. A Christian nationalist's morality might be that anyone who is associated with abortions don't have a right to live and should be killed - an eye for an eye. Or a jihadist and muslim extremist with ISIS might feel all westerners do not have a right to exist because they don't follow Allah. - Do we really want moral programmability? - When we have a psychotic person armed with a lethal weapon, that is a dangerous situation. If we have a nation of super geniuses who go rogue, that is danger multiplied many orders of magnitude.

  2. Jan 2026
  3. Dec 2025
    1. That is a situation we are now living through, and it is no coincidence that the democratic conversation is breaking down all over the world because the algorithms are hijacking it. We have the most sophisticated information technology in history and we are losing the ability to talk with each other to hold a reasoned conversation.

      for - progress trap - social media - misinformation - AI algorithms hijacking and pretending to be human

    1. ow would you respond to such ways of of looking at data?

      for - progress cheerleaders - response to - to - progress - Jason Hickel - responds to Steven Pinker - to - progress - Jason Hickel - responds to Bill Gates - https://hyp.is/go?url=https%3A%2F%2Fjacobin.com%2F2019%2F02%2Fsteven-pinker-global-poverty-neoliberalism-progress&group=vnpq69nW

    2. he counted examples of violence done by an indigenous group in I believe Uruguay uh as an example of violence of prehistoric primitive societies. Uh >> even though >> the the actual violence that was reported was done by colonists against those indigenous people but he counted it as the opposite as violence done by the indigenous people

      for - progress champion - Steven Pinker - discredited - one example of many - outright lie - he says violence committed BY indigenous Uruguay people but it was colonialist violence done TO THEM!

    3. Steven Pinger's big book better angels of our nature uh inspired a whole literature debunking it

      for - book - Better Angels - Steven Pinker - inspired literature debunking him - to - progress - Jason Hickel - responds to Steven Pinker - to - progress - Jason Hickel - responds to Bill Gates - https://hyp.is/go?url=https%3A%2F%2Fjacobin.com%2F2019%2F02%2Fsteven-pinker-global-poverty-neoliberalism-progress&group=vnpq69nW

    4. it's not so much about we have to you know expand the scope of the church or you know civilize people who don't have Jesus Christ and becomes more about we have to uh expand the market and we have to uh you know increase the the you know national revenue and the acreage that's under cultivation

      for - history - progress - after Enlightenment - no long about converting savages to Christians - became about expanding markets

    5. hat the book is is kind of trying to do is trace that lineage from that initial uh you know the the very first kind of literary endeavors um through uh you know uh Judaism and and through the classical Greek uh thinkers

      for - book - tracing history of progress / Growthist political economy narrative from Vikings to Mesopotamia to Judaism to Greeks to Islam to Enlightenment to US

    6. what progress should be, why it is so vital, and how little time we really have to achieve it.

      for - youtube - Planet Critical interview - Samuel Miller MacDonald - The Myth of Progress

      • SRG comment - interview - The Myth of Progress - Samuel Miller McDonald
        • Samuel summarizes key points from his research and book:
          • Progress: Humanity's Worst Idea
        • He discusses
          • what progress should be,
          • why it is so vital, and
          • how little time we really have to achieve
    7. rogress: A History of Humankind's Worst Idea

      for - progress trap - book - to - book - Progress: A History of Humankind's Worst Idea - https://hyp.is/cMyt5tjMEfCGz9-Edzp-hA/harpercollins.co.uk/products/progress-a-history-of-humanitys-worst-idea-samuel-miller-mcdonald - author Samuel Miller McDonald

      SRG comment - interview - book on Progress - see other references: - to - book - A Short History of Progress (2004) - https://hyp.is/93k5CtjLEfC1UpPEi59BHA/archive.org/details/shorthistoryofpr0000wrig - to - movie - Surviving Progress (2011) - https://hyp.is/sRPYJtjLEfCwuDdwG2xNnw/www.nfb.ca/film/surviving-progress/ - SRG article - Cogress

    Tags

    Annotators

    URL

    1. for - Medium article - cogress - Part 1 - progress trap - James Gien Wong - definition - cogress - to - Medium article cogress - Part 2 - progress trap - James Gien Wong - https://hyp.is/t8FhpDGAEfC4J7f0NEFujg/medium.com/@gien_SRG/human-cogress-part-2-d6fd075a55c7 - to - Stop Reset Go hypothesis annotations - progress trap - Ronald Wright - https://jonudell.info/h/facet/?max=100&expanded=true&user=stopresetgo&exactTagSearch=true&any=ronald+wright - General - https://jonudell.info/h/facet/?max=100&expanded=true&user=stopresetgo&exactTagSearch=true&any=progress+trap - from - youtube - Planet Critical interview - Samuel Miller MacDonald - The Myth of Progress - https://hyp.is/r-hmFtjKEfCd8odATbINbA/www.youtube.com/watch?v=BEhmWEDkZUQ

    1. Once humans attained culture, the pressure on genetic change is less significant and adaptation can take place through the flexibility afforded through cultural change.

      for - key insight - culture - adaption through culture, not genes - SRG comment - danger is progress traps! - This is a key insight. Once we have sophisticated culture, we don't rely on slow moving genetic change to adapt anymore. Instead we rely on culture! - This is the world of human progress, but is also a dangerous one because progress (cultural adaptation to environmental pressures) comes with progress traps.

    1. Edward Tellella, another physicist, had naughty calculation that there's a nonzero chance that detonating the bomb would ignite the entire atmosphere of Earth, killing not just all humans, but every single shred of life. By that time, the US also knew that the Nazis were no longer capable of making the bomb nor even pursuing their own project anymore. They still went ahead and took the risk.

      for - progress trap - technology - nuclear - psychopathic behavior - Edward Teller calculation - decision to go ahead anyways!

    2. I think we need to concentrate more on the feedbacks between all of those nodes than on the nodes themselves. And that's tough because I might be an expert on one of those nodes and you might be an expert on one of the other nodes. And and it's not that that's needed. It's the feedbacks between the nodes.

      for - wicked problems - feedback between nodes is the priority - wicked problems - SRG comment - feedback between nodes - indicates progress traps COLLECCT ecosystem design

    3. one of the things that I find really interesting that's not talked about very much is the impacts of nitrogen fixing and the production of artificial fertilizers which contributed to the number one issue which is human population growth

      for - progress trap - nitrogen for fertilizers - anthropocene research - releases lots of methane - climate crisis - leverage point - replacing nitrogen fertilizers

    4. Now compare that for instance with another kind of biologically built structure where we're getting comparable amounts of morphological change of morphos species or technos species uh uh you know which have developed just over a few decades

      for - stats - speed - cultural (technological) evolution - cell phone - 35 years to touchscreen phones - comparison - speed of cultural vs biological evolution - progress trap

  4. Nov 2025
    1. We uh changed the way we train engineers and computer scientists. So to graduate from any engineering school, you had to actually comprehensively study all the places that humanity had gotten technology wrong, including forever chemicals or leaded gasoline, which dropped a billion points of IQ or social media that caused all these problems

      for - progress trap - education -advocate

  5. Oct 2025
    1. I've been thinking about this stuff for decades, and I had not broached the topic of platonic patterns until until this year. And that's because I think it is now actionable.

      for - quote - platonic patterns are now actionable - Michael Levin - I've been thinking about this stuff for decades, and I had not broached the topic of platonic patterns until this year. - And that's because I think it is now actionable. - question - progress trap - moral questions and alarm bells? playing God? - Michael Levin

  6. Sep 2025
    1. for - consciousness, AI, Alex Gomez- Marin, neuroscience, hard problem of consciousness, nonmaterialism, materialism - progress trap - transhumanism - AI - war on conciousness

      Summary - Alex advocates - for a nonmaterialist perspective on consciousness and argues - that there is an urgency to educate the public on this perspective - due to the transhumanist agenda that could threaten the future of humanity - He argues that the problem of whether consciousness is best explained by materialism or not is central to resolving the threat posed by the direction AI takes - In this regard, he interprets that the very words that David Chalmers chose to articulate the Hard Problem of Consciousness reveals the assumption of a materialist reference frame. - He used a legal metaphor too illustrate his point: - When a lawyer poses three question "how did you kill that person" - the question is entrapping the accused . It already contains the assumption of guilt. - I would characterize his role as a scientist who practices authentic seeker of wisdom - will learn from a young child if they have something valuable to teach and - will help educate a senior if they have something to learn - The efficacy of timebinding depends on authenticity and is harmed by dogma

  7. Aug 2025
    1. for - youtube - BBC - AI2027 - Futures - AI - progress trap - AI - to AI2027 website - https://hyp.is/0VHJqH3cEfCm9JM_EB3ypQ/ai-2027.com/

      summary - This dystopian futures scenario is the brainchild of former OpenAI researcher Daniel Kokotajlo, - It is premised on human behavior in modernity including - confirmation bias of AI researchers - entrenched competing political ideologies that motivate an AI arms race - entrenched capitalist market behavior that motivates an AI arms race - AI becoming embodied, resulting in Artificially Embodied Artificial Intelligence (AEAI), posing the danger to humanity because it's no longer just talk, but action - Can it happen? The probability is not zero.We don't really understand the behavior of the AI LLM's we design, they are nonpredictable, and as we give them even greater power, that is a slippery slope - AI can become humanity's ultimate progress trap, which is ironic, because the technology that promises to be the most efficient of all, can become so efficient, it no longer need human beings - Remember Jerry Kaplan's book "Humans need not apply"? - https://hyp.is/o0lBFH3fEfC1QLfnLSs5Bg/www.youtube.com/watch?v=JiiP5ROnzw8 - This dystopian futures scenario goes further and explores the idea that "humans need not exist"!

      question - What about emulating climate change gamification of "Bend the Curve" of emissions? - Use the AI 2027 trajectory as a template and see how much real-life follows this trajectory - Just as we have the countdown to the https://climateclock.world/ ( 3 years and change remaining as of today) - perhaps we can have an AI 2027 clock? - What can we do to "bend the dystopian AI 2027 curve" AWAY from the dystopian future?

    1. we cannot just go ‘back’ to indigenous social systems

      for - adjacency - cannot go back - spiral -progress - progress trap - This can also be seen as the complexity emerging from the continuous oscillation between progress and progress traps - while we are a timebinding species, the unintended consequences of progress require us to undo the unintended harm by revisiting a corner time to remember the beneficial qualities so they we may decouple the harmful qualities in the future

    1. THEY WANT TO BE ABLE TO OWN THEIR OWN VOICES. AND THIS IS WHAT I FIGHT AGAINST NOW, ARE THINGS LIKE NDAS, BECAUSE A LOT OF THESE WOMEN SIGNED NDAS AS YOUNG GIRLS

      for - progress trap - legal - NDA - question - legal - NDA - can laws be amended so that NDA's are null and void whecan laws be amended so that NDA's are null and void when perpetrators use them to defend and hide their illegal activity?

  8. Jul 2025
  9. Jun 2025
    1. he reason I call it a memory is because once you do this once you convert that network to store the the that electric circuit to store a two-headed pattern it's permanent.

      for - adjacency - morphological memory - permanent - progress trap - progress trap - programmable morphological memory - Nature has obviously altered the bioelectrical patterns through natural evolution, - while humans now understand the mechanism and can alter it artificially to suit our own wants and needs - Hence, it can become a future progress trap

    2. it has a different representation of what to do if it gets injured in the future. It's a latent memory. It doesn't do anything until it gets injured. It just sits there and you would have no idea that it's there by looking at the at the anatomy. But if it's get if it gets injured, this is what its idea of a correct worm.

      for - adjacency - stored latent memory of future morphology - can be altered - Michael Levin - potential progress trap

    1. The tendency to suppress or ignore the inconsistencies that challenge our worldviews is thus universal rather than partisan

      for - adjacency - scientific paradigm shift - confirmation bias - universal behavior - liberal / conservative dynamics - progress

      adjacency - scientific paradigm shift - confirmation bias - universal behavior - liberal / conservative dynamics - progress - It is a natural for humans to be both conservative and liberal - If we weren't liberal, there would be no progress - At the same time, we recognize the value of existing traditions - they worked and helped us to survive - Confirmation bias is conservative - why tamper with something that isn't broke? - Yet novelty is a behavior that even the staunchest conservative displays - It is nonsensible to think we have only one but not the other aspect, we have both

  10. May 2025
    1. Anthropic researchers said this was not an isolated incident, and that Claude had a tendency to “bulk-email media and law-enforcement figures to surface evidence of wrongdoing.”

      for - question - progress trap - open source AI models - for blackmail and ransom - Could a bad actor take an open source codebase and twist it to do harm like find out about an rogue AI creator's adversary, enemy or victim and blackmail them? - progress trap - open source AI - criminals - exploit to identify and blackmail victiims

    1. anthropic's new AI model shows ability to deceive and blackmail

      for - progress trap - AI - blackmail - AI - autonomy - progress trap - AI - Anthropic - Claude Opus 4 - to - article - Anthropic Claude 4 blackmail and news leak - progress trap - AI - article - Anthropic Claude 4 - blackmail - rare behavior - Anthropic’s new AI model didn’t just “blackmail” researchers in tests — it tried to leak information to news outlets

    1. for - progress trap - Consilience Project - progress trap - Daniel Schmactenberger - from - LinkedIn post - https://hyp.is/twtPIDFaEfC-DCuswNHo5g/www.linkedin.com/posts/danielschmachtenberger_development-in-progress-the-consilience-activity-7222883365371191297-DCPX/?rcm=ACoAACc5MHMBii80wYJJmFqll3Aw-nvAjvI52uI

      summary - Daniel is describing the condition known as a "progress trap",an unintended consequence of progress. - I provide a history of progress traps in my two Medium articles found in the annotation links above. - The idea of progress traps is a very important one, especially for modernity because it is a central and general organizing principle under which many disparate unintended consequences of progress can be subsumed. - As is common in paradigm shifts, it is only when a novel concept of sufficient generalization and relevance is introduced that numerous important problems that could not be explained sufficiently in an older model, can be explained more elegantly from a higher or deeper level perspective - Without recognizing a new category of "progress traps", the many different types of unintended consequences are treated in a fragmented and adhoc way.

    2. This article explains how our current idea of progress is immature: it is developmentally incomplete. Progress, as we define it now, ignores or downplays the scale of its side effects.

      for - progress trap - to - Stop Reset Go hypothesis annotations - progress trap - Ronald Wright - https://jonudell.info/h/facet/?max=100&expanded=true&user=stopresetgo&exactTagSearch=true&any=ronald+wright - General - https://jonudell.info/h/facet/?max=100&expanded=true&user=stopresetgo&exactTagSearch=true&any=progress+trap

    1. new article exploring the narrative of progress, where the current narrative falls catastrophically short, what authentic progress would entail and require, and specific suggestions for how it could be realized.

      for - post - LinkedIn - progress trap - Daniel Schmatenberger - to - article - The Consilience Project - Development in Progress - https://hyp.is/E3HHGDFaEfCZErPpYGIONg/consilienceproject.org/development-in-progress/

  11. Apr 2025
    1. for - report - America's Superintelligence Project - definition - ASI - Artificial Super Intelligence

      summary - What is the cost of mistrust between nation states? - The mistrust between the US and China is reaching an all-tie high and it has disastrous consequences for an AI arms race - It is driving each country to move fast and break things, which will become an existential threat to all humanity - Deep Humanity, with an important dimension of progress traps can help us navigate ASI

    1. We need technology, much of it to solve the problems that we've created with technology in the first place. But since our ignorance is so vast, how could we possibly develop new technologies that wouldn't in turn create more technologies-- more difficulties that we hadn't anticipated? And you see it in spades right now.

      for - progress trap - David Suzuki

    2. by the time Rachel Carson published Silent Spring, we knew there were ramifications we didn't-- couldn't have anticipated, the most amazing being biomagnification. When eagles began to disappear in the United States, scientists tracked it down to the fact that DDT sprayed at low concentrations would be amplified up the food chain. So by the time you get to the fatty glands and the fat tissue and the shell glands of birds and the breasts of women, DDT was concentrated hundreds of thousands of times beyond what we had sprayed it at. By the 1960s, women's breast milk was considered too toxic to feed to babies.

      for - progress trap - DDT - David Suzuki

    3. she said is, yeah, you scientists are clever. You can make powerful compounds like DDT, but you don't know enough to anticipate all of the consequences. Because, first of all, the lab is not a replica of the real world. The lab is an artifact, something that has very little to do with the real world out there. In the real world, everything is connected to everything else, and we don't know enough to anticipate the effects of what we do with our powerful technologies.

      for - quote - progress trap - David Suzuki - quote - Indra's net of jewels - David Suzuki

      quote - progress trap - David Suzuki - What she (Rachel Carson) said is, - Yeah, you scientists are clever. You can make powerful compounds like DDT, but you don't know enough to anticipate all of the consequences. - Because the lab is not a replica of the real world. The lab is an artifact, something that has very little to do with the real world out there. - In the real world, everything is connected to everything else, and we don't know enough to anticipate the effects of what we do with our powerful technologies.

    1. This article, then, has three aims.

      for - futuring - paper - Techniques of futuring: On how imagined futures become socially performative - from - collective imagination toolkit https://hyp.is/i3N9KA_DEfCsXivEzv3w5A/www.collectiveimagination.tools/ - purpose of the paper - how images of the future gain performative traction - objectives: how images of the future gain performative traction: - present insights and weaknesses of leading social-theoretical futures work - fill some gaps by - imagining the future via - social practices - performance of reality // question- what does this mean?// - develop performative understanding of futuring via - dramaturgical analysis that investigates ow actors - actively bring the future into the present through performance of particular: - narratives - settings - configurations

      Summary - This is a very insightful paper on futuring and how activity in the present realizes imagined fictions, which don't yet exist, and bring them into being in our (future) present - One thing to note is that there is a huge swath of human activity not explicitly discussed which is intrinsically futuring, and that is the birth of any new idea in general, including scientific, mathematical and technological. - Human progress is the sum total of countless individual futuring projects that imagine some fictitious, nonexistent idea and work to incrementally bring it into existence.

  12. Mar 2025
    1. before the internet it was impossible really I mean getting coring people into town halls regularly that would have been a hard thing to do anyway online made a bit easier but now with aii we can actually all engage with each other AI can be used to harvest the opinions of millions of people at the same time and distill those opinions into a consensus that might be agreeable to the vast majority

      for - claim - AI for a new type of democracy? - progress trap - AI - future democracy

  13. Feb 2025
  14. www.becomingdenizen.com www.becomingdenizen.com
    1. One of the most important subjects that we wanted to address on Consilience was the idea of progress.

      Why am I interested in this topic? Because in IPK 102 Introduction to Indigenous Peoples Knowledges, I have chosen to make a presentation on Chapter 13: “The Myth of Progress” of Indigenous Writes: A Guide to First Nations, Métis, & Inuit Issues in Canada by Chelsea Vowel.

      The featured resource for this podcast episode is the article by The Consilience Project, “Development in Progress”.

  15. Jan 2025
    1. In the context of transformative transdisciplinary research, such reflexive processes are meant to open-up epistemic and solution spaces that elevate marginalized perspectives and challenge the status quo.

      for - adjacency - reflexive processes elevate marginalized perspectives and challenge status quo - diversity of Indyweb perspectival knowing - mitigates progress traps that emerge from myopism - SOURCE - paper - Reflexivity as a transformative capacity for sustainability science: introducing a critical systems approach - Lazurko et al. - 2025, Jan 10

    1. [[Moral Progress by Philip Kitcher]] reads, based on both their blurbs, like a continuation of [[The Ethical Project by Philip Kitcher]], exploring how actual ethical changes have occurred in time. Moves towards method rather than big-T truth (in line w social evolution perspective of the Ethical Project) and strengthens the pragmatism in pragmatic naturalism. 10yrs between the 2 books. Blurb mentions progressing away from something rather than to something, which chimes neatly with the evolutionary perspective of moving away from being hindered by a selective pressure. The attention to moral progress as method brings it closer to my notion of [[Ethics As A Practice (EaaP) 20200819161530]]

  16. Dec 2024
    1. "If he [Musk] is concerned about competitors getting there first, it doesn't matter as uncontrolled superintelligence is equally bad, no matter who makes it come into existence."

      for - quote - Response to Elon Musk - competition is moot - whoever creates superintelligence first week also create the progress trap that comes along with it - Roman Yampolskiy

      quote - Response to Elon Musk - competition is moot - whoever creates superintelligence first week also create the progress trap that comes along with it - Roman Yampolskiy

      • If he [Musk] is concerned about competitors getting there first,
        • it doesn't matter as uncontrolled superintelligence is equally bad, no matter who makes it come into existence.
    1. It has taken its place on the clockshelf, with only the Bible, the “Pilgrim's Progress,” and the Almanac for its companions. No other classic author, with, perhaps, the single exception of Æsop, has been so widely read in modern times; and the popular knowledge of the men of Greece and Rome is derived more from Plutarch than from all other ancient authors put together.

      importance of Plutarch's Lives

    1. the ten thousand things became so catastrophically powerful.

      for - epiphany - adjacency - progress traps - losing sight of the sacred - the Genesis story of intentionality - the symbol is the abstraction - is the intentionality - is the incompleteness - in the light of the infinite emptiness

      epiphany - adjacency - between - progress traps - losing sight of the sacred - the Genesis story of intentionality - the symbol is the abstraction - is the intentionality - is the incompleteness - in the light of the infinite emptiness - adjacency relationship - Epiphany occurred to me that Genesis is the story of control - and control is about intentionality - and intentional design is all about incompleteness - The written symbol is inherently incomplete - To control anything in nature requires intentionaity - We must design something with intention, which will always be incomplete - and here we immediately run up against the infinite - and the emergence of progress traps - In this sense, every design is a mistake, biding its time to reveal the form of its unintended consequences

    1. measure of progress is the development of human capacity to undertake this work of transcendence as a conscious endeavour

      for - progress - measure of - Dil Green

      progress - measure of - Dil Green - the degree to which we transcend blind evolution and - grow a capacity to evolve our culture purposefully, with increasing wisdom

      comment - Wisdom trumps intelligence - Part of that wisdom is a deep understanding of the nature of human progress and how progress traps are an intrinsic possibility of all progress - wisdom includes a diversity of perspectives that mitigate myopic design - In particular, it means a deep understanding of the emptiness of reality and the role that plays in progress traps

    1. A predicament is a situation where, as you try to solve problems, you lack a holistic understanding because you’ve been reductionistic and ignored parts of the interdependencies and you end up creating other problems. The attempt to create a solution creates other problems because of the interdependencies.

      for - adjacency - systemic intedependent web - predicament - progress trap - Joe Brewer - progress trap - climate crisis solutions

    1. these things are not externalities that the existing system can figure out, but they are the logical outcomes of the existing system. And so any lens we use to say, well, technology will save the day. Well, technology is an extension and an externality of neoliberal capitalism

      for - progress traps - science - technology - neoliberalism - Post Capitalist Philanthropy Webinar 1 - Alnoor Ladha - Lynn Murphy - 2023

      progress traps - science - technology - neoliberalism - Post Capitalist Philanthropy Webinar 1 - Alnoor Ladha - Lynn Murphy - 2023 - It is with progress that the modernity shaped by centuries of scaled-out industrial,scientific and technological innovation has created all our crisis. - It is absurd to say that science, technology and industrialization did not play a major role in the creation of all the crisis of modernity - If science, technology and industry inherently embed separation, how do we use it in a meaningful way that doesn't lead to another progress trap? - What are the motives of those who fund technology?

  17. Nov 2024
    1. for - AI - progress trap - interview Eric Schmidt - meme - AI progress trap - high intelligence + low compassion = existential threat

      Summary - After watching the interview, I would sum it up this way. Humanity faces an existential threat from AI due to: - AI is extreme concentration of power and intelligence (NOT wisdom!) - Humanity still have many traumatized people who want to harm others - low compassion - The deadly combination is: - proliferation of tools that give anyone extreme concentration of power and intelligence combined with - a sufficiently high percentage of traumatized people with - low levels of compassion and - high levels of unlimited aggression - All it takes is ONE bad actor with the right combination of circumstances and conditions to wreak harm on a global scale, and that will not be prevented by millions of good applications of the same technology

    1. the point is that this is a collective problem that can only be solved collectively. And clearly there is no collective, even worse

      for - post comment - LinkedIn - polarization - Trump 2024 win - lack of collective - adjacency - Deep Humanity - deep time, species-wide singularity - conservativism vs progressiveness - progress - political polarization - progress trap

      adjacency between - Trump 2024 win - Deep Humanity - anthropocene as deep time species-wide singularity - progress traps reaching a climax - conservatism vs progressiveness - adjacency relationship - This fits into a Deep Humanity explanation: - We are moving through a deep time, species singularity in which - once isolated pockets of cultural seeking and interpretative systems for explaining reality have been rapidly mashed-up via: - communication and - transportation technology - There is a singularity now where two forces are battling each other: - conservative that values old traditional cultural values and norms and - progressive that values the future possibilities - There are different cultural flavors of this. Whether it is - political polarization that pits authoritarian vs democratic ideologies or - climate change that pits traditional fossil fuel systems vs new renewable energy systems - the way we've always done things is in conflict with new ways of doing things through natural human evolutionary change - progress - In fact, we can look at the deep time, species-wide singularity that is now happening across all fields in the anthropocene as a predictable progress trap arising from progress itself

    1. we haven't even got to a planetary place yet really and we're about to unleash Galactic level technology you know what I'm saying like so we have a we have a lot of catchup that needs to happen in a very short period of time

      for - quote - progress trap - AI - developed by unwise humans - John Churchill

      quote - progress trap - AI - developed by unwise humans - John Churchill - (See below) - We haven't even got to a planetary place yet really - and we're about to unleash Galactic level technology - So we have a we have a lot of catchup that needs to happen in a very short period of time

  18. Oct 2024
  19. Sep 2024
    1. nobody told it what to do that's that's the kind of really amazing and frightening thing about these situations when Facebook gave uh the algorithm the uh uh aim of increased user engagement the managers of Facebook did not anticipate that it will do it by spreading hatefield conspiracy theories this is something the algorithm discovered by itself the same with the capture puzzle and this is the big problem we are facing with AI

      for - AI - progress trap - example - Facebook AI algorithm - target - increase user engagement - by spreading hateful conspiracy theories - AI did this autonomously - no morality - Yuval Noah Harari story

    2. when a open AI developed a gp4 and they wanted to test what this new AI can do they gave it the task of solving capture puzzles it's these puzzles you encounter online when you try to access a website and the website needs to decide whether you're a human or a robot now uh gp4 could not solve the capture but it accessed a website task rabbit where you can hire people online to do things for you and it wanted to hire a human worker to solve the capture puzzle

      for - AI - progress trap - example - no morality - Open AI - GPT4 - could not solve captcha - so hired human at Task Rabbit to solve - Yuval Noah Harari story

    1. It feels, to him, like a trick. As if I’ve drawn a silver coin from behind his ear. The poem changes when marked by my blackness, I learn.

      The author's blackness terrified the professor from the sounds of this piece, a way to symbolize something which could attract a reader but what was it that they meant, the professor could be seen as shrewd or inquisitive.

    1. Die Fossilindustrie finanziert seit Jahrzehten Universitäten und fördert damit Publikationen in ihrem Interesse, z.B. zu false solutions wie #CCS. Hintergrundbericht anlässlich einer neuen Studie: https://www.theguardian.com/business/article/2024/sep/05/universities-fossil-fuel-funding-green-energy

      Studie: https://doi.org/10.1002/wcc.904

  20. Aug 2024
    1. there's great risk here there's people turning into gurus there's you know weird cult formations there's exploitation there's money pumping uh you have to do a lot you have to try to build a lot in to safeguard against this

      for - progress trap - meaning crisis intervention practices

      progress trap - meaning crisis intervention practices - JV recognizes the potential progress traps of this potential intervention

    1. Degradation ofecosystem services could be significantly slowed down or even reversed if the role ofbiodiversity and its full contribution to economic production were an integrated part ofdecisions made by governmental entities, companies, and other stakeholders (Paul et al2020)20

      for - biodiversity - impact of monoculture diet

      biodiversity - impact of monoculture diet - FAO study done before 2000 and often cited shows that 75% of the global diet comes from 12 plant and 5 animal food sources

      to - stats - progress trap - monoculture - table of 12 plant and 5 animal species that make up 75% of world's diet - https://hyp.is/iznepFWoEe-umbNyOGVqrg/thefuturemarket.com/biodiversity

    1. while our predicament is eco-logical (“let it live”), our thinking remains techno-logical (“fix it”). The monoculture's fixation on what I call algorithmic rationality (linear, sequential, goal-oriented problem-solving),

      for - adjacency - ecology of communication - progress traps - intentionality - language

      adjacency - between - ecology of communications - progress traps - intentionally - language - emptiness - adjacency relationship - human intentionally focuses it attention on only a few select aspects of the entire gestalt of any moment of our phenomenological reality - It creates our salience landscape - What we choose to focus on and know more about it always coupled with and complimented by a vast ignorance of what we choose NOT to know - Indeed, the use language itself is the telling of a very specific story - Of all the stories we can tell, - Of the infinite stories we can construct now, -we settle on one - So the use of language already betrays the complexity inherent in each and every one of our ecological moments - We plant the seeds for progress traps as soon as we - manifest an intention - attempt to communicate - Hence, it is not avoidable and the best we can do is - recognize our situation - manage it - It is the relationship between - human nature (perceived as limited) - nature nature (infinite) - What springs to mind if the Zen koan - The elbow does not bend backwards

    1. the conclusion must of course be, okay, so this is the risk  assessment we have. Let's, then we have to apply precaution. Precautionary  principle. Exactly. Uncertainty in science, which will always be there, should in my view,  always be. connected with a risk assessment.

      for - adjacency - precautionary principle - risk assessment - progress traps

      adjacency - between - precautionary principle - risk assessment - progress trap - adjacency relationship - Precautionary principle is really stating that we don't have enough knowledge and there can be a high risk - Even if there is low probability of occurrence, we must apply precautionary principle to avoid a progress trap

    2. World Economic Forum, we're working very closely. They're also integrating planetary boundaries in,  their global economy kind of policy agenda

      for - World economic forum - integration planetary boundaries into their strategy

      Concern - unintended consequence - The WEF is perceived by many to be an elitist organisation - who do not have the best interest off the people in mind - This could lead to potential reputational damage to the planetary boundary framework thru their association with it

  21. Jul 2024
    1. recommends that ToC construction should be participatory, involving stakeholders who represent different perspectives and roles within the intervention

      for - ToC construction - recommendation - should be participatory

      comment - Stop Reset Go process using Trailmark mark-in notation within Indyweb people-centered, interpersonal software ecosystem is inherently designed: - to be participatory - to mitigate progress traps - In fact, - the greater the diversity of perspectives, - the greater the efficacy in mitigating progress traps - For this reason, open source is necessary to achieve the optimal transformations of improvement

    1. If a baby born today and a baby born 30,000 years ago were swapped at birth, they would each grow up as normal people in their new cultures.

      for - similar to - quote - Ronald Wright - progress trap - computer metaphor

      similar to - quote - Ronald Wright - progress trap - computer metaphor - Ronald Wright's famous quote on the computer metaphor really gets to the essence of things - how much of the meta-poly-perma-crisis can be explained by the unprecedented mismatch between the rate of - biological evolution of our species - cultural evolution of our species - Culture is the major and possibly most signficant differentiator between the person alive 50,000 years ago and the one alive today.

      reference - quote - Ronald Wright - computer metaphor - https://hyp.is/go?url=https%3A%2F%2Fwww.goodreads.com%2Fwork%2Fquotes%2F321797-a-short-history-of-progress&group=world

    1. exponential growth isn’t totally smooth and uniform. Kurzweil explains that progress happens in “S-curves”:↳

      exponential growth isn't totally smooth and uniform. Progress happens in "S-curves"

    1. 26:30 Brings up progress traps of this new technology

      26:48

      question How do we shift our (human being's) relationship with the rest of nature

      27:00

      metaphor - interspecies communications - AI can be compared to a new scientific instrument that extends our ability to see - We may discover that humanity is not the center of the universe

      32:54

      Question - Dr Doolittle question - Will we be able to talk to the animals? - Wittgenstein said no - Human Umwelt is different from others - but it may very well happen

      34:54

      species have culture - Marine mammals enact behavior similar to humans

      • Unknown unknowns will likely move to known unknowns and to some known knowns

      36:29

      citizen science bioacoustic projects - audio moth - sound invisible to humans - ultrasonic sound - intrasonic sound - example - Amazonian river turtles have been found to have hundreds of unique vocalizations to call their baby turtles to safety out in the ocean

      41:56

      ocean habitat for whales - they can communicate across the entire ocean of the earth - They tell of a story of a whale in Bermuda can communicate with a whale in Ireland

      43:00

      progress trap - AI for interspecies communications - examples - examples - poachers or eco tourism can misuse

      44:08

      progress trap - AI for interspecies communications - policy

      45:16

      whale protection technology - Kim Davies - University of New Brunswick - aquatic drones - drones triangulate whales - ships must not get near 1,000 km of whales to avoid collision - Canadian government fines are up to 250,000 dollars for violating

      50:35

      environmental regulation - overhaul for the next century - instead of - treatment, we now have the data tools for - prevention

      56:40 - ecological relationship - pollinators and plants have co-evolved

      1:00:26

      AI for interspecies communication - example - human cultural evolution controlling evolution of life on earth

    1. for - progress trap - AI -

      article details - title - Hollow, world! (Part 1 of 5) - author - James Allen - date - 10 July, 2024 - publication - substack - self link - https://allenj.substack.com/p/hollow-world-part-1-of-5

      summary James Allen provides an insightful description of ultra-anthropomorphic AI, AI that attempts to simulate an entire, whole human being.

      In short, he points out the fundamental distinction between the real experience of another human being, and a simulation of one. In so doing, he gets to the heart of what it is to be human.

      An AI is a simulation of a human being. No matter how realistic it's responses and actions, it is not evolved out of biology. I have no doubts that scientists are hard at work trying to make a biological AI. The distinction becomes fuzzier then.

      Current AI cannot possibly simulate the experience of being in a fragile and mortal body and all that this entails. If an AI robot says it understands joy or pain, that statement isn't built on the combined exteroception and interoception of being in a biological body, rather, it is based on many linguistic statements it has assimilated.

    1. book come out last year called over the seaw wall his name is Steven Robert Miller

      for - book - Over the Seawall - Steven Robert Miller

      book - Over the Seawall - Steven Robert Miller - A book about PROGRESS TRAPS! - How climate adaptation measures can lead to progress traps, such as - lead to a sense of complacency and false security - leading to overdevelopment - leading to even more people vulnerable to climate and extreme weather events

    2. I don't really understand what they think uh what it is um if it's not you know 00:45:20 how resources are allocated and um the the transformation of commod you know raw material into finished goods and stuff all that takes energy it all takes material

      for - progress trap - real dangers from - abstraction and siloing

      progress trap - real dangers from - abstraction and siloing - Business processes create workers who live in abstract, symbolic worlds, never seeing the consequences of their symbolic manipulations - At the end of the day, the abstract, symbolic finance industry worker gets a fat salary and lives comfortably, whilist playing with abstractions of processes they are contributing to which they have no sensory information on - the separation of producer from consumer is yet another huge abstraction that cleaves the gestalt into pieces that we cannot see - ANTIDOTE to this - de-abstraction - re-synthesize - Processes have been fragmented and split apart - We need to find ways for people to re-synthesize and assemble the pieces back together again in order to - see and experience the whole picture

    1. in the past these collapses of civilizations were local and people could migrate a little further on and rebuild but the chances of of that are gone now i mean we have to we have to uh to to 01:03:18 uh get right with what we have because it's all we have you know we we all all those bets we placed when our ancestors invented civilization they all rest on one high stakes throw which is 01:03:32 now

      for - progress trap - modernity can't run away anywhere from its ruins

    2. does agriculture become a 00:51:16 progress trap has it been a progress trap well i think i think in a sense it has

      for - progress trap - Agriculture appears to be a progress trap - Ronald Wright

      argument - progress trap - Agriculture appears to be a progress trap - Ronald Wright - The early progress traps have been comparatively small in scale - During the stone age, there were no more than a few million people alive (3 to 5 million?) and - they destroyed all the big game where humans lived - The Sumerians, with a population of around one million people salted up and destroyed the fertile land of Southern Iraq - Now we have 8 billion people and a third of them are starving - Our continuous technology development is what enables us to stave off the day of reckoning but - we are losing a Scotland-size worth of topsoil every year to - soil erosion - urban sprawl - We still face the possibility of collapse - Our species has existed for 5 to 6 million years and - civilization is an experiment that has only emerged about 10,000 years ago - It's still very possible for the experiment to fail

    3. we've achieved a level of prosperity for a huge number of people that was not typical of the past i mean most countries have a big middle class as well as an extremely wealthy upper 00:50:00 class but the number of people in abject poverty in the world today living on less than two dollars a day is greater than the entire population of the world 00:50:13 only 100 years ago so that's not progress

      for - statistics - progress trap - comparative levels of poverty

      statistics - progress trap - comparative levels of poverty - modern civilization has - a huge middle class - a small elite class - a huge impoverished class - The absolute number of people living on less than 2 dollars a day is less than the entire population of humans only 100 years ago

    4. that's part of the logic of agriculture isn't it i mean you have a lot of work to do yeah a lot of people you know but there again you're you're in a progress trap or or a treadmill that you need more children 00:48:57 so you can work more land and then that more land provides more food so you have yet more children

      for - progress trap - the agricultural-large family positive feedback loop

      progress trap - the agricultural-large family positive feedback loop - Interesting to compare modern vs agricultural societies - Populations are dropping in most western countries around the contemporary world, yet - traditional agricultural societies had large families to tend to large amount of agricultural work - There is a progress trap potential with encouraging many large families with a limited land resource: - If you have larger families, you can cultivate more land - If you cultivate more land, you can have even larger family - until you reach a point when the land has been exhausted and you are now forced to reduce the population