15 Matching Annotations
  1. Sep 2024
    1. nobody told it what to do that's that's the kind of really amazing and frightening thing about these situations when Facebook gave uh the algorithm the uh uh aim of increased user engagement the managers of Facebook did not anticipate that it will do it by spreading hatefield conspiracy theories this is something the algorithm discovered by itself the same with the capture puzzle and this is the big problem we are facing with AI

      for - AI - progress trap - example - Facebook AI algorithm - target - increase user engagement - by spreading hateful conspiracy theories - AI did this autonomously - no morality - Yuval Noah Harari story

    2. when a open AI developed a gp4 and they wanted to test what this new AI can do they gave it the task of solving capture puzzles it's these puzzles you encounter online when you try to access a website and the website needs to decide whether you're a human or a robot now uh gp4 could not solve the capture but it accessed a website task rabbit where you can hire people online to do things for you and it wanted to hire a human worker to solve the capture puzzle

      for - AI - progress trap - example - no morality - Open AI - GPT4 - could not solve captcha - so hired human at Task Rabbit to solve - Yuval Noah Harari story

  2. Aug 2024
    1. Degradation ofecosystem services could be significantly slowed down or even reversed if the role ofbiodiversity and its full contribution to economic production were an integrated part ofdecisions made by governmental entities, companies, and other stakeholders (Paul et al2020)20

      for - biodiversity - impact of monoculture diet

      biodiversity - impact of monoculture diet - FAO study done before 2000 and often cited shows that 75% of the global diet comes from 12 plant and 5 animal food sources

      to - stats - progress trap - monoculture - table of 12 plant and 5 animal species that make up 75% of world's diet - https://hyp.is/iznepFWoEe-umbNyOGVqrg/thefuturemarket.com/biodiversity

  3. Jul 2024
    1. 26:30 Brings up progress traps of this new technology

      26:48

      question How do we shift our (human being's) relationship with the rest of nature

      27:00

      metaphor - interspecies communications - AI can be compared to a new scientific instrument that extends our ability to see - We may discover that humanity is not the center of the universe

      32:54

      Question - Dr Doolittle question - Will we be able to talk to the animals? - Wittgenstein said no - Human Umwelt is different from others - but it may very well happen

      34:54

      species have culture - Marine mammals enact behavior similar to humans

      • Unknown unknowns will likely move to known unknowns and to some known knowns

      36:29

      citizen science bioacoustic projects - audio moth - sound invisible to humans - ultrasonic sound - intrasonic sound - example - Amazonian river turtles have been found to have hundreds of unique vocalizations to call their baby turtles to safety out in the ocean

      41:56

      ocean habitat for whales - they can communicate across the entire ocean of the earth - They tell of a story of a whale in Bermuda can communicate with a whale in Ireland

      43:00

      progress trap - AI for interspecies communications - examples - examples - poachers or eco tourism can misuse

      44:08

      progress trap - AI for interspecies communications - policy

      45:16

      whale protection technology - Kim Davies - University of New Brunswick - aquatic drones - drones triangulate whales - ships must not get near 1,000 km of whales to avoid collision - Canadian government fines are up to 250,000 dollars for violating

      50:35

      environmental regulation - overhaul for the next century - instead of - treatment, we now have the data tools for - prevention

      56:40 - ecological relationship - pollinators and plants have co-evolved

      1:00:26

      AI for interspecies communication - example - human cultural evolution controlling evolution of life on earth

    1. example is weaponry

      for - progress trap - example - weapons leading to nuclear weapons

      progress trap - example - weapons leading to nuclear weapons - These are the most ironic inventions of civilization - We spend significant percentages of our budgets maintaining and escalating them, meanwhile, we all know we cannot use them as it would mean billions would die

      quote progress trap - nuclear weapons - When you're talking nuclear weapons that can never be used you're investing in something that's completely useless - that you're maybe burying in the ground in the form of missile silos or - you're putting into submarines or - into aircraft or missiles - You can never use these things and they are draining off the surplus that might otherwise be used into - wealth redistribution and into - long-term sustainability

    2. another example would be um the internal combustion engine

      for - progress trap - example - internal combustion engine / fossil fuels

      progress trap - example - internal combustion engine / fossil fuels - This is one of my favorite examples. - Nobody could foresee that the ICE burning fossil fuels could lead us to destabilize Earth's entire climate system

    3. the really big progress traps uh come with with the invention of 00:07:20 agriculture and i i mentioned the first full-blown civilization in the old world the sumerians who perfected the art of irrigation 00:07:33 in what is now southern iraq

      for - progress trap - example - from history - Sumerian civilization

      progress trap - example - from history - Sumerian civilization - the really big progress traps uh come with with the invention of agriculture and - i mentioned the first full-blown civilization in the old world the sumerians who perfected the art of irrigation in what is now southern iraq and - for for several centuries everything went really well - They had built canals and ran the water onto the desert and were able to - raise more and more crops and - expand their farmland and - expand their population and - their cities got bigger - their numbers got greater but - what they didn't know is that the kind of irrigation they were practicing - was causing the land to get saltier and saltier - and after a number of centuries they suddenly saw their farm meals declining because of salinity - and they had to switch to crops that could tolerate more salt - and then eventually they ended up producing only about one quarter of the food that they'd been able to produce when they started -and the civilization collapsed - So they had walked into what i call in my book a progress trap - and this is where the myth of progress is so seductive - You do something that in the short run produces obvious benefits so you're getting this positive feedback from some new invention, whether it's - a new way to drive mammoth over a cliff or - it's a new way to expand your farm base through irrigation - but there's a hidden cost down the road which is often hard to foresee

  4. Jun 2024
    1. getting a base model to you know make money by default it may well learn to lie to commit fraud to deceive to hack to seek power because 00:47:50 in the real world people actually use this to make money

      for - progress trap - AI - example - give prompt for AI to earn money

      progress trap - AI - example - instruct AI to earn money - Getting a base model to make money. By default it may well learn - to lie - to commit fraud - to deceive - to hack - to seek power - because in the real world - people actually use this to make money - even maybe they'll learn to - behave nicely when humans are looking and then - pursue more nefarious strategies when we aren't watching

  5. Jan 2024
    1. In 2017, Facebook mistranslated a Palestinian man’s post, which said “good morning” in Arabic, as “attack them” in Hebrew, leading to his arrest.
      • for: example - progress trap - AI - mistranslation
  6. Dec 2023
    1. i think it's more likely that 00:49:59 that we will think we will think that we this particular set of procedures ai procedures that we linked into our strategic nuclear weapons system uh will keep us safer but we haven't recognized that they're 00:50:12 unintended that there are consequences glitches in it that make it actually stupid and it mistakes the flock of geese for an incoming barrage of russian missiles and and you know unleashes everything in response 00:50:25 before we can intervene
      • for: example - stupid AI - nuclear launch, AI - progress trap - example - nuclear launch
  7. Nov 2023
  8. Oct 2023
    1. every time we try to pick at one piece of this polycrisis we end up actually creating problems in other contexts
      • for: polycrisis, quote, quote - polycrisis, quote - Nora Bateson

      • quote

        • every time we pick at one piece of those polycrisis we end up actually creating more problems in other contexts
      • author: Nora Bateson

      • example

        • climate change If we do, all emissions suddenly, we will create an economic crisis, then without money, a health and social crisis
  9. Aug 2023
    1. the problems I've mentioned are being tackled by groups of people 00:11:18 sad thing is those people are often operating in silos just concerned to solve their particular problem not realizing that if they don't have the whole picture they may solve their 00:11:31 problem and cause problems in other places
      • for: indyweb, silos, emptiness - example, entanglement - example, progress trap
      • paraphrase
      • quote
        • all the problems I've mentioned are being tackled by groups of people
        • sad thing is those people are often operating in silos just concerned to solve their particular problem
          • not realizing that if they don't have the whole picture they may solve their problem
          • and cause problems in other places
      • author
        • Jane Goodall
      • comment
        • the Indyweb and SRG strategy is designed specifically to mitigate progress traps through radical collaboration built into the communication and information system itself.