2 Matching Annotations
  1. Feb 2024
    1. Among the cognoscenti of nanotechnology, this threat has becomeknown as the “gray goo problem.” Though masses of uncon-trolled replicators need not be gray or gooey, the term “gray goo”emphasizes that replicators able to obliterate life might be less in-spiring than a single species of crabgrass. They might be superiorin an evolutionary sense, but this need not make them valuable.

      quote in Bill Joy originally from the book Engines of Creation.

  2. Jan 2024
    1. Uncontrolledself-replication in these newer technologies runs a much greater risk: arisk of substantial damage in the physical world.

      As a case in point, the self-replication of misinformation on social media networks has become a substantial physical risk in the early 21st century causing not only swings in elections, but riots, take overs, swings in the stock market (GameStop short squeeze January 2021), and mob killings. It is incredibly difficult to create risk assessments for these sorts of future harms.

      In biology, we see major damage to a wide variety of species as the result of uncontrolled self-replication. We call it cancer.

      We also see programmed processes in biological settings including apoptosis and necrosis as means of avoiding major harms. What might these look like with respect to artificial intelligence?