• 5BC2E7@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    ·
    7 months ago

    I hope they put some failsafe so that it cannot take action if the estimated casualties puts humans below a minimum viable population.

      • Echo Dot@feddit.uk
        link
        fedilink
        English
        arrow-up
        4
        ·
        7 months ago

        Yes there is that’s the very definition of the word.

        It means that the failure condition is a safe condition. Like fire doors that unlock in the event of a power failure, you need electrical power to keep them in the locked position their default position is unlocked even if they spend virtually no time in their default position. The default position of an elevator is stationery and locked in place, if you cut all the cables it won’t fall it’ll just stay still until rescue arrives.

      • afraid_of_zombies@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        7 months ago

        I mean in industrial automation we take about safety rating. It isn’t that rare when I put together a system that would require two 1-in-million events that are independent of each other to happen at the same time. That’s pretty good but I don’t know how to translate that to AI.

        • Echo Dot@feddit.uk
          link
          fedilink
          English
          arrow-up
          3
          ·
          7 months ago

          Put it in hardware. Something like a micro explosive on the processor that requires a heartbeat signal to reset a timer. Another good one would not be to allow them to autonomously recharge and require humans to connect them to power.

          Both of those would mean that any rogue AI would be eliminated one way or the other within a day

    • lad@programming.dev
      cake
      link
      fedilink
      English
      arrow-up
      5
      ·
      7 months ago

      Of course they will, and the threshold is going to be 2 or something like that, it was enough last time, or so I heard