AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

    • JustMy2c@lemm.eeEnglish
      5·
      11 months ago

      I know we don’t like them here but the word reddit is not banned (yet)

        • JustMy2c@lemm.eeEnglish
          1·
          11 months ago

          So you’re saying that “Inflammatory data” isn’t a reference to reddit? :D

          • Daxtron2@startrek.websiteEnglish
            3·
            11 months ago

            Not inherently, I’m sure that’s part of it but it’s really everywhere. Even here on Lemmy I’ve run into nasty folk

                • JustMy2c@lemm.eeEnglish
                  1·
                  11 months ago

                  Obviously but reddit is in the goldilocks zone where you get coherent intelligent stuff and humor and facts.

                  But it’s still toxic for an Ai.

          • kent_eh@lemmy.caEnglish
            2·
            11 months ago

            I’d say using Twitter and Facebook would be worse than reddit. Or, and I shudder to think about it, truth social…

            • JustMy2c@lemm.eeEnglish
              1·
              11 months ago

              And I’m saying that reddit data is sublime for Ai. And specifically that it’s invested with toxicity