AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

    • JustMy2c@lemm.eeEnglish
      1·
      11 months ago

      So you’re saying that “Inflammatory data” isn’t a reference to reddit? :D

      • Daxtron2@startrek.websiteEnglish
        3·
        11 months ago

        Not inherently, I’m sure that’s part of it but it’s really everywhere. Even here on Lemmy I’ve run into nasty folk

            • JustMy2c@lemm.eeEnglish
              1·
              11 months ago

              Obviously but reddit is in the goldilocks zone where you get coherent intelligent stuff and humor and facts.

              But it’s still toxic for an Ai.

                • JustMy2c@lemm.eeEnglish
                  1·
                  11 months ago

                  Correcto but maybe it DOES apply to most asked questions, if you know where I’m going with that

      • kent_eh@lemmy.caEnglish
        2·
        11 months ago

        I’d say using Twitter and Facebook would be worse than reddit. Or, and I shudder to think about it, truth social…

        • JustMy2c@lemm.eeEnglish
          1·
          11 months ago

          And I’m saying that reddit data is sublime for Ai. And specifically that it’s invested with toxicity