AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

  • JustMy2c@lemm.eeEnglish
    5·
    5 months ago

    I know we don’t like them here but the word reddit is not banned (yet)

      • JustMy2c@lemm.eeEnglish
        1·
        5 months ago

        So you’re saying that “Inflammatory data” isn’t a reference to reddit? :D

        • Daxtron2@startrek.websiteEnglish
          3·
          5 months ago

          Not inherently, I’m sure that’s part of it but it’s really everywhere. Even here on Lemmy I’ve run into nasty folk

              • JustMy2c@lemm.eeEnglish
                1·
                5 months ago

                Obviously but reddit is in the goldilocks zone where you get coherent intelligent stuff and humor and facts.

                But it’s still toxic for an Ai.

                  • JustMy2c@lemm.eeEnglish
                    1·
                    5 months ago

                    Correcto but maybe it DOES apply to most asked questions, if you know where I’m going with that

        • kent_eh@lemmy.caEnglish
          2·
          5 months ago

          I’d say using Twitter and Facebook would be worse than reddit. Or, and I shudder to think about it, truth social…

          • JustMy2c@lemm.eeEnglish
            1·
            5 months ago

            And I’m saying that reddit data is sublime for Ai. And specifically that it’s invested with toxicity