Child safety org flags new CSAM with AI trained on real child sex abuse images
arstechnica.com
AI will make it harder to spread CSAM online, child safety org says.

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It’s the earliest AI technology striving to expose unreported CSAM at scale.

  • Jimbabwe@lemmy.worldEnglish
    35·
    1 day ago

    If AI was reliable, maybe. MAYBE. But guess what? It turns out that “advanced autocomplete” does a shitty job of most things, and I bet false positives will be numerous.

    • pearsaltchocolatebar@discuss.onlineEnglish
      6·
      1 day ago

      It’s possible to have a good AI system, but it takes millions of dollars and several thousand manhours to do, and most companies won’t put in the effort.

      But, there should always be a human in the loop.

    • AwesomeLowlander@sh.itjust.worksEnglish
      4·
      1 day ago

      “detect new or previously unreported CSAM and child sexual exploitation behavior (CSE), generating a risk score to make human decisions easier and faster.”

      False positives don’t matter if they stick to the stated intended purpose of making it easier to detect CSAM manually.

      • Voroxpete@sh.itjust.worksEnglish
        11·
        1 day ago

        The problem is that they won’t.

        Yes, AI tools, in the hands of skilled people, can be very helpful.

        But “AI” in capitalism doesn’t mean “more effective workers”, it means “fewer workers.” The issue isn’t technological so much as cultural. You fundamentally cannot convince an MBA not to try to automate away jobs.

        (It’s not even a money thing; it’s about getting rid of all those pesky “workers rights” that workers like to bring with us)

        • AwesomeLowlander@sh.itjust.worksEnglish
          2·
          1 day ago

          Here’s the thing. This technology is unequivocally one of the things AI would be very useful for. It can potentially do a lot of good. Yes, MBAs could screw it up like they screw anything else up in society. That doesn’t mean we shouldn’t be happy that we’ve created this new tech.