Child safety org flags new CSAM with AI trained on real child sex abuse images
arstechnica.com
AI will make it harder to spread CSAM online, child safety org says.

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It’s the earliest AI technology striving to expose unreported CSAM at scale.

  • Churbleyimyam@lemm.eeEnglish
    12·
    1 month ago

    I think all CSAM should be destroyed out of respect for the victims, not proliferated. I don’t care who is hanging onto this material or for what purpose.

    • Ghostie21@lemmy.worldEnglish
      17·
      1 month ago

      How is this proliferating csam? Also, how do you expect them to find csam without having known images? It gives a really nice way to check based on hashes without having someone look at every picture on someone’s harddrive. With this AI it should greatly help determining new or unknown images while minimizing the number of actual people that have to see that stuff, and who get scarred from looking at such images. The only reason to be against this is if you are looking at CP and want it to be harder to find, or if you don’t understand how this technology is being used.

      • Churbleyimyam@lemm.eeEnglish
        2·
        1 month ago

        How is this proliferating csam?

        Sharing it with people and companies that it wasn’t being shared with before.

        Also, how do you expect them to find csam without having known images?

        The same way it is now: people reporting it and undercover police accounts. People recognise it.

        without having someone look at every picture on someone’s harddrive

        If it’s going to get used as evidence in court a human will have to review and confirm it. I don’t think “Because the AI said so” is going to convince juries.

        The only reason to be against this is if you are looking at CP

        Or if it’s you or someone you love who is in the CP. Having further copies of it on further hard drives, whether it’s so someone can bake it into their AI tool or any other purpose is wrong. That’s just my view though.

        • Ghostie21@lemmy.worldEnglish
          2·
          1 month ago

          Sorry I cannot post a longer response but I’d suggest you look up how this type of forensic software is developed and used. There are a few good documentaries on it if you look, one I remember watching was on googles team for this stuff.

          The images are not exactly shared in that very few people have access to them, and they treat it very much like classified information so that only select people can see them.

          These models would be developed using normal images and then trained in closed systems with the real images where the accuracy is used and not the images. No need to scar the developers who just want to work.

          Nothing about the reporting of people will change, the only difference is this will allow the FBI to have a list of suspected CP and a list of normal images from a computer allowing them to spend a fraction of the time looking at this stuff to document it. This is very important when you have people who have literally terrabytes of the stuff and probably even more normal images. In general we like to minimize the time spent looking at such stuff because it is so scarring.

          As for showing the images in court, in the US hashes are acceptable evidence, again we don’t like to scar people by showing them this stuff. Additionally after you’ve been shown the 100th picture of a baby being abused and the FBI is telling you they have 1000000 more, you’ll just take their word for it.

          Anyways, hope you have a good one

    • sunzu2@thebrainbin.org
      12·
      1 month ago

      This ain’t about the victims… It never was, otherwise churches would NOT exist in current form.

      This is about police and corpo state gaining power.