• Skull giver@popplesburger.hilciferous.nl
    link
    fedilink
    arrow-up
    66
    ·
    8 months ago

    I think the advancement of LLMs, which culminated in the creation of ChatGPT, is this generation’s Eternal September. In a couple of decades, we’ll talk about how the internet “used to be” before free, public websites were abandoned because our CAPTCHAs could no longer filter out bots and device attestation and continuous mictopayments became the only way to keep platforms spam free.

    Even when Microsoft and OpenAI stop hemorrhaging money by giving away stuff like ChatGPT for basically free, the spam farms will run this stuff on their own soon. I expect a wave of internet users to get upset and call paying for used services “enshittification”, because people don’t realise how much running these AI models actually costs.

    I think this will also start the transition of not only AI being sold like Netflix or like mobile data caps, but also to an “every company that doesn’t get the most expensive AI will start lagging behind” economy. After all, AI only needs to cost a little less than the manpower it’s replacing. Any internet facing company needs good AI to outwit the AI trying to abuse cheap or free services (like trials) that they may offer.

    We’re probably lucky that AI spammers haven’t discovered the Fediverse yet, but if the Fediverse does actually become big enough for mainstream use, we’ll see Twitter level reaction spam in no time, and no amount of CAPTCHAs will be able to stop it.

    • Kichae@lemmy.ca
      link
      fedilink
      English
      arrow-up
      36
      ·
      8 months ago

      Part of what makes Twitter, Reddit, etc. such easy targets for bot spammers is that they’re single-point-of-entry. You join, you have access to everyone, and then you exhaust an account before spinning up 10 more.

      The Fediverse has some advantages and disadvantages here. One significant advantage is that – particularly if, when the dust finally settles, it’s a big network of a large number of small sites – it’s relatively easy to cut off nodes that aren’t keeping the bots out. One disadvantage, though, is that it can create a ton of parallel work if spam botters target a large number of sites to sign up on.

      A big advantage, though, is that most Fediverse sites are manually moderated and administered. By and large, sites aren’t looking to offload this responsibility to automated systems, so what needs to get beaten is not some algorithmic puzzle, but human intuition. Though, the downside to this is that mods and admins can become burned out dealing with an unending stream of scammers.

      • Skull giver@popplesburger.hilciferous.nl
        link
        fedilink
        arrow-up
        25
        ·
        8 months ago

        We had a bunch of Japanese teenagers run scripts on their computers and half the Fediverse was full of spam. If someone really cared about spamming, this shit wouldn’t stop as quickly.

        No Fediverse tools have sufficient spam prevention measures right now. The best we have is individually blocking every server, but there are thousands of servers that can be abused by a very basic account creation + spam script.

        Manal moderation will lead to small/single user instances getting barred from participating, leading back to centralisation on a few vetted servers. We need automated tools, across all parts of the Fediverse, or the network will be in a constant flux between waves of spam and overbearing defederation to fight the spam waves. Especially once spammers start bypassing CAPTCHAs.

        • ᴇᴍᴘᴇʀᴏʀ 帝@feddit.uk
          link
          fedilink
          English
          arrow-up
          6
          ·
          8 months ago

          We had a bunch of Japanese teenagers run scripts on their computers and half the Fediverse was full of spam. If someone really cared about spamming, this shit wouldn’t stop as quickly.

          The upside of that attack is that instance Admins had to raise their game and now most of the big instances are running anti-spam bots and sharing intelligence. Next time we’ll be able to move quickly and shut it all down, where this time we were rather scrambling to catch up. Then the spammers will evolve their attack and we’ll raise our game again.

        • Kichae@lemmy.ca
          link
          fedilink
          English
          arrow-up
          2
          ·
          8 months ago

          It’s true that the toolset isn’t here now, and the network is actually very fragile at the moment.

          It’s also true that platform builders don’t seem to want to deal with these kinds of tools, for raisins.

          But it’s also true that temporary blocks are both effective and not that big of a deal.

          I’m not sure why you’d think that manual moderation will lead to small instances getting barred, though. Unless you’re predicting that federation will move to whitelisting, rather than blacklisting? That’s historically been the tool of corporate services, not personal or community ones.

      • explodicle@local106.com
        link
        fedilink
        English
        arrow-up
        16
        ·
        8 months ago

        If it really ramps up, we could share block lists too, like with ad blockers. So if a friend (or nth-degree friend) blocks someone, then you would block them automatically.

    • Rottcodd@kbin.social
      link
      fedilink
      arrow-up
      22
      ·
      8 months ago

      I expect a wave of internet users to get upset and call paying for used services “enshittification”, because people don’t realise how much running these AI models actually costs.

      I am so tired of this bullshit. Every time I’ve turned around, for the past thirty years now, I’ve seen some variation on this same basic song and dance.

      Yet somehow, in spite of supposedly being burdened with so much expense and not given their due by a selfish, ignorant public, these companies still manage to build plush offices on some of the most expensive real estate on the planet and pay eight- or even nine-figure salaries to a raft of executive parasites.

      When they start selling assets and cutting executive salaries, or better yet laying them off, then I’ll entertain the possibility that they need more revenue. Until then, fuck 'em.

        • Rottcodd@kbin.social
          link
          fedilink
          arrow-up
          4
          ·
          edit-2
          8 months ago

          What “entitlement?”

          I don’t expect anyone to start a web site or service or to give me or anyone else access to it at all, much less for free.

          I’m just making the very narrow point that when a company chooses to do all of that, and manages to make enough money to build a plush corporate headquarters on some of the most expensive real estate on the planet and pay its executives millions or even tens or hundreds of millions of dollars, then starts crying about not making enough money, that’s self-evident bullshit.

          If anybody’s acting"entitled" in that scenario, it’s the greedy corporate weasels who spend billions on their own privilege, then expect us to cover their asses when they come up short.

    • 🦊 OneRedFox 🦊@beehaw.org
      link
      fedilink
      English
      arrow-up
      14
      ·
      8 months ago

      We’re probably lucky that AI spammers haven’t discovered the Fediverse yet, but if the Fediverse does actually become big enough for mainstream use, we’ll see Twitter level reaction spam in no time, and no amount of CAPTCHAs will be able to stop it.

      I was thinking about this the other day. We might have to move to a whitelist federation model with invite-only instances at some point.

      • Skull giver@popplesburger.hilciferous.nl
        link
        fedilink
        arrow-up
        5
        ·
        8 months ago

        The downside of that approach is that AI can pretend to be humans wanting to join quite well. It’s possible to set up a lobster.rs like system where there’s a tree of people you’ve invited so admins can cull entire spam groups at once, but that also has its downsides (i.e. it’s impossible to join if none of your friends have already joined, or if you don’t want to attach your online socials to your friends).

        • flashgnash@lemm.ee
          link
          fedilink
          arrow-up
          2
          ·
          8 months ago

          I don’t think that’s a perfect system anyway though, spammers could create a massive tree of fake accounts and just only use a small proportion of them for spam

          Use a number of compromised user accounts to set this up and it becomes a nightmare

        • PenguinCoder@beehaw.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          8 months ago

          where there’s a tree of people you’ve invited.

          And that is how you get singular point of view echo chamber.

          • Robin.Net (she/her)@beehaw.org
            link
            fedilink
            arrow-up
            6
            ·
            8 months ago

            Most of the internet is made up of echo chambers now even though anyone and everyone can access a majority of it. I don’t think being selective in who we allow into communities worsens the pre-existing echo chamber issue. If anything it may help to be more selective. It can sometimes be impossible to tell the difference between trolls, bots, and real people, so I feel like we assume every person we disagree with is a troll or bot. The issue with that is that we may be outright dismissing real opinions. In theory, everyone in a selective community is a real person who is expressing their true thoughts and feelings.

    • Lvxferre@mander.xyz
      link
      fedilink
      arrow-up
      8
      ·
      8 months ago

      Instead of being this gen’s September 1993, I feel like the changes being sped up by the introduction of generative models are finally forcing us into October 1993. As in: they’re reverting some aspects of the internet to how they used to be.

      also to an “every company that doesn’t get the most expensive AI will start lagging behind” economy.

      That spells tragedy of the commons for those companies. They ruining themselves will probably have a mixed impact on us [Internet users in general].