One of the worst parts of this boom in LLM models is the fact that they can “invade” online spaces and control a narrative. For an example, just go on twitter and scroll to the comments on any tagesschau (german news site) post- it’s all rightwing bots and crap. LLMs do have uses, but the big problem is that a bad actor can basically control any narrative with the amount of sheer crap they can output. And OpenAI does nothing- even though they are the biggest provider. It earns them money, after all.
I also can’t really think of a good way to combat this. If you would verify people using an ID, you basically nuke all semblance of online anonymity. If you have some sort of captcha, it will probably be easily bypassed- it doesn’t even need to be tricked. Just pay some human in a country with extremely cheap labour that will solve it for your bot. It really sucks.
I don’t think people need to enshrine anonymity absolutely to post crap daily for millions of followers. You could have an accreddited human poster who proves not only humanity, but also agrees to a few rules to maintain this credential. And then you could still have non-accredited posters who nobody vouched for, but everyone should instantly doubt and dismiss their big claims as shitposting.
This would also have to be state-provided, because states and citizens are the ones who lose the most with infowarfare, corporations don’t care.
It’s a comprehensive information warfare doctrine.
I’m sorry for how nuts this sounds, but there are all 3 components - 1) the architecture benefiting bot farms, crushing minority opinions and saturating attention, 2) LLM’s and other such means to make this order of magnitude more efficient, 3) surveillance systems and insecure by design software and services so that only powerful would have privacy.
In the end result nobody can hear you scream if a much narrower authority than 20 years ago doesn’t want that.
I couldn’t muster my attention to start re-reading The Last of the Jedi and other such things from the Star Wars 20-0 PBY era, but all this really seems like ascent of a new totalitarian future. A well-prepared one, unlike the rookie attempts in the 1920’s and 1930’s. People in the West are going to feel well and think they have democracy and civilization, and also that parties committing a few holocausts in the other parts of the planet are totally not in bed with that democracy.
One of the worst parts of this boom in LLM models is the fact that they can “invade” online spaces and control a narrative. For an example, just go on twitter and scroll to the comments on any tagesschau (german news site) post- it’s all rightwing bots and crap. LLMs do have uses, but the big problem is that a bad actor can basically control any narrative with the amount of sheer crap they can output. And OpenAI does nothing- even though they are the biggest provider. It earns them money, after all.
I also can’t really think of a good way to combat this. If you would verify people using an ID, you basically nuke all semblance of online anonymity. If you have some sort of captcha, it will probably be easily bypassed- it doesn’t even need to be tricked. Just pay some human in a country with extremely cheap labour that will solve it for your bot. It really sucks.
I don’t think people need to enshrine anonymity absolutely to post crap daily for millions of followers. You could have an accreddited human poster who proves not only humanity, but also agrees to a few rules to maintain this credential. And then you could still have non-accredited posters who nobody vouched for, but everyone should instantly doubt and dismiss their big claims as shitposting.
This would also have to be state-provided, because states and citizens are the ones who lose the most with infowarfare, corporations don’t care.
It’s a comprehensive information warfare doctrine.
I’m sorry for how nuts this sounds, but there are all 3 components - 1) the architecture benefiting bot farms, crushing minority opinions and saturating attention, 2) LLM’s and other such means to make this order of magnitude more efficient, 3) surveillance systems and insecure by design software and services so that only powerful would have privacy.
In the end result nobody can hear you scream if a much narrower authority than 20 years ago doesn’t want that.
I couldn’t muster my attention to start re-reading The Last of the Jedi and other such things from the Star Wars 20-0 PBY era, but all this really seems like ascent of a new totalitarian future. A well-prepared one, unlike the rookie attempts in the 1920’s and 1930’s. People in the West are going to feel well and think they have democracy and civilization, and also that parties committing a few holocausts in the other parts of the planet are totally not in bed with that democracy.