Networks in China and Iran also used AI models to create and post disinformation but campaigns did not reach large audiences
In Russia, two operations created and spread content criticizing the US, Ukraine and several Baltic nations. One of the operations used an OpenAI model to debug code and create a bot that posted on Telegram. China’s influence operation generated text in English, Chinese, Japanese and Korean, which operatives then posted on Twitter and Medium.
Iranian actors generated full articles that attacked the US and Israel, which they translated into English and French. An Israeli political firm called Stoic ran a network of fake social media accounts which created a range of content, including posts accusing US student protests against Israel’s war in Gaza of being antisemitic.
Techbros once again surprised at how their technology is used.
The other breaking headlines for today:
Shock discovery that water is wet.
Toddler discovers that fire is hot after touching it.
Bear shits in woods.
Pope revealed to be Catholic.
We aren’t naive. We all knew this will happen. But, as it happened, it was better than banning AI in the free world and giving dictators advantages in AI tech.
Ah, the old “the only way to stop a bad person with a gun is for all the good people to have guns” argument.
Were the dictators even working on their own large language models, or do these tools only exist because OpenAI made one and released it to the public before all the consequences had been considered, thus sparking an arms race where everyone felt the need to jump in on the action? Because as far as I can see, ChatGPT being used to spread disinformation is only a problem because OpenAI were too high on the smell of their own arses to think about whether making ChatGPT publicly available was a good idea.
Exactly.
Gods this whole “if we outlaw AI only outlaws will have AI” bullshit is so so tiresome and naive
It really is. I’m also not a huge fan of “everyone needs to have access to their own personal open source AI, otherwise only corporations will be able to use it”, like somehow the answer to corporations being shit is to give everyone else a greater ability to be shit too. What the world really needs is even more shit!
Well fortunately it doesn’t matter what you think, and people will keep developing and improving open source AI nonetheless.
Just don’t complain when the world becomes even more shit than it already is. Open source AIs that rely on scraping content without paying the creator are just as exploitative of workers as corporate AIs doing the exact same thing.
Removed by mod
I already write one reply to tell my main point. But whatever argument you come up with, I don’t think that’ll match the reality as viewed by AI researchers. If you give me specific short questions I’d be happy to engage in a discussion, with conditions on time.
In any case, I won’t listen to metaphoric arguments like yours with guns because metaphoric arguments are very difficult to do scientifically. Every situation is different. I mean that anybody can always end the discussion saying “that’s oranges vs apples”, and everything time this happens you’d not have an objective way to counter that.
The metaphoric argument is exactly on point, though: the answer to “bad actors will use it for evil” is not “so everybody should have unrestricted access to this really dangerous thing.” Sorry, but in no situation you can possibly devise is giving everyone access to a dangerous tool the correct answer to bad people having access to it.
I can say it’s both on point and not. For the not, you can ban the gun in the UK and it will be very difficult to bring one from the continent. Peace. But the same is not true for AI. If the UK government bans AI, Russia can still bring it through the internet.
And then I can still counter-argue that one, and then counter-argue this one also. See what a mess a metaphoric arguments bring.
Had OpenAI not released ChatGPT, making it available to everyone (including Russia), there are no indications that Russia would have developed their own ChatGPT. Literally nobody has made any suggestion that Russia was within a hair’s breadth of inventing AI and so OpenAI had better do it first. But there have been plenty of people making the entirely valid point that OpenAI rushed to release this thing before it was ready and before the consequences had been considered.
So effectively, what OpenAI have done is start handing out guns to everyone, and is now saying “look, all these bad people have guns! The only solution is everyone who doesn’t already have a gun should get one right now, preferably from us!”
The reality is, passing this huge amount of data was the only way these crazy current AI models work as powerful as ChatGPT. With a restriction like you fantasize, the AI programs would have been dominated by bad actors and the west would not have a counter technology for a decade if not longer.
Regulating the outputs of AIs would be a separate story. But it’s still overwhelmingly difficult. OpenAI is actually advanced in this region in the sense that they have in pocket the single best technology to politically balance the replies by a chatbot.
AI programs are already dominated by bad actors, and always will be. OpenAI and the other corporations are every bit the bad actors as Russia and China. The difference between Putin and most techbros is as narrow as a sheet of paper. Both put themselves before the planet and everyone else living on it. Both are sociopathic narcissists who take, take, take, and rely on the exploitation of those poorer and weaker than themselves in order to hoard wealth and power they don’t deserve.
This is just labeling. You can label everything as bad at will. I’m fine with that, it’s called “you’re entitled to your opinion”. That’s not objective though.
Well, let’s see about the evidence, shall we? OpenAI scraped a vast quantity of content from the internet without consent or compensation to the people that created the content, and leaving aside any conversations about whether copyright should exist or not, if your company cannot make a profit without relying on labour you haven’t paid for, that’s exploitation.
And then, even though it was obvious from the very beginning that AI could very easily be used for nefarious purposes, they released it to the general public with guardrails that were incredibly flimsy and easily circumvented.
This is a technology that required being handled with care. Instead, its lead proponents are of the “move fast and break things” mentality, when the list of things that can be broken is vast and includes millions of very real human beings.
You know who else thinks humans are basically disposable as long as he gets what he wants? Putin.
So yeah, the people running OpenAI and all the other AI companies are no better than Putin. None of them care who gets hurt as long as they get what they want.
it was better than banning AI in the free world and giving dictators advantages in AI tech.
The US doesn’t need to ban AI. It just needs to stop publicly deploying it, untested and unregulated, on the masses. And some of these big tech companies need to stop releasing open models that can be easily obtained and abused by bad actors. Dictatorships don’t actually like AI internally, because it threatens their control of the narrative within their country. For example, the CCP has been very cautious of it when compared to the US because it is concerned about how it could be employed against the party.
And this whole arms race argument sort of ignores the fact that the US continuing to mass deploy this shit at breakneck speed is already giving the dictators the advantages they need to fuck with democracy. No one needs to have a real war with the US if it starts one with itself.
AI told me the Pope shit in the woods and that bears are Catholic.
And probably also that water is hot and fire is wet?
Before there was ChatGPT to blame, we had the “50 cent army.” The fully automated bullshit generators are a cheaper but also a less effective way to do what was already being done. I expect the real problem is somewhere closer to the design of mass social media and the human weaknesses it has evolved to exploit, not so much the super-human powers of generative AI which have been so greatly exaggerated.
No shit, Sherlock.
You mean to tell me that the purpose-built disinformation machine that you developed has been used by malicious actors to spread disinformation?!
Not that surprising unfortunately :/
🤖 I’m a bot that provides automatic summaries for articles:
Click here to see the summary
OpenAI on Thursday released its first ever report on how its artificial intelligence tools are being used for covert influence operations, revealing that the company had disrupted disinformation campaigns originating from Russia, China, Israel and Iran.
As generative AI has become a booming industry, there has been widespread concern among researchers and lawmakers over its potential for increasing the quantity and quality of online disinformation.
OpenAI claimed its researchers found and banned accounts associated with five covert influence operations over the past three months, which were from a mix of state and private actors.
An Israeli political firm called Stoic ran a network of fake social media accounts which created a range of content, including posts accusing US student protests against Israel’s war in Gaza of being antisemitic.
The US treasury sanctioned two Russian men in March who were allegedly behind one of the campaigns that OpenAI detected, while Meta also banned Stoic from its platform this year for violating its policies.
OpenAI stated that it plans to periodically release similar reports on covert influence operations, as well as remove accounts that violate its policies.
Saved 67% of original text.
Oh hi anyone who monitors my posts accusing other users of being potentially disinfo bots — as if that totally isn’t a thing we all know about at this point
