Scientists found more than 1,000 AI spam bots trying to scam people and steal their social media profiles — and regulators can’t keep up::Social media is being flooded with spammy AI content. Research by Indiana University details how artificial intelligence is being used to scam people on social media platforms.

  • wmassingham@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    8
    ·
    1 year ago

    Why is the author suggesting government regulation should be involved here? Spamming and scamming is nothing new, at all. This is on the platforms to actually do a substantial job of moderating.

    • nickwitha_k (he/him)@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      1
      ·
      1 year ago

      Ostensibly, because fraud is criminal behavior that government is supposed to protect its citizens from. In reality, probably more likely part of a fear campaign to have support for things like KOSA and backdooring encryption.

    • Aopen@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 year ago

      This is on the platforms to actually do a substantial job of moderating.

      What else will force companies to moderate if not regulation?

    • Touching_Grass@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      I said it in another thread. Only time I’ve seen media put out articles like this is to generate some new social fear that didn’t exist before so that new laws can be made to fuck over regular people. You can’t go 5 minutes without an “AI IS STEALING GRANDMA” article

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    This is the best summary I could come up with:


    A new study shared last month by researchers at Indiana University’s Observatory on Social Media details how malicious actors are taking advantage of OpenAI’s chatbot ChatGPT, which became the fastest-growing consumer AI application ever this February.

    The rise of social media gave bad actors a cheap way to reach a large audience and monetize false or misleading content, Menczer said.

    New AI tools “further lower the cost to generate false but credible content at scale, defeating the already weak moderation defenses of social-media platforms,” he said.

    In the past few years, social-media bots — accounts that are wholly or partly controlled by software — have been routinely deployed to amplify misinformation about events, from elections to public-health crises such as COVID.

    The AI bots in the network uncovered by the researchers mainly posted about fraudulent crypto and NFT campaigns and promoted suspicious websites on similar topics, which themselves were likely written with ChatGPT, the survey says.

    Yang said that tracking suspects’ social-media activity patterns, whether they have a history of spreading false claims and how diverse in language and content their previous posts are, is a more reliable way to identify bots.


    The original article contains 875 words, the summary contains 191 words. Saved 78%. I’m a bot and I’m open source!