Uh there’s zero chance these big techs are selling voices like this. Also, this sounds very targeted and planned, so there must be more context to this. Also, why the hell are they on bluesky?
They’re on BlueSky because there are more people there that would actually believe this total load of bullshit. Plenty of scams that will claim to be vague family member (no names; just like “son” or “daughter,” “aunt” or “uncle”) but highly unlikely they’re getting an AI to mimic your voice. Just like vagueness of the family member they claim to be, the voices used may coincidentally sound similar.
All of these articles are making it up then? https://www.nytimes.com/2023/08/30/business/voice-deepfakes-bank-scams.html https://www.cnn.com/2023/04/29/us/ai-scam-calls-kidnapping-cec/index.html https://abcnews.go.com/Technology/experts-warn-rise-scammers-ai-mimic-voices-loved/story?id=100769857 https://finance.yahoo.com/news/ai-supercharges-voice-scams-making-it-easier-for-americans-to-fall-prey-143635279.html https://www.cbsnews.com/news/scammers-ai-mimic-voices-loved-ones-in-distress/
Because its probably the best twitter alternative
Not even close to Mastodon
Bluesky is more usable than Mastodon purely because it doesn’t use a decentralized model. Sure it defeats the purpose, but on the plus side it removes some serious inconveniences that the true fediverse comes with, for example i’ve never been on Bluesky and found myself unable to upvote someone because i’ve accidentally left my instance.
Bluesky is decentralized
Yeah but who owns the servers currently running it? If it’s decentralized but the same entity owns all the servers, then it’s not decentralized. Seems obvious
I wish I were this naive
Oh they totally are. Maybe not this directly, but there is an awful depth to the data market. One company may be selling to the next and the next and you end up with companies just buying all the data they can to sell police surveillance software running off of fucking Candy Crush telemetry.
you don’t even need to fake a voice for these scams tho, it’s very difficult to differentiate q voice while you’re crying
Do a lot of people put their voice on the internet “as much as they’re able to”? It sounds like that person may post their voice online more than the average person…
Discord just automatically started putting you opt in for having your voice recorded for clips
If you post videos of yourself online, your voice will be caught. Whether social media or public presence as a streamer. I’m pretty sure that’s all they meant.
I imagine even discounting social media self-posts, there are VoIP calls, etc.
Don’t assume a call with your mom through Facebook Messenger or Zoom or FaceTime or whatever is not somehow packaged and sold.
Everyone shhhhhhhh
Where did they get their voice?
You can train AI with just a single voice clip. You can do this on your desktop. Microsoft doesn’t need to sell shit, you put that clip on tiktok yourself.
Really? How?
The ‘old’ way of faking someone’s voice like you saw in 90s spy movies was to get enough sample data to capture each possible speech sound someone could make, such that those sounds can be combined to form all possible words.
With AI training you only need enough data to know what someone sounds like ‘in general’ to extrapolate a reasonable model.
One possible source of voice data is spam-calls.
You get a call, say “Hello?” And then someone launches into trying to sell you insurance or some rubbish, you say “Sorry I’m not interested, take me off your list please. Okay, bye” and hang up.
And that is already enough data to replicate your voice.
When scammers make the call using your fake voice, they usually use a crappy quality line, or background noise, or other techniques to cover up any imperfections in the voice replica. And of course they make it really emotional, urgent and high-stakes to override your family member’s logical thinking.
Educating your family to be prepared for this stuff is really important.
Clutch explanation. I just sent a screenshot of your comment to my folks.
Yeah I’m gonna go ahead and not give that knowledge out.
Okay well thanks for letting me know lol
It’s okay to say you don’t know
Oh gee, someone on the Internet thinks I’ll say it if they tell me they think I’m bluffing. My ego is so hurt! I’d better spill the beans on these unregulated technologies!
Do you think you’re protecting some too-powerful technology that should stay secret? Am I seriously the only person in this thread who knows how to use a search engine?
If they’re too stupid to figure it out, they’re too stupid to consider its implications and consequences when using it. I’m not going to give a weapon to a toddler for the same reason.
You don’t even need to upload anything. They can call you, have a short convo and then just say “oh sorry wrong number” or something. You’d never know.
Yet another reason to screen your calls. I never pick up unless I know the number.
Yup. You need like 5 to 15 seconds of talking, that’s it. I’ve done this myself to confirm it works actually quite well with.
Well they said they dont share their voice anywhere, if thats true it would be concerning. I for one just dont use any centralized unencrypted services that could scrape my voice but i would assume most people think that if they dont publish anything, they are safe…
When I was a kid, my parents had “the talk” with me. It was about sex. Now I’m older and my parents are too. I have to have “the talk” with them. It’s about scams.
Voicemail greeting.
I dont have one. The automated message is just reading my number and telling you to leave a message.
People still set that?
My voicemail is just me going “BRRRRRRRKZM” or some sort of screaming distorted gibberish
Seriously, it was only one person, and it was with a golf cart.
All those TV shows that taught us how to spot which twin was the evil one by asking about life history were just training us to beat AI
They can also be used to train the ai…
Waiting for the comment that’s going to say something like, “Joke’s on you, my parents don’t even talk to me.”
My parents probably do not talk to you either.
Mine can’t stand them.
The only way to train an AI voice model is to have lots of samples. As scummy as they are, neither Microsoft nor Apple is selling your voice recordings with enough info to link them to you specifically. This person probably just forgot about an old social post where they talk for enough time for a model to be trained. Still super scary stuff.
Not true anymore. You can create a reasonable voice clone with like 30 seconds of audio now (11labs for example doesn’t do any kind of authentication). The results are good enough for this kind of thing, especially in a lower bandwidth situation like a phone call.
True for creating voices at all, but that work has already been done.
Now we’re just taking these large AI’s trained to mimic voices and giving them a 30 second audio clip to tell them what to mimic. It can be done quickly and give convincing results especially when hidden by the phonecall quality.
Tbh it’s not that hard to stop scams. Treat EVERY call you get as a scammer!
Either phone back on a known number, not some shit they give you or if they claim you need bail, ask for a reference number and the place being held and phone them after looking up the number, and If they get pissed, it’s a scam!
No real police force is going to care/shouldn’t care if you call back. It’s not like cops get a percentage of bail money but scammers always seem too desperate to get you to pay and lose it pretty quick.
I advise everyone to contact their loved ones and inform them of this possibility. I also advise having some codeword that would be used if there was an emergency and money needs to be sent.
For example is more than $100 is being asked for we have to share the code word or we should not transfer money.
They don’t even have to scrape calls. If you use Alexa, Siri or Google Assistant, they already have recordings of your voice on their servers
What kind of bill are you going to pay for killing 2 people tho
