dr.chaos

AI used to fake voices of loved ones in “I’ve been in an accident” scam

Aamir Lakhani2 min read

Phishing continues to be the number one attack vector and impersonation attacks are not new. What is interesting is how there are threat actors using AI to enhance classic attacks.

I’ve seen various versions of this attack from claims that I didn’t pay my taxes BUT I can wire money now (see more on this HERE), calling older targets and telling them their grandkids were arrested but they can pay the bail over wire, and the most common being you sell something on craiglist/facebook and the buyer wants to wire you money now but there is a business account meaning you have to wire money to upgrade to a business account. All of these have pretty easy red flags to spot however, imagine HEARING your son’s voice generated by AI. This can be much harder to spot mixed with the panic included with the story being told by the attacker.

The good news is you can always fall back on the same defense tactics. The ones I live by are the following:

  • Never assume trust. Nobody will get super angry if you ask them to verify who they are through questions only they will know. Just state you want to verify this isn’t some crazy scam and ask something only they will know.

  • Question any situation that needs action right now. Most scammers are creating panic and hope the target takes a quick action. If you feel you are being pushed to do something, pause and consider you may be getting scammed.

  • Validate evidence. If somebody is hurt, you should be able to hang up and call them back at the number you know. If something happened such as the tax example, you should be able to log into the official website (never use provided links from the potential threat) and validate what they say is real. One key example is the classic business account scam stating they paid you but you get a email saying you need to wire money to open a business account. Just log into your real account to validate they are full of it.

The post from malwarebits talking about this scam can be found HERE.

Other things to consider to avoid this scam are the following (as stated in the post):

How to avoid scams like this

One of the main tools for the imposters is the amount of information they can round up about the target. Their main sources will include social media and phishing.

There are a few simple precautions to lessen the chances of falling victim to such scams:

  • Avoid letting third parties know too many personal details about you.

  • Do not answer telephone calls from numbers you do not recognize or calls from private numbers.

  • Ask for the caller’s telephone number and check it.

  • If necessary, try to reach your allegedly implicated family member by phone. If you can’t reach them directly, call someone else who might know where they are.

  • Hang up if in doubt and never give financial or personal information to the caller.

  • If you receive or have received such a call, please notify the police immediately and under no circumstances respond to the perpetrators’ demands.

originally posted on: https://www.thesecurityblogger.com/ai-used-to-fake-voices-of-loved-ones-in-ive-been-in-an-accident-scam/

Aamir Lakhani

Founder · Dr. Chaos

Aamir Lakhani is a leading senior security strategist responsible for providing IT security solutions to major enterprises and government organizations. He creates technical security strategies and leads security implementation projects for…

~/related

Keep digging

More research along the same attack path.

Your API Key Was Someone Else's Credit Card: The OpenCode Console Breach

OpenCode called it a "large scale distillation attack." The victims called it an overnight bill. What happened to OpenCode Console users' stored OpenAI, Anthropic, and Google keys, why a hosted key store changes the blast radius, what "distillation" can and cannot mean here, a twenty-minute key lockdown for each provider, and what anyone building a bring-your-own-key console should change.

Aamir Lakhani12 min read

ATT&CK Finally Has a Name for Prompt Injection. Now Write the Detection.

MITRE ATT&CK v20 adds five AI techniques to the Enterprise matrix: Direct and Indirect Prompt Injection under Execution, AI-Enabled Exfiltration, AI Result Poisoning, and Impair Autonomous Defenses. Why the placement matters more than the count, what the direct versus indirect split means for your trust boundaries, how MITRE's exfiltration analytic actually works, and the detection gaps you should know about before your next coverage report.

Aamir Lakhani12 min read

Meta's Muse Wonder Has Your Calendar. Who Holds the Guardrails?

Meta's Muse Wonder and Muse Wonder Full are real frontier models built for personal agents. What Meta shipped, how to read its benchmark and safety charts, what independent tests and six launch-week videos found, what r/MetaAI users are saying, and why the security that matters lives in the Muse product, not in the model developers get through the API.

Aamir Lakhani18 min read