AI-Powered Deepfake Scam Sparks Concern Over Rise of Artificial Intelligence-Driven Fraud in China

Police said the perpetrator used AI-powered face-swapping technology to impersonate a friend of the victim during a video call.

By Reuters | Updated: 22 May 2023 17:25 IST

AI-Powered Deepfake Scam Sparks Concern Over Rise of Artificial Intelligence-Driven Fraud in China

Photo Credit: Reuters

The case sparked discussion on Weibo about the threat to online privacy and security

Highlights

China has been tightening scrutiny of AI-powered technology and apps
The country adopted new rules in January to legally protect victims
Police said they had recovered most of the stolen funds

A fraud in northern China that used sophisticated "deepfake" technology to convince a man to transfer money to a supposed friend has sparked concern about the potential of artificial intelligence (AI) techniques to aid financial crimes.

China has been tightening scrutiny of such technology and apps amid a rise in AI-driven fraud, mainly involving the manipulation of voice and facial data, and adopted new rules in January to legally protect victims.

Police in the city of Baotou, in the region of Inner Mongolia, said the perpetrator used AI-powered face-swapping technology to impersonate a friend of the victim during a video call and receive a transfer of CNY 4.3 million ($622,000, roughly Rs. 5,15,52,000).

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

He transferred the money in the belief that his friend needed to make a deposit during a bidding process, the police said in a statement on Saturday.

The man only realised he had been duped after the friend expressed ignorance of the situation, the police added, saying they had recovered most of the stolen funds and were working to trace the rest.

The case unleashed discussion on microblogging site Weibo about the threat to online privacy and security, with the hashtag "#AI scams are exploding across the country" gaining more than 120 million views on Monday.

This Is How AI Voice-Cloning Tools Can Spread Misinformation on Social Media

"This shows that photos, voices and videos all can be utilised by scammers," one user wrote. "Can information security rules keep up with these people's techniques?"

Samsung Galaxy A34 5G was recently launched by the company in India alongisde the more expensive Galaxy A54 5G smartphone. How does this phone fare against the Nothing Phone 1 and the iQoo Neo 7? We discuss this and more on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.