Beijing is expected to step up sophisticated AI-generated disinformation campaigns in an attempt to influence several high-profile elections in 2024, according to Microsoft's threat intelligence team.
Microsoft warned that state-sponsored Chinese cyber groups backed by North Korea “will likely target” presidential and congressional elections this year in the United States, South Korea, India and other countries. Their main tactic is predicted to be to create and spread AI-generated content on social media that is skewed “to favor their positions” in these elections.
“While the impact of this content on audience sentiment remains low, China is increasingly experimenting with amplifying memes, videos and audio, which may prove to be more effective in the future,” Microsoft warned in a report published on Friday.
The company cited China's recent “dry run” of AI-synthesized disinformation in Taiwan's presidential election in January as a sign of this new threat. Microsoft assessed that the pro-Beijing group known as Storm 1376, or Spamouflage Dragon, was the first documented attempt by a state actor to use AI-generated content to influence a foreign vote.
Tactics deployed by China-backed operatives included posting fake supposedly “AI-generated” audio clips depicting a former presidential candidate endorsing a rival, as well as AI-generated memes alleging unfounded corruption allegations against pro-independence candidate William Lai, who ultimately won. The group also created an AI-rendered “news anchor” to broadcast false information about Lai's private life.
“As citizens in India, South Korea and the United States head to the polls, Chinese cyber and influence actors, and to some extent North Korean cyber actors, will likely be active in targeting these elections,” the Microsoft report said.
The company added that Chinese groups are already attempting to map divisive issues and voting blocs in the US through coordinated social media campaigns, potentially “collecting intelligence and accuracy on key voter demographics ahead of the US presidential elections.”
While warning of the risks, Microsoft acknowledged that AI-enabled disinformation has so far had limited success in shaping public opinion globally, but warned that Beijing's growing investment and technological sophistication pose a growing threat to the integrity of democratic elections around the world.
(Photo courtesy of Element5 Digital)
reference: How to protect your business from AI-generated deepfakes
Want to learn more about AI and big data from industry leaders? Check out the AI & Big Data Expo in Amsterdam, California and London, a comprehensive event taking place alongside other major events like BlockX, Digital Transformation Week and Cyber Security & Cloud Expo.
Find out about upcoming enterprise technology events and webinars hosted by TechForge here.
