Priya PatelIn recent years, there has been increasing concern over the cybersecurity risks to the democratic process, and the rise of artificial intelligence (AI) only amplifies these concerns. Malicious actors are now using AI-powered deepfake technology to target US elections, with the potential to disrupt the democratic process through mass influence campaigns, automated trolling, and the proliferation of deepfake content.
One of the nightmare scenarios is that microtargeting with AI-generated content will become widespread on social media platforms, similar to the tactics used in the Cambridge Analytica scandal. AI could automate this process at scale, creating highly convincing content that has few “bot” characteristics, thus making it more difficult for users to discern the difference between real and fake content. This could lead to increased polarization and a breakdown of trust in the electoral process.
The adoption of AI also poses risks in terms of phishing and social engineering attacks. AI-generated content can make such attacks more convincing, which increases the likelihood of unsuspecting users interacting with malicious content. Criminal and nation-state adversaries are likely to capitalize on the boom in election-related digital content to deliver malicious content to their targets.
In order to defend against these threats, election officials and campaigns must be aware of the risks posed by AI and take appropriate measures to defend against them. This includes training staff on AI-powered threats, implementing safeguards to control content, and providing education on safe online practices. Long-term regulation that includes watermarking for audio and video deepfakes may also be necessary to mitigate these risks.
