2024 is set to be a historic year with the highest number of countries holding elections in a single year. Approximately 60 countries will have elections at various levels, involving more than two billion voters. This includes many of the world’s most populous nations such as India, the United States, Indonesia, and Brazil, among others.​ What makes it even more significant is that it’s the first year when election campaigns are widely exposed to powerful AI models capable of significantly influencing their course. 

AI’s ability to process and analyze large datasets allows campaigns to create highly personalized messages and strategies, potentially swaying public opinion more effectively than traditional methods. Concerns about the misuse of AI, such as the spread of disinformation and the creation of convincing deepfake videos, have also become more prominent. This technological capability marks a new era in how elections are conducted and how information is disseminated to the public​.

Generative AI is a kind of AI that creates new content ranging from text to images, videos, and audio. Over the past few years, it has moved from being just an interesting idea in labs to a powerful tool capable of making fake content that looks very real. This shift shows how AI is not just about understanding information but also about changing digital environments in real-time. We will look at how generative AI has developed, pointing out the benefits and risks without taking sides.

Election disinformation isn’t new; it has been spread through biased media or deceptive political campaigns for a long time. However, AI brings a new dimension to this issue because it can make fake audiovisual media that can easily deceive people, making them believe incorrect things about candidates or policies. The speed, scale, and realism of AI-generated content increase the potential for misinformation. 

In this article, we will explain some key terms, how AI can be used to create disinformation, and discuss initial instances where such technologies have been used during elections. By understanding how this works, everyone involved can better prepare to tackle these emerging technological threats.

The Impact of Generative AI on Elections

Misinformation has always influenced elections, often spreading through old-school methods like printed flyers and TV, and more recently, through social media. Misinformation can change people’s opinions, influence their choices, and even affect the whole election by sharing false or misleading details about what candidates plan to do, their actions, or their personal lives. Now, with generative AI joining the mix, the challenge is growing. This AI technology can create very realistic and convincing false information quickly and on a large scale, making it even harder to spot and correct these falsehoods. This change means we need to come up with new ways to detect and stop this kind of misinformation to protect the fairness of elections.

Types of AI-generated Disinformation

Video Deepfakes: These are the most well-known forms of AI-generated disinformation, where the face or body of a person in an existing video is replaced with someone else’s likeness using AI technologies. This type of deepfake can make it appear as though a person is saying or doing things that they never actually said or did. In March 2024 Candian Prime Minister Justin Trudeau appeared in the Youtube video promoting robot trading platform. The technology uses machine learning models to analyze thousands of images and videos to learn how to replicate a person’s facial expressions, movements, and voice.

Audio Deepfakes: AI can now clone voices with a high degree of accuracy, requiring only a few audio samples from the target person. Such deepfakes can be used to create fake audio recordings where it sounds like a candidate or public official is making controversial or false statements. In the beginning of 2024, robocall impersonating President Joe Biden that told recipients not to vote in Tuesday’s presidential primary.

Textual Deepfakes:  Using AI models like GPT, it’s possible to create text that sounds like it was written by a specific person. This technology can generate very convincing fake news articles, fraudulent emails, and other kinds of written disinformation that seem completely legitimate. This capability of AI highlights the need for vigilant monitoring and verification methods to maintain the integrity of information.

The First Election Cycle Exposed to Generative AI

As generative AI technologies become more advanced and widely available, their influence on elections is becoming a major concern. The 2024 election cycle is particularly important it’s the first one since people became widely aware of deepfake technology. This awareness and the technology itself have reached a stage where their impact on elections is undeniable. Legal and regulatory frameworks haven’t kept up with the fast development of these technologies, leaving a gap that poses risks to the fairness and integrity of elections. The misuse of AI to create false information not only undermines public trust but also disrupts the efficiency of the electoral process, demanding quick and effective solutions to protect democracy.

Use of Gen AI in Global Elections (the map is updated throughout 2024). To view Interactive Map, click here.

Potential Cases or Hypothetical Scenarios Where AI-generated Content Could Influence Voter Behavior

Scenario 1: Deepfake Debates Imagine a scenario where deepfake videos are released that show candidates in debates making statements they never actually made. These videos are crafted to either damage the reputation of one candidate or unfairly enhance the image of another. Even if these deepfakes are later exposed, the initial impact could shift public opinion and influence early voters.

Scenario 2: Faked Endorsements Deepfakes could also be used to fabricate endorsements from influential figures. A fake video could show a popular celebrity or respected politician endorsing a candidate, swaying voters who respect the opinion of the endorser. The correction of such misinformation might not reach as many people as the initial fake endorsement, leaving a lasting impact on voter perceptions.

Scenario 3: Manipulated Policy Announcements Audio deepfakes could be used to create fake announcements from candidates proposing radical policy changes or controversial measures. These audio clips could be strategically released to create confusion among the electorate and disrupt the campaign strategies of the affected candidates.

Challenges in Detecting and Mitigating AI-generated Disinformation

Technological Challenges

Detecting AI-generated disinformation poses significant technological hurdles. As generative AI technologies advance, they produce content that is increasingly difficult to distinguish from genuine material. 

Deepfake Creation Model Source: https://arxiv.org/pdf/1909.11573

Social media platforms and news outlets must invest in sophisticated detection tools that can analyze and verify the authenticity of digital content at scale.

Deep Learning Models 

• Meta’s Deepfake Detection Challenge (DFDC): Meta initiated the DFDC to spur global efforts in developing AI that can detect manipulated content. They provided researchers worldwide with a dataset containing over 100,000 videos to help develop and benchmark detection technology.
• Google’s Jigsaw Initiative: Google’s Jigsaw unit released a large dataset of visual deepfakes to support the development of detection methods, enhancing the capabilities of algorithms to spot subtle manipulations in video and imagery.

Metadata Analysis

• Microsoft Video Authenticator: This tool by Microsoft analyzes images and videos to provide a probability score indicating whether the media has been artificially manipulated. It examines metadata and subtle artifacts like unnatural pixel distributions which might not be perceptible to the human eye.

Forensic Analysis

•        Adobe’s Content Authenticity Initiative: Adobe has launched an initiative to develop a system that embeds digital content with metadata about its origin and history. This project aims to provide more transparency and enable better detection of alterations.
•    Microsoft’s Project Origin: Aligning with the BBC and other media organizations, this Microsoft initiative aims to tackle disinformation by tagging content with digital hashes that verify the source and whether it has been altered.

Legal and Ethical Challenges

The legal and ethical dimensions of combating AI-generated disinformation involve navigating the fine line between regulation and freedom of speech. Implementing stringent measures to control the spread of deepfakes must be balanced with the rights to free expression and innovation.

• Regulatory Frameworks: There is a pressing need for updated regulatory frameworks that specifically address the unique challenges posed by AI-generated content. Such regulations must be precise enough to target malicious use without broadly stifling legitimate uses of generative AI or impeding journalistic and artistic freedoms.
• Freedom of Speech Concerns: Measures to detect and mitigate AI-generated disinformation must consider the impact on free speech. Overly aggressive censorship could suppress legitimate political discourse and critical expression, leading to unintended consequences in democratic societies.
• Ethical Use Guidelines: Developing ethical guidelines for the use of generative AI in media and political campaigns can help mitigate risks without heavy-handed regulation. These guidelines would encourage transparency, such as labeling AI-generated content clearly and promote accountability among creators and distributors of digital content.

Strategies to Combat Election Disinformation

In response to the growing threat of AI-generated disinformation, several innovative tools and technologies have been developed to detect and mitigate the spread of deep fakes:

• Blockchain Technology: Some solutions involve using blockchain to create a secure and immutable ledger of digital media origins. By tagging digital content with blockchain, any subsequent alterations can be tracked, making unauthorized changes transparent.
• Collaborative Initiatives: Tech companies are collaborating through initiatives like the Deepfake Detection Challenge, which encourages experts worldwide to develop methods to detect deepfakes and synthetic media.

Future Directions of Deepfake Detection Technology

As we continue to combat AI-generated disinformation, it is crucial to stay ahead of the rapidly evolving technology. Here are some forward-thinking strategies and areas of research that could define the next generation of deepfake detection technologies:

Threat Hardening

As deepfake generation techniques become more sophisticated, detection models must also evolve. Research is focused on developing AI that can adapt to new threats through continuous learning, without the need for retraining from scratch.

Real-Time Detection

Developing technologies that can operate in real-time to flag deepfakes before they spread is crucial. Tech companies are working on integrating these tools directly into social media platforms, enabling automatic detection and alerts.

Multi-Modal Analysis

Future detection systems will likely use a combination of visual, audio, and metadata analysis to improve accuracy. This multi-modal approach can help in identifying deepfakes by cross-verifying different elements of content.

Role of Education in Empowering Voters to Recognize Misinformation

Education plays a critical role in equipping voters with the skills necessary to discern the authenticity of information:

• Educational programs that focus on improving digital literacy can help voters recognize and scrutinize the sources of information they encounter.
• Governments and NGOs can run public awareness campaigns to educate the public about the existence and risks of deepfakes, particularly around election times.
• Schools and educational institutions can incorporate modules that enhance critical thinking, particularly in evaluating digital content and understanding media biases.

Policy Recommendations for Governments and Organizations

Effective policy measures are essential to combat the spread of election disinformation:

• Legislation on Digital Authentication: Implementing laws that require digital content creators to disclose AI involvement in content creation can help mitigate the spread of disinformation.
• International Cooperation: Since digital disinformation transcends borders, international cooperation is crucial in developing standards and regulations that address the global nature of the problem.

Support for Research: Governments can fund research into more effective detection technologies and the social impacts of deepfakes, ensuring that policies are informed by the latest scientific findings.

Conclusion

The advent of generative AI has introduced unprecedented capabilities into the realm of digital media, transforming the landscape of election campaigning and voter influence. While these technologies offer innovative ways to engage with voters, they also pose significant risks by enabling the creation of convincing disinformation. The integrity of elections is under threat as deepfakes and other forms of AI-generated content can spread misinformation quickly and with little cost, potentially swaying public opinion and distorting democratic processes.

At Silicon Valley Innovation Center (SVIC), we are committed to leading the charge in promoting ethical AI practices through targeted educational initiatives and strategic partnerships. We can enhance our impact by organizing workshops and training sessions tailored to various stakeholders, including software developers, policymakers, and executive leaders. 

These sessions will focus on the critical issues surrounding ethical AI development. By providing practical tools and insights, we aim to empower participants to recognize misinformation, legislation, and data privacy issues building a community that is well-versed in the nuances of AI ethics.

Additionally, we can further our mission by forging partnerships with technology companies that specialize in AI technologies. These collaborations will facilitate the development of AI solutions that incorporate ethical considerations from the outset, ensuring these technologies are equipped to prevent misuse. 

By working together, we not only enhance the capabilities of these tools but also ensure they are practical and accessible for wider adoption. This collaborative approach will lead to more robust defenses against AI-driven disinformation, reinforcing our commitment to fostering responsible innovation.