Regulating the Deepfake Dilemma

Reckoning With the Rise of Deepfakes

The emergence of deepfakes has raised significant concerns regarding their implications for privacy, misinformation, and regulatory challenges. Deepfakes are synthetic media, including images, audio, and videos that are generated using advanced machine learning techniques. These technologies can produce content that appears hyper-realistic, making it increasingly difficult for the public to distinguish between genuine and manipulated media.

The Evolution of Deepfakes

Initially, deepfakes appeared on platforms like Reddit in 2017, where users posted sexually explicit content featuring the faces of celebrities superimposed on other bodies. Since then, deepfake technology has evolved, leading to various applications—both beneficial and harmful. For instance, in the medical field, deep learning algorithms can accurately locate cancerous tumors and predict the spread of cancerous regions. In education, deepfakes can resurrect historical figures for interactive lessons, enhancing engagement in classrooms and museums.

Legal and Ethical Considerations

Despite the potential benefits, the majority of deepfake videos are associated with sexually explicit content, disproportionately targeting women and minors, raising serious privacy and abuse concerns. Scholars warn that the proliferation of deepfakes threatens both individual privacy and public trust in information. The technology has already been used to fabricate speeches by political figures, undermining democratic institutions and disseminating disinformation.

Prior to the TAKE IT DOWN Act, states had individually regulated AI-generated intimate imagery. As of 2025, all 50 states and Washington, D.C. have enacted laws targeting the nonconsensual distribution of intimate images, with some updating their language to include deepfakes. However, these laws vary significantly in scope and enforcement.

The TAKE IT DOWN Act

Enacted on May 19, 2025, the TAKE IT DOWN Act represents the first federal statute criminalizing the distribution of nonconsensual intimate images, including those generated using AI. This Act prohibits the dissemination of such content with penalties of up to two years’ imprisonment. Furthermore, it mandates online platforms to establish notice-and-takedown procedures, requiring the removal of flagged content within 48 hours.

Many experts agree on the necessity to regulate harmful deepfakes. However, there are concerns that broad legislation could infringe upon First Amendment rights, particularly in contexts like satire or political speech. Legal scholars debate how to address the harms posed by deepfakes without undermining protected expression.

Challenges and Recommendations

As deepfake technology continues to advance, lawmakers face the challenge of curbing its damaging applications while preserving free speech and fostering innovation. Scholars propose various frameworks for addressing deepfakes, including the right of publicity (ROP), which may provide a balanced approach by mitigating harm while protecting First Amendment rights through fair use provisions.

It is imperative for governments, technology companies, and researchers to collaborate on establishing clear ethical guidelines and regulatory frameworks that can adapt to the rapidly changing landscape of synthetic media technologies. Such coordinated efforts are crucial to safeguarding individuals, businesses, and political institutions from the threats posed by deepfakes.

Conclusion

The rise of deepfakes presents complex challenges that require nuanced regulatory responses. While the technology holds promise for various applications, its potential for abuse necessitates a proactive approach to regulation that balances innovation with the protection of individual rights. The ongoing discourse surrounding deepfakes underscores the urgent need for effective governance to address the ethical and legal dilemmas they pose.

More Insights

US Rejects UN’s Call for Global AI Governance Framework

U.S. officials rejected the establishment of a global AI governance framework at the United Nations General Assembly, despite broad support from many nations, including China. Michael Kratsios of the...

Agentic AI: Managing the Risks of Autonomous Systems

As companies increasingly adopt agentic AI systems for autonomous decision-making, they face the emerging challenge of agentic AI sprawl, which can lead to security vulnerabilities and operational...

AI as a New Opinion Gatekeeper: Addressing Hidden Biases

As large language models (LLMs) become increasingly integrated into sectors like healthcare and finance, a new study highlights the potential for subtle biases in AI systems to distort public...

AI Accountability: A New Era of Regulation and Compliance

The burgeoning world of Artificial Intelligence (AI) is at a critical juncture as regulatory actions signal a new era of accountability and ethical deployment. Recent events highlight the shift...

Choosing Effective AI Governance Tools for Safer Adoption

As generative AI continues to evolve, so do the associated risks, making AI governance tools essential for managing these challenges. This initiative, in collaboration with Tokio Marine Group, aims to...

UN Initiatives for Trustworthy AI Governance

The United Nations is working to influence global policy on artificial intelligence by establishing an expert panel to develop standards for "safe, secure and trustworthy" AI. This initiative aims to...

Data-Driven Governance: Shaping AI Regulation in Singapore

The conversation between Thomas Roehm from SAS and Frankie Phua from United Overseas Bank at the SAS Innovate On Tour in Singapore explores how data-driven regulation can effectively govern rapidly...

Preparing SMEs for EU AI Compliance Challenges

Small and medium-sized enterprises (SMEs) must navigate the complexities of the EU AI Act, which categorizes many AI applications as "high-risk" and imposes strict compliance requirements. To adapt...

Draft Guidance on Reporting Serious Incidents Under the EU AI Act

On September 26, 2025, the European Commission published draft guidance on serious incident reporting requirements for high-risk AI systems under the EU AI Act. Organizations developing or deploying...