IndiaAI Unveils Five Innovative Projects for AI Safety and Trust

IndiaAI Selects Five AI Projects for Deepfake Detection, Bias Mitigation, and Generative AI Testing

The Central government’s artificial intelligence initiative, IndiaAI, has selected five groundbreaking projects aimed at reinforcing its “Safe and Trusted AI” framework. These projects focus on critical areas such as deepfake detection, bias mitigation, and generative AI security.

Background and Purpose

This announcement follows the second round of expressions of interest (EoI) initiated in December 2024 under the IndiaAI Mission. The primary goal of this mission is to ensure the ethical and transparent deployment of AI systems within India.

According to the Ministry of Electronics and Information Technology (MeitY), the initiative received over 400 proposals from a diverse range of stakeholders, including academic institutions, startups, research organizations, and civil society. A multi-stakeholder committee meticulously reviewed these submissions, ultimately shortlisting five innovative projects.

Selected Projects for Safe and Trusted AI Development

The five projects selected for further development include:

  • Saakshya: A multi-agent framework for deepfake detection and governance, developed by IIT Jodhpur and IIT Madras.
  • AI Vishleshak: A tool developed by IIT Mandi and the Directorate of Forensic Services, Himachal Pradesh, which enhances audio-visual deepfake and signature forgery detection using explainable AI.
  • Real-Time Voice Deepfake Detection System: Developed by IIT Kharagpur.
  • Evaluating Gender Bias in Agriculture LLMs: A project by Digital Futures Lab and Karya that aims to create digital public goods for benchmarking and fair data work.
  • Anvil: A penetration testing and evaluation tool for generative AI systems, led by Globals ITES Pvt Ltd and IIIT Dharwad.

Significance of the Selected Projects

IndiaAI has emphasized that these initiatives will bolster its commitment to establishing a secure, transparent, and inclusive AI ecosystem. The projects combine real-time forensics, resilience testing, and bias audits, ensuring that AI models deployed in India are accountable and reliable.

A senior official associated with the IndiaAI Mission stated, “These projects represent India’s drive to not only adopt AI but to shape it responsibly. By developing indigenous tools for detection, testing, and fairness evaluation, India aims to lead globally in safe AI innovation.”

Broader Mission of IndiaAI

IndiaAI operates as an independent business division under MeitY and serves as the implementation agency for the national AI strategy. Its objectives include improving access to artificial intelligence, promoting ethical AI practices, and fostering technological self-reliance.

The Safe and Trusted AI pillar is part of a multi-dimensional approach that encompasses building foundational models, advancing AI compute infrastructure, and fostering responsible AI adoption across various sectors, including agriculture, healthcare, and public safety.

Recently, IndiaAI has partnered with leading research institutes and private sector players to advance AI governance and data ethics frameworks, highlighting a growing emphasis on balancing innovation with responsibility in India’s rapidly expanding digital ecosystem.

The IndiaAI Mission has been approved with a significant budget outlay of ₹10,371.92 crore over the next five years.

Conclusion

The selected projects illustrate a proactive approach towards managing the challenges posed by AI technologies, ensuring their safe deployment while addressing critical issues such as bias and misinformation. As these initiatives progress, they will play a pivotal role in shaping a responsible AI landscape in India.

More Insights

Rethinking AI Innovation: Beyond Competition to Collaboration

The relentless pursuit of artificial intelligence is reshaping our world, challenging our ethics, and redefining what it means to be human. As the pace of AI innovation accelerates without a clear...

Pakistan’s Ambitious National AI Policy: A Path to Innovation and Job Creation

Pakistan has introduced an ambitious National AI Policy aimed at building a $2.7 billion domestic AI market in five years, focusing on innovation, skills, ethical use, and international collaboration...

Implementing Ethical AI Governance for Long-Term Success

This practical guide emphasizes the critical need for ethical governance in AI deployment, detailing actionable steps for organizations to manage ethical risks and integrate ethical principles into...

Transforming Higher Education with AI: Strategies for Success

Artificial intelligence is transforming higher education by enhancing teaching, learning, and operations, providing personalized support for student success and improving institutional resilience. As...

AI Governance for Sustainable Growth in Africa

Artificial Intelligence (AI) is transforming various sectors in Africa, but responsible governance is essential to mitigate risks such as bias and privacy violations. Ghana's newly launched National...

AI Disruption: Preparing for the Workforce Transformation

The AI economic transformation is underway, with companies like IBM and Salesforce laying off employees in favor of automation. As concerns about job losses mount, policymakers must understand public...

Accountability in the Age of AI Workforces

Digital labor is increasingly prevalent in the workplace, yet there are few established rules governing its use. Executives face the challenge of defining operational guidelines and responsibilities...

Anthropic Launches Petri Tool for Automated AI Safety Audits

Anthropic has launched Petri, an open-source AI safety auditing tool that automates the testing of large language models for risky behaviors. The tool aims to enhance collaboration and standardization...

EU AI Act and GDPR: Finding Common Ground

The EU AI Act is increasingly relevant to legal professionals, drawing parallels with the GDPR in areas such as risk management and accountability. Both regulations emphasize transparency and require...