High-Risk AI Systems: Stakeholder Insights and Guidelines

Targeted Stakeholder Consultation on Classification of AI Systems as High-Risk

This consultation is aimed at gathering insights from various stakeholders regarding the classification of AI systems as high-risk, a significant aspect of the recently enacted Artificial Intelligence Act (the ‘AI Act’), which became effective on August 1, 2024.

Purpose of the Consultation

The primary goal of this consultation is to collect input from stakeholders, which includes providers and deployers of high-risk AI systems, industry organizations, academia, independent experts, civil society organizations, and public authorities. The feedback will help clarify practical examples and issues related to the guidelines for classifying high-risk AI systems and future requirements.

Overview of the AI Act

The AI Act establishes a single market and harmonized rules for trustworthy and human-centric AI within the European Union. Its objectives are to promote innovation and the adoption of AI technologies while ensuring a high level of protection for health, safety, and fundamental rights, including democracy and the rule of law.

One of the key features of the AI Act is its risk-based approach, which categorizes AI systems into different risk levels, including high-risk systems as specified in Chapter III. The obligations for these high-risk systems will come into effect two years after the act’s implementation, specifically from August 2, 2026.

Classification of High-Risk AI Systems

The AI Act distinguishes between two categories of AI systems considered high-risk:

  • Article 6(1): AI systems embedded as safety components in products or that are products covered by Union legislation in Annex I, which may adversely impact health and safety.
  • Article 6(2): AI systems that pose significant risks to health, safety, or fundamental rights based on their intended purpose.

Annex III of the AI Act outlines eight areas where AI systems could potentially pose significant risks, along with specific use cases classified as high-risk. Article 6(3) provides exemptions for certain AI systems intended for specific cases listed in Annex III but do not pose significant risks.

Requirements for High-Risk AI Systems

AI systems classified as high-risk must adhere to several requirements detailed in Chapter III, Section 2, including:

  • Data governance
  • Documentation and record keeping
  • Transparency and user information
  • Human oversight
  • Robustness, accuracy, and security

Providers of high-risk AI systems are obligated to ensure compliance with these requirements, which include implementing a quality management system and conducting a conformity assessment before market placement or service initiation. Additionally, deployers of these systems must meet obligations pertaining to correct usage, human oversight, and monitoring.

Guidelines and Future Directions

According to Article 6(5) of the AI Act, the Commission is tasked with providing guidelines for the practical implementation of high-risk classification rules by February 2, 2026. These guidelines will include a comprehensive list of practical examples of both high-risk and non-high-risk AI systems.

Furthermore, Article 96(1)(a) mandates the development of guidelines on the practical application of requirements for high-risk AI systems and operator responsibilities, including those along the AI value chain as per Article 25.

Structure of the Consultation Questionnaire

The consultation questionnaire is divided into five sections:

  • Section 1: Classification rules of high-risk AI systems as per Article 6(1) and Annex I.
  • Section 2: Classification of high-risk AI systems under Article 6(2) and Annex III.
  • Section 3: General questions regarding high-risk classification.
  • Section 4: Requirements and obligations for high-risk AI systems.
  • Section 5: Need for amendments to the lists of high-risk use cases and prohibited AI practices.

Respondents are encouraged to provide explanations and practical cases to enhance the guidelines’ usefulness. The consultation will be open for 6 weeks, starting from June 6 to July 18, 2025.

Conclusion

All contributions to this consultation will be made publicly available, and individuals can request anonymity for their submissions. The results will be summarized and based on aggregated data, ensuring that respondents are not directly quoted.

More Insights

State AI Regulation: A Bipartisan Debate on Federal Preemption

The One Big Beautiful Bill Act includes a provision to prohibit state regulation of artificial intelligence (AI), which has drawn criticism from some Republicans, including Congresswoman Marjorie...

IBM Launches Groundbreaking Unified AI Security and Governance Solution

IBM has introduced a unified AI security and governance software that integrates watsonx.governance with Guardium AI Security, claiming to be the industry's first solution for managing risks...

Ethical AI: Building Responsible Governance Frameworks

As AI becomes integral to decision-making across various industries, establishing robust ethical governance frameworks is essential to address challenges such as bias and lack of transparency...

Reclaiming Africa’s AI Future: A Call for Sovereign Innovation

As Africa celebrates its month, it is crucial to emphasize that the continent's future in AI must not merely replicate global narratives but rather be rooted in its own values and contexts. Africa is...

Mastering AI and Data Sovereignty for Competitive Advantage

The global economy is undergoing a transformation driven by data and artificial intelligence, with the digital economy projected to reach $16.5 trillion by 2028. Organizations are urged to prioritize...

Pope Leo XIV: Pioneering Ethical Standards for AI Regulation

Pope Leo XIV has emerged as a key figure in global discussions on AI regulation, emphasizing the need for ethical measures to address the challenges posed by artificial intelligence. He aims to...

Empowering States to Regulate AI

The article discusses the potential negative impact of a proposed moratorium on state-level AI regulation, arguing that it could stifle innovation and endanger national security. It emphasizes that...

AI Governance Made Easy: Wild Tech’s Innovative Solution

Wild Tech has launched a new platform called Agentic Governance in a Box, designed to help organizations manage AI sprawl and improve user and data governance. This Microsoft-aligned solution aims to...

Unified AI Security: Strengthening Governance for Agentic Systems

IBM has introduced the industry's first software to unify AI security and governance for AI agents, enhancing its watsonx.governance and Guardium AI Security tools. These capabilities aim to help...