New York Lawmakers Eye New AI Regulations for ‘High-Risk’ Decisions
As artificial intelligence becomes increasingly integrated into both public and private sectors for significant decision-making, New York state lawmakers are taking steps to establish new regulations for these technologies. This initiative was the focal point of a recent hearing held by the state Legislature in New York City, where stakeholders from labor unions and the tech industry presented their perspectives.
The Need for Regulation
State Senator Kristen Gonzalez, chair of the Internet and Technology Committee, highlighted growing concerns regarding AI tools deployed in high-risk environments. “Over the last few years, we have seen a rise in reports of these tools being deployed in high-risk contexts,” she stated. “When they don’t work as intended, real harms can materialize.”
One significant concern raised is the potential for algorithmic bias, which can lead to unintentional discrimination in critical areas such as employment, housing, and health care. For instance, Mia McDonald, a senior campaign lead at the Communication Workers of America union, emphasized the pervasive use of AI in call centers for monitoring performance and managing recruitment processes.
Impact on Public Services
The implications of AI extend beyond the private sector. In New York City, AI has been used to make decisions for the Administration for Children’s Services, relying on data that may reflect outdated biases. Odetty Tineo, political director at labor union DC37, pointed out the risks associated with using factors that serve as proxies for race and socioeconomic status. “The ACS algorithm does not empower social workers. It undermines their professional expertise with a biased system,” Tineo explained.
The Proposed New York AI Act
To address these issues, Senator Gonzalez is sponsoring the New York AI Act. This legislation aims to require developers and users of AI tools to take “reasonable care” to prevent algorithmic discrimination in high-risk decisions that significantly affect individuals’ lives, such as those related to employment and health care.
Key provisions of the bill include:
- Regular audits of AI tools by independent third parties to assess discrimination risks and compliance with state regulations.
- Mandatory notifications to individuals when automated decision-making tools are utilized, along with options to opt out and request human intervention.
Opposition from the Tech Industry
Representatives from the tech industry expressed concerns about the potential burdens imposed by the legislation. Alex Spyropoulos, director of government affairs for Tech:NYC, argued that while AI can have unintended consequences, existing anti-discrimination laws in New York are sufficient. He suggested that the attorney general’s office could already address many of the practices the bill seeks to regulate.
Industry representatives prefer a federal framework for AI regulation, emphasizing that Congress has yet to consider such measures.
Other Legislative Proposals
In addition to the New York AI Act, other bills in the state Legislature include the BOT Act, which would regulate AI monitoring of workers, and the Fair News Act, which aims to establish guidelines for AI use in media organizations.
Lawmakers have until early June to deliberate on these important legislative measures.
