Philadelphia’s Growing AI Programs Face Scrutiny Over Governance and Public Input
Philadelphia is advancing its use of AI in city services, yet residents are expressing concerns about the lack of public visibility surrounding these initiatives. The City Council convened its first significant hearing on AI regulation in October, where representatives from Mayor Cherelle Parker’s administration presented a high-level strategy but withheld specific details regarding the technology’s applications.
Devren Washington, the organizing director for Philly Tech Justice, voiced concerns stating, “Our concerns around the city’s use of technology is that it’s a black box.” This sentiment highlights the need for transparency as the city moves forward.
AI Policy Framework Development
City officials indicated that they aim to create a framework to guide public sector employees in their use of AI by late winter 2025 or early spring 2026. However, progress on this matter remains unclear. Plans include increasing training opportunities and establishing a cross-departmental AI governance committee to oversee and update future policies.
Melissa Scott, the city’s Chief Information Officer, emphasized the importance of these policies in teaching employees to avoid using government data with online tools like ChatGPT and Gemini.
Despite Councilmember Rue Landau’s request for a comprehensive inventory of all AI tools used by the city, the Parker administration did not provide this information, leaving many questions from both council members and the public unanswered.
Concerns Regarding Data Control
At the heart of the discussion lies the issue of data control. Washington stated, “The reason why we are fighting for accountability with the city is because … these companies are getting more control over the data that we are producing, and it’s immensely valuable.” This concern underscores the need for community engagement and oversight in data collection and usage.
Integration of AI in City Services
Philadelphia has a history of experimenting with AI in public spaces. Notable initiatives include:
- The SmartCityPHL project, which involved the Streets Department collaborating with GoodRoads to deploy AI tools for pothole identification in 2021.
- The SmartBlockPHL initiative in 2022, which tested smart sensors on streetlights capable of collecting data on people, objects, and environmental conditions.
- A $4.9 million state grant in 2022 funded SEPTA’s pilot with local startup ZeroEyes, which installed AI-powered gun-detection software across parts of the transit system.
Under Mayor Parker, these initiatives have continued, with SEPTA and the Philadelphia Parking Authority utilizing AI to issue tickets for vehicles in bus lanes.
Public Concerns about Law Enforcement and AI
During the City Council’s AI hearing, residents expressed specific concerns regarding the use of AI in law enforcement. Testimonies did not address how the police department is employing AI or whether there are concerns about its use by Immigration and Customs Enforcement (ICE) in the city. Scott mentioned that she was “unaware” of any instances of AI being deployed against residents by the Philadelphia police, raising further questions about transparency.
Washington pointed out that concerns extend beyond transparency to encompass budget priorities and equity. Algorithms used for training can be biased, leading to prejudiced results. He highlighted issues with the city’s property assessment algorithm, which in 2022 was reported to have distributed the tax burden unequally, particularly affecting neighborhoods with majority Black populations and lower median household incomes.
Importance of Human Oversight
Bray, the chief legal counsel to the mayor, emphasized that maintaining human judgment, public trust, and accountability would remain priorities for officials. “A large theme from all of that testimony was just keeping humans in the process,” noted a Technical.ly reporter, reinforcing the necessity for human auditing in AI systems to ensure their proper function.
As Philadelphia develops its AI programs, the ongoing dialogue between city leaders, stakeholders, and residents will be crucial in shaping a transparent and equitable technological landscape.
