PA Senate Passes Regulation of AI Chatbots Used by Kids & Teens
As unregulated artificial intelligence chatbots gain popularity and raise concerns about safety, the state senators of Pennsylvania have nearly unanimously passed a bill aimed at regulating these so-called AI companion services.
Overview of the Legislation
The proposal, sponsored by Sen. Tracy Pennycuick (R-Montgomery), outlines a series of limited safeguards for operators of chatbot services, which are defined as generative AI algorithms that simulate human relationships with users. Notably, these safeguards will only be required when an operator knows or suspects that a user is a minor. However, the bill does not explicitly mandate age verification.
Bipartisan Support
The bill received support from a bipartisan group of co-sponsors, with only Sen. Doug Mastriano (R-Franklin) opposing the measure. According to Pennycuick, “These systems are designed to simulate human interaction, and for vulnerable users they can feel very real.” She emphasized that reliance on machines for emotional support without proper safeguards could have devastating consequences.
Key Provisions
The legislation requires all AI companion operators to take steps to ensure that their products do not promote self-harm, suicide, or violence towards others. Furthermore, it mandates that users be provided with real-world resources, such as crisis hotline numbers, if they express thoughts of self-harm.
Operators will also need to publish their related protocols on a publicly accessible website. In instances where there is reason to believe a user is a minor, the bill requires operators to:
- Notify users that they are not human.
- Remind them of this every three hours.
- Suggest that they take a break from usage.
Additionally, when services are being used by minors, operators are prohibited from generating sexually explicit visual content or encouraging sexually explicit actions. Chatbots offered to minors must also inform users that they may not be suitable for individuals under 18.
Enforcement and Penalties
The bill designates the state Attorney General’s office to enforce these regulations, with civil penalties of up to $10,000 for AI service operators that violate the law.
Future Steps
In a statement following the bill’s passage in the Senate, it was acknowledged that the potential dangers associated with overreliance on artificial intelligence are real. The statement noted that online chatbots have played roles in various tragedies across the nation and stressed the importance of protecting children and vulnerable residents from toxic online interactions.
The proposal still requires approval from the Democrat-controlled House and must be signed by Gov. Josh Shapiro to become law. Shapiro has already expressed intentions to seek ways to regulate AI chatbot services.
