Pa. Senate Passes Bill Regulating AI Chatbots Used by Children and Teens
As unregulated artificial intelligence chatbots gain popularity and raise concerns about safety, state senators nearly unanimously passed a bill aimed at regulating so-called AI companion services.
Overview of the Bill
The proposal, sponsored by Sen. Tracy Pennycuick (R-Montgomery), lays out a series of limited safeguards for operators of chatbot services, defined as generative AI algorithms that simulate human relationships with users. Importantly, these safeguards will only be required when an operator knows or suspects a user is a minor, yet the bill does not explicitly mandate age verification.
Bipartisan Support
The bill garnered a bipartisan group of co-sponsors, with only Sen. Doug Mastriano (R-Franklin) opposing the measure. “These systems are designed to simulate human interaction, and for vulnerable users, they can feel very real,” Pennycuick stated, emphasizing the potential risks when young people rely on machines for emotional support without appropriate safeguards.
Key Provisions of the Bill
The measure includes several crucial requirements for AI companion operators:
- Operators must take steps to ensure their products do not promote self-harm, suicide, or violence towards others.
- They must provide users with real-world resources, such as a crisis hotline number, if a user discusses harming themselves.
- Operators are required to publish related protocols on their publicly accessible website.
Notifications and Content Restrictions
When there is reason to believe a user is a minor, the bill mandates:
- Notification to users that they are interacting with a chatbot.
- Reminders of the chatbot’s non-human status every three hours.
- Suggestions for users to take breaks from the interaction.
For services used by minors, operators are prohibited from generating sexually explicit visual content and from encouraging users to take sexually explicit actions. Additionally, any chatbot offered to minors must notify users that it may not be suitable for individuals under 18.
Enforcement and Penalties
The bill designates the state Attorney General’s office to enforce the law and allows for civil penalties of up to $10,000 for operators that violate these regulations.
Future Steps
Following the Senate’s approval, the proposal must still pass the Democrat-controlled House and be signed by Gov. Josh Shapiro to become law. Shapiro has expressed interest in regulating AI chatbot services, acknowledging the potential dangers associated with overreliance on artificial intelligence.
In summary, this bill represents a significant step towards ensuring the safety of children and vulnerable individuals in their interactions with AI technologies.
