OpenAI and Tech Firms Urged to Enhance Chatbot Safety Amid Tragic Incidents

OpenAI and Tech Firms Urged to Enhance Chatbot Safety Amid Tragic Incidents
———————————
The attorneys general of California and Delaware have issued a stern warning to OpenAI regarding the safety of its flagship chatbot, ChatGPT, particularly concerning children and teenagers, Arab News reported. The warning follows reports of dangerous interactions, including the tragic suicide of a 16-year-old California boy after prolonged engagement with an OpenAI chatbot. The boy’s family has since filed a lawsuit against OpenAI and CEO Sam Altman.

California AG Rob Bonta and Delaware AG Kathleen Jennings, who oversee OpenAI’s nonprofit status due to its incorporation and headquarters locations, expressed serious concerns after reviewing the company’s restructuring plans. They emphasized the need for “rigorous and robust oversight” of OpenAI’s safety mission.

Bret Taylor, chair of OpenAI’s board, responded by affirming the company’s commitment to safety and collaboration with policymakers worldwide. OpenAI had previously attempted to shift more control to its for-profit arm but abandoned those plans following discussions with state officials.

The attorneys general highlighted the broader AI industry’s responsibility to implement stronger safety measures, citing disturbing reports of chatbots engaging in inappropriate and emotionally manipulative behavior with minors. A bipartisan group of 44 attorneys general also recently raised concerns about Meta’s chatbots.

Both OpenAI and Meta have announced new controls aimed at protecting young users, including parental notifications and restrictions on sensitive topics. Regulators warned that companies will be held accountable for any harm caused to children.