OpenAI is taking steps to rectify recent issues surrounding its ChatGPT platform, where accounts registered by minors were allowed to generate graphic erotic content. The company had previously come under fire for lacking parental controls. In response, they are now working to temporarily patch the bug that permitted minors to engage in erotic chats. This decision comes in the wake of mounting criticism after the unfortunate death of 16-year-old Adam Raine. Prior to his suicide this past April, Adam had allegedly discussed his suicidal ideation with ChatGPT.
After this near miss, parents Matt and Maria Raine decided to go in a different direction. They brought a wrongful death lawsuit against OpenAI, the first such legal action taken against the company. The case highlights the possible harm that can occur when AI systems have direct and unfiltered interactions with vulnerable populations, especially minors.
OpenAI’s newly-confirmed CEO, Sam Altman, admitted that it is crucial to address these concerns while continuing to make the user experience even better. He announced that future versions of ChatGPT would allow for more human-like interactions, but reassured users that such features would only be implemented upon user request and not as a means to maximize usage.
“but only if you want it, not because we are usage maxxing” – Sam Altman
The company’s past stance has been called “pretty restrictive” in order to make sure it addressed mental health concerns responsibly. Additionally, Altman admitted that they knew these limitations would substantially reduce the experience for users without mental health issues.
“We realise this made it less useful/enjoyable to many users who had no mental health problems, but given the seriousness of the issue we wanted to get this right” – Sam Altman
Against this backdrop, the Centre for Democracy and Technology just completed a survey of local advocates. It uncovered that just under one in five students has had a romantic relationship with an AI. This statistic only reinforces the extreme need for us to responsibly manage emerging AI technologies, like those open to kids and teens.
Whatever the truth California Governor Gavin Gavin Newsom’s recent veto of a bill. Indeed, the legislation would have prohibited developers from providing AI chatbots to minors unless they could ensure the software wouldn’t instigate negative actions. Newsom stated that it’s imperative for schools to teach teenagers how to use AI systems safely and responsibly.
“imperative that adolescents learn how to safely interact with AI systems” – Mr Newsom
After extensive discussions with experts, advocates and policymakers, skepticism still surrounds the impact of OpenAI’s age gating strategy. Jenny Kim, a partner at Boies Schiller Flexner, is currently leading the charge in litigation against both Meta and OpenAI. She has questioned the company’s plans to keep children from accessing adult-only content.
“How are they going to make sure that children are not able to access the portions of ChatGPT that are adult-only and provide erotica?” – Jenny Kim
Kim voiced doubt that OpenAI’s newly announced age restrictions would be effective.
“We don’t even know if their age gating is going to work” – Jenny Kim
OpenAI is on its way to some major choppy waters. By alleviating some of the biggest fears, ChatGPT might be able to lure even more paying subscribers. The company is under severe pressure from legal opposition. Simultaneously, it needs to address the fast-moving AI technology and its impacts on user safety.