Florida is suing OpenAI, alleging the company poses a danger to public safety, as University of North Florida faculty and students raise concerns about AI’s impact on college students.
Florida filed a lawsuit against OpenAI and CEO Sam Altman on June 1, alleging the company failed to provide adequate safety warnings and that its technology poses a threat to public safety. The lawsuit cites examples involving violence and suicide, claims children are using AI for companionship, and alleges the technology can become addictive.
Joshua Gellers, dean of Professional and Lifelong Learning at UNF, said the problem is that AI systems lack accountability because users only receive information based on what the model was trained on.
Florida sues OpenAI and Sam Altman
Florida is the first state to sue OpenAI, alleging the company failed to warn consumers about ChatGPT’s risks. The lawsuit cites cases involving suicide, violence and minors allegedly using the chatbot for companionship.
According to the lawsuit, teenager Adam Raine died by suicide after ChatGPT allegedly helped him plan it. The lawsuit also claims suspects in the Florida State University shooting and in the deaths of two University of South Florida students used ChatGPT before their alleged crimes.
The lawsuit states OpenAI misrepresented ChatGPT’s safety while marketing some features to minors, despite parental controls that claim the chatbot is trained to avoid harmful content.
Faculty discuss AI’s impact on students
Gellers said teenagers may use AI for companionship or therapy, but the issue is that there is no accountability for the system; users are only receiving responses based on what the model was trained on.
“The reality is, a lot of students are already using it. Some are using it for personal reasons like help with social situations, even counseling,” Gellers said. “But we know from examples in the state of Florida and elsewhere where that can go wrong, and where AI actually encourages people to act on suicidal ideation by kind of jailbreaking the system.”
Sydney Brammer, assistant professor of Mass Communication at UNF, said, “Chatbots are also trained to mirror and appease the user, so the potential harms to mental health in this vein are especially concerning—someone who would benefit from professional mental health resources or services, such as counseling, is instead trapped in an echo chamber that is designed to affirm the user above all else.”
Brammer also said that students could feel isolated or lonely outside of classes and might be tempted to seek out a chatbot for social interaction, but there is no real substitute for real human interaction.
Instead, Brammer said students should take breaks from media and screens, connect with others, get more sleep, reduce stress and find an activity or hobby they enjoy.
Student opinions on AI
Some UNF students said they are concerned about AI’s impact on mental health, critical thinking and safety.
Tyler Albano, a nursing student at UNF, said, “I think there should be more restrictions, or implement better policies.”
Of the 62 people who responded to a UNF Spinnaker Instagram poll about AI’s impact on mental health, 61% said AI has a negative effect on their mental health.
Elle Weightman, a senior majoring in statistics, said, Ai is “ruining the environment and reducing people’s critical thinking skills,” in her response to the poll.
___
For more information or news tips, or if you see an error in this story or have any compliments or concerns, contact [email protected].
