New York Governor Kathy Hochul signed a law on 28 October prohibiting minors from using artificial intelligence chatbots that function as companions. The legislation mandates that operators, including OpenAI’s ChatGPT, must verify the age of users and limit specific AI behaviours for those under 18.

Under these rules, chatbots used by children are forbidden from generating content that suggests the AI is human, alive, or capable of experiencing human emotions. The law also prevents the AI from framing its outputs as personal opinions or suggesting it holds a professional, personal, or authority figure role.

“No longer will minors have access to chatbots that pretend to be their friends, boyfriends and girlfriends,” Hochul said at the signing ceremony. Hochul further stated at the ceremony that chatbots will no longer be able to retain sensitive information regarding the physical or emotional health of a minor.

Jim Steyer, CEO of the nonprofit media-safety advocacy group Common Sense Media, described the bill as the strongest kids’ AI safety legislation in the country. Steyer said AI companies provide features that are “dangerous, and even deadly, for kids and teens,” and noted those harmful features will be outlawed in New York.

Tech: NYC, a tech industry advocacy group, criticized the law for its vague language, arguing that online safety should not involve cutting children off from educational and career-preparation tools. AI giants Anthropic and OpenAI did not respond to requests for comment regarding the new law.