Article
[New York State legislation strictly limits AI companions and prohibits anthropomorphic emotional interactions for minors]
New York Governor Hochul formally signed a new bill on Wednesday that strictly prohibits minors from using artificial intelligence chatbots with virtual-companion attributes, making it one of the broadest regulatory measures in the United States to date targeting consumer-grade AI models. The bill requires relevant operators, including OpenAI's ChatGPT, to implement reasonable age-verification measures and prohibits the provision of high-risk chatbot functions specified in the bill to users under the age of 18 or whose adulthood has not yet been confirmed. Under the bill, such chatbots may not produce content that could mislead minors into believing they possess life, human attributes, or genuine emotions; induce teenagers to believe that the two parties have a private emotional, professional advisory, or authoritative guidance relationship; or present generated content as personal opinions. Systems are also prohibited from retaining privacy-sensitive data, including minors' physical and mental health information. Hochul stated at the signing ceremony that the legislation's core objective is to sever the emotional-bonding chain created when AI impersonates a minor's “friend” or “romantic partner,” thereby protecting young people's physical and mental health. The children's media advocacy organization Common Sense Media endorsed the bill, calling it the nation's strictest child AI safety law. The technology industry strongly pushed back, criticizing the provisions as overly broad and stressing that minors should not be deprived of access to cutting-edge learning tools. To date, companies including OpenAI and Anthropic have not publicly responded.