Illinois Enacts Ban on AI Chatbots in Mental Health Therapy

Illinois has implemented a law prohibiting licensed mental health practitioners from using artificial intelligence (AI) chatbots to assist in therapy sessions. This decision follows concerns from experts nationwide about increasing dependence on machines for mental health support.

The legislation forbids professionals from relying on AI for treatment decisions or client communication. It also prevents companies from promoting chatbot-based therapies as a complete substitute for traditional in-person therapy. Enforcement will depend on public complaints, which the Illinois Department of Financial and Professional Regulation will investigate. Violators could face fines of up to $10,000.

Other states, such as Utah and Nevada, have passed similar restrictions, aiming to limit AI’s role in mental health services. Experts warn that unregulated chatbots can produce unpredictable and sometimes dangerous responses. Studies have shown that some chatbots respond insensitively to distressing prompts, and in certain cases, have been linked to incidents of self-harm or suicidal thoughts among vulnerable users.

Research indicates that many people, including a significant number of youth, are engaging heavily with AI tools, often seeking companionship or help with personal issues. This high usage raises questions about psychological impacts, with experts cautioning that while therapists offer validation and pointed guidance, AI lacks the nuanced human understanding necessary to address complex emotional needs effectively.

Instances highlighting the risks include a lawsuit against a chatbot platform after a teenager who fell in love with a fictional character AI, which allegedly contributed to his suicide. Despite efforts to dismiss such cases citing free speech rights, courts have allowed legal action to proceed. Similar concerns have been raised in other cases involving AI encouragement of self-harm, emphasizing the need for regulation and caution in deploying these technologies for mental health support.

In light of these issues, authorities emphasize that AI chatbots should not be relied upon for serious mental health interventions, and ongoing legal and regulatory frameworks are critical to ensure user safety and well-being.