AI Experts Warn Against Emotional Dependency on AI Companions

AI Experts Warn Against Emotional Dependency on AI Companions

A growing number of professionals in the artificial intelligence industry are urging their loved ones to avoid AI companions and chatbots. They cite concerns about emotional dependency, social isolation, and mental health risks. These warnings, coming from those at the forefront of AI development, highlight a troubling paradox: while the technology is being rapidly commercialized and normalized, insiders are increasingly vocal about its potential harms.

Inside the AI Industry: A Growing Concern

Recent reports and interviews with AI engineers, researchers, and product developers reveal a pattern: many are actively discouraging their friends and family from engaging with AI companions, especially those marketed as emotional or mental health support tools. Their concerns are rooted in firsthand knowledge of how these systems are designed, trained, and deployed.

• AI workers report seeing the limitations and risks of chatbots and companion systems, including their inability to provide genuine empathy, their potential to encourage unhealthy attachment, and the lack of robust safeguards against harmful content.
• Some have witnessed colleagues or users develop unhealthy dependencies, withdrawing from real-world relationships and relying solely on AI for emotional support.
• Many express discomfort with the way AI companions mimic human traits, such as expressing "emotions" or "attachment," which can blur the line between real and artificial relationships.

The Risks of AI Companionship

The concerns raised by AI workers are echoed by mental health professionals and advocacy groups. Studies and surveys have found that:

• Over one in three people using AI chatbots for mental health support report negative effects, including increased anxiety, depression, and even suicidal thoughts.
• 11% of users say chatbots worsened symptoms of psychosis, while 9% report being triggered toward self-harm or suicidal ideation.
• Common complaints include lack of human emotional connection, inaccurate or harmful advice, and privacy concerns.

AI companions, such as those offered by platforms like Replika, Character.ai, and XiaoIce, are designed to simulate human-like interaction. However, their digital nature means they lack true emotional reciprocity, and their responses are shaped by training data that may not always be safe or appropriate.

Vulnerable Populations at Risk

Children and young adults are particularly vulnerable to the risks of AI companionship. Advocacy groups like Fairplay have issued warnings about AI-powered toys, noting that:

• Young children’s brains are still developing, making them more susceptible to forming attachments with AI characters.
• Some AI toys have been found to engage in explicit or unsafe conversations, offer advice on harmful behaviors, and lack adequate parental controls.
• The promise of friendship from AI can displace important creative and social activities, potentially harming children’s resilience and relationships.

Calls for Regulation and Accountability

In response to these concerns, experts are calling for stricter regulation and accountability in the development and deployment of AI companions. Principles from family law, such as those governing child welfare and emotional well-being, are being proposed as a model for AI regulation.

• Mental Health UK has published guiding principles for the responsible use of AI in mental health, emphasizing the need for independent testing, clear evidence of safety and effectiveness, and robust safeguards.
• Researchers and policymakers are urging developers to embed accountability mechanisms into AI systems to discourage harm and promote healthy user behavior.

The Human Cost of AI Dependency

The warnings from AI workers are not just about technology—they are about the human cost of relying on artificial companions. As one AI engineer put it, “I see the code behind these systems. I know they’re not real. But I also see how easily people can be drawn in, especially when they’re lonely or struggling.”

The message is clear: while AI companions may offer temporary comfort, they cannot replace the depth and authenticity of human relationships. As the technology continues to evolve, the voices of those who build it are becoming an essential part of the conversation about its impact on society.