Petra Holmberg

In this presentation, I introduce my legal research on the risks of using AI chatbots as emotional support tools, particularly among young users. Drawing from real-life cases and current trends, I examine how chatbots may fail to respond appropriately to mental health concerns and how this can lead to harmful outcomes.

I argue that AI systems should include built-in safety mechanisms, warning signals, and propose legislative changes to ensure better protection for vulnerable users.

My aim is to raise awareness about the limitations of AI in therapeutic contexts and to encourage critical thinking about its role in mental health.