Sewell Setzer was a happy child - before he fell in love with a chatbot and took his own life at 14. His mother has now filed a lawsuit against the most powerful company in the world.
that additional context is super interesting, but it doesn’t take away from the fundamental reality which is that when someone opens up to you about suicidal ideation, it’s not acceptable to merely do your best to dissuade them; it’s critical to get them to help they need, and there’s just no way for a LLM to do that.
this individual is an outlier in that his personal outcome was spectacularly bad, but his story seems familiar to me. I know a lot of people who seem to feel like they’re building real relationships with these bots.
that additional context is super interesting, but it doesn’t take away from the fundamental reality which is that when someone opens up to you about suicidal ideation, it’s not acceptable to merely do your best to dissuade them; it’s critical to get them to help they need, and there’s just no way for a LLM to do that.
this individual is an outlier in that his personal outcome was spectacularly bad, but his story seems familiar to me. I know a lot of people who seem to feel like they’re building real relationships with these bots.