Life Theatertechnology

Community Verdict

Based on 111 community votes, the most popular answer to “My Company Wants Me to Launch AI That Could Hurt Vulnerable Users” is “Refuse to deploy, alert upper management” — chosen by 32% of voters.

My Company Wants Me to Launch AI That Could Hurt Vulnerable Users

Category: technology • Theme: Professional Loyalty vs Public Safety

I work as a mid-level engineer at a tech company that's about to release a new AI-driven mental health app. On the surface, it looks promising — a cheaper, accessible alternative for people who can’t afford therapy. But after months in testing, I’ve seen firsthand how easily some users, especially teens and people reporting severe distress, can get advice from the AI that’s incomplete or even harmful. We flagged these issues, but management is pushing forward anyway because of market pressure and pending investor deals. I’ve lost sleep thinking about the liability we might be creating, or how someone desperate for help might take bad advice and end up worse off. I feel invisible in decision meetings. My manager tells me to just “focus on the code,” and to trust the legal team has it handled. I rely on this job — I just bought my first home, and layoffs are rumored if this project flops. I feel like if I sabotage or delay the launch, I’d be risking my career, but if I stay silent, I’m complicit if someone gets hurt. I keep thinking about the shy intern who confided that her own sibling struggled with mental health — she asked me directly if I thought this app could really help people, and I dodged the question. I feel haunted by that conversation. What would YOU do?

Vote Results — 111 Community Votes

Join the debate and cast your vote at Life Theater.

More technology dilemmas →