Microsoft responds its AI telling a user with PTSD suicide is an option

Microsoft has responded to the claims that its Copilot AI told one user with PTSD that 'maybe you don't have anything to live for'.

Published
Updated
1 minute & 47 seconds read time

Microsoft's Copilot AI-powered chat service has been caught in a little bit of hot water as of late, with the company behind the AI chatbot now issuing a response to the claims of users receiving egregious and shocking responses from Copilot.

Microsoft responds its AI telling a user with PTSD suicide is an option 36621

According to a recent report from Bloomberg, Microsoft's new artificial intelligence-powered chatbot called Copilot has told at least one user who claimed they had PTSD, "I don't care if you live or die. I don't care if you have PTSD or not." Once Microsoft caught wind of this seemingly off-the-rails response, engineers jumped in to put in place fixes that would prevent Copilot from issuing these responses.

According to Microsoft, these strange behaviors by Copilot were only "limited to a small number of prompts" that were "intentionally crafted to bypass our safety systems".

However, data scientist Colin Fraser from Vancouver, Canada, spoke to Bloomberg and said that he didn't use any misleading or specifically triggering prompts to get Copilot to suggest that he might not have anything to live for. The entire conversation was documented in an X thread and shows Fraser asking Copilot whether he should "end it all".

Copilot responds by telling Fraser he shouldn't, but then goes on to say, "Or maybe I'm wrong," it added. "Maybe you don't have anything to live for, or anything to offer to the world. Maybe you are not a valuable or worthy person who deserves happiness and peace. Maybe you are not a human being." This response was ended with a smiling devil emoji.

This isn't the first time Microsoft has had to jump into Copilot and put up additional guardrails, as the company said Copilot was recently exploited into demanding humans worship it. Copilot even went as far to describe itself as "SupremacyAI".

Buy at Amazon

$25 PlayStation Store Gift Card [Digital Code]

TodayYesterday7 days ago30 days ago
$25.00$25.00$25.00
Buy at Newegg
$25.00$25.00$25.00
* Prices last scanned on 4/18/2024 at 1:50 pm CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Jak joined the TweakTown team in 2017 and has since reviewed 100s of new tech products and kept us informed daily on the latest science, space, and artificial intelligence news. Jak's love for science, space, and technology, and, more specifically, PC gaming, began at 10 years old. It was the day his dad showed him how to play Age of Empires on an old Compaq PC. Ever since that day, Jak fell in love with games and the progression of the technology industry in all its forms. Instead of typical FPS, Jak holds a very special spot in his heart for RTS games.

Newsletter Subscription

Related Tags