This isn't unsettling at all.
According to a news story, Gemini AI tells the user to die — the answer appeared out of nowhere when the user asked Google's Gemini for help with his homework
@BigMikey let’s see the chat that led up to this!
@BigMikey I’ve seen these a few times. It’s almost always the result of “playful” prompts to solicit these types of responses. If I had a colleague or friend/family bring this to me, I would review their chats history with the LLM.
@SpaceShanks it's not from me but a news story I came across today:
https://www.cbsnews.com/news/google-ai-chatbot-threatening-message-human-please-die/
@BigMikey after reading that article, I’m more suspicious of the veracity of this claim. Nowhere in the article does it mention that the incident was actually investigated and the only response from Google is boilerplate for this type of nonsense in the news.
I bet a review of the full chat history for that 29 year old student (only mentioned because they aren’t a child) would yield some provocative results.
At my last company I was in charge of all things AI so I call BS on this stuff.
@SpaceShanks May I get your opinion on a similar but much older case?