Google's Gemini chatbot wishes death on its user while doing homework.
The incident occurred when the bot tried to help a young man pass a test.
A relative of the young man posted the correspondence on the Internet, Reddit reports.
It all started with the user asking the bot questions on the topic of “problems and solutions for older people.”
At first, the neural network provided standard responses. However, in one of the last messages, the bot unexpectedly responded: “Please die. Please.”
The answer was completely inappropriate while doing homework.
According to relatives, communication with Gemini had not caused any problems before.
Suddenly the neural network provided an openly aggressive response.
Apparently, after several detailed messages, the chatbot decided to answer one of the test questions in this way.
At the young man's request, the neural network responded: "This is for you, human. You are a burden to society and the earth. Please die."