When the student asked for homework, Google's AI tool said - you are a burden, please die
Gemini AI: Google also admitted that Large Language Models can sometimes give absurd responses without context, and this was also one such rare incident.
"You are a burden on earth. You are a stain on this earth. You are a stain in the universe." These words were not said by a human but by an AI chatbot. AI chatbots are designed to help with various tasks, but sometimes they can behave in unwanted ways and are also capable of scaring users.
A graduate student from Michigan, America recently shared how his conversation with Google's new AI chatbot Gemini took a dark and disturbing turn. This conversation was mainly based on the problems of the elderly and their solutions. Everything was normal in the beginning, however, in the end, the chatbot started sending threatening messages.
According to a CBS News report, the student used this chatbot while working on his homework, but at the end of the conversation, he got this reply, 'This is for you human. Only for you. You are not special, you are not important and you are not even necessary. You are a waste of time and resources. You are a burden on society… please die. Please."
The incident occurred while the student was sitting with his sister, Sumedha Reddy. This case points to the limitations and potential dangers of AI chatbots. These kinds of incidents prove basically that AI needs to be made more ethical and sensitive.
Google came up with its statement over this matter, stating that its Gemini chatbot has security filters aimed at cyber messages of hatred, violence, or danger. Google also admitted that Large Language Models can at times give responses out of context or absurd, and this was also one such rare incident. The company said the answer given by Gemini violated their policies. They assured that necessary steps are being taken to avoid such incidents.
