News
Fake Trump death story shows how easily AI can be poisoned
AI chatbots integrated with DuckDuckGo repeated a fabricated story about Donald Trump dying of rabies, a hoax internet users deliberately planted on Reddit to test the models. The case shows how easily coordinated disinformation can slip into AI-generated answers.
Contents
The AI-generated answers feature built into the DuckDuckGo search engine spent several days telling users a completely fabricated story: that US President Donald Trump had died on June 7 from rabies after being bitten by Vice President J.D. Vance, who had supposedly died of the same disease earlier. Neither event ever happened.
How users tricked the AI
The r/poisonai community was founded with a clear goal: post absurd but believable-sounding claims about well-known politicians and celebrities, hoping they would end up in AI training data or model search results. Alongside the story of Trump's death, the forum featured equally false claims, such as that blue whales are orange or that bricks should be watered.
Of all these hoaxes, the rabies story spread the furthest. It didn't just show up in DuckDuckGo's AI-generated answers, it also spread across social media as an apparent news story before newsrooms could debunk it. The US president is alive and in office, and the entire story was a fabrication designed from the start to target AI systems.
Why models trust Reddit
Dr. Mateusz Labuz of the University of Hamburg explains that language models readily cite forum discussions because the language users write in sounds more natural than the dry, encyclopedic style of other sources. He points to three reasons Reddit dominates AI answers: the sheer scale of authentic natural-language examples, the diversity of comments, and a voting system that creates the impression of social verification of content.
AI models cite forum discussions because the language sounds more natural compared to encyclopedic sources - Dr. Mateusz Labuz, University of Hamburg
This is exactly the mechanism the creators of r/poisonai exploited. They knew that a model looking for an answer about current events would reach for the lively, conversational tone of a Reddit post more readily than for a dry press note, even if that note were true and the post false.
Data poisoning as a new tactic
The phenomenon known as data poisoning or LLM grooming involves deliberately flooding the internet with false information in the hope that AI systems will start treating it as fact. A Cornell University study published in June 2026 found that just 13 well-chosen words in publicly visible online content are enough to consistently trigger a false or deceptive model response.
This is not an isolated case. Labuz notes that popular language models repeated narratives from Russian disinformation networks in roughly a third of the cases analyzed in 2024-2025. The scale of the problem is growing as more people ask chatbots directly about current events instead of reading news sources.
Risk for ordinary users
A classic search engine shows a dozen or so links and leaves it to the user to judge credibility. An AI chatbot delivers a single, confident answer without noting that it's based on a satirical forum post. Experts warn that on political, health or financial topics, this kind of confidence paired with a faulty source can mislead millions of people within a few hours.
The case lands at a moment when more and more companies and institutions, including in Poland, are deploying large-language-model assistants for customer service or document analysis. If a model draws its knowledge from the open internet without additional filters, the risk of absorbing similarly fabricated content applies to every deployment, not just consumer search engines.
Model makers are responding piecemeal for now, refining classifiers and reducing the weight given to forum content when answering questions about current events. None of the major companies has announced a systemic fix for data poisoning, which means further fake stories crafted specifically to target AI are only a matter of time.
Sources: Chatbot uznal, ze Donald Trump nie zyje. Powod? Internetowy zart (spidersweb.pl), AI usmiercila Trumpa. Tak internauci zakpili z chatbota (wiadomosci.wp.pl), Chatbot usmiercil Donalda Trumpa. AI twierdzi, ze zmarl na wscieklizne (ithardware.pl)
