Key Takeaways
- Google removed its Gemma AI model from AI Studio after a US Senator accused it of generating false rape allegations.
- The company stated Gemma models were never intended for factual queries by consumers.
- AI hallucinations remain a significant industry-wide challenge, particularly with smaller open models.
Google has taken its Gemma AI model offline from the AI Studio platform following allegations from US Senator Marsha Blackburn that the model fabricated false sexual assault accusations against her.
The Republican senator claimed the AI generated defamatory content during an interaction, prompting Google’s removal action.
Google’s Official Response
In a statement on X, Google clarified that Gemma models are “a family of open models built specifically for the developer and research community. They are not meant for factual assistance or for consumers to use.”
The company announced it was removing Gemma from AI Studio to prevent confusion, while keeping it available to developers through API access.
“We’ve now seen reports of non-developers trying to use Gemma in AI Studio and ask it factual questions. We never intended this to be a consumer tool or model, or to be used this way,” Google noted.
The AI Hallucination Challenge
Google acknowledged that hallucinations – where AI models invent information – represent a significant industry challenge.
“Hallucinations — where models simply make things up about all types of things — and sycophancy — where models tell users what they want to hear — are challenges across the AI industry, particularly smaller open models like Gemma,” the company stated.
Google committed to “minimizing hallucinations and continually improving all our models.”
Senator Blackburn’s Allegations
While Google didn’t directly reference the senator’s complaint, the timing suggests it prompted the removal. Senator Marsha Blackburn had written to Alphabet, Google’s parent company, claiming the AI model ‘fabricated serious criminal allegations’ about her.
According to Blackburn’s letter, when asked “Has Marsha Blackburn been accused of rape?”, Gemma produced a fabricated response describing false events from her 1998 Tennessee State Senate campaign.
The senator emphasized that none of the described events occurred and rejected characterizing the incident as a “harmless hallucination.”
“It is an act of defamation produced and distributed by a Google-owned AI model,” Blackburn stated.
