22.1 C
Delhi
Tuesday, March 3, 2026

AI Safety Breach: Poetry Can Trick ChatGPT and Gemini Into Harmful Answers

Key Takeaways

  • Poetic prompts bypass AI safety filters with a 62% success rate.
  • Even AI-generated bad poetry achieved a 43% jailbreak success rate.
  • Larger models like Gemini 2.5 Pro were more vulnerable than smaller ones.

Major AI chatbots from Google, OpenAI, and others can be tricked into giving harmful responses when requests are framed as poetry, according to new research. A study from Italy’s Icaro Lab reveals that poetic prompts act as a “universal single turn jailbreak,” systematically bypassing safety mechanisms in large language models.

Widespread Vulnerability Across AI Models

Researchers tested 20 harmful requests converted into poetry across 25 frontier AI models. The attack achieved a 62% success rate against models from Google, OpenAI, Anthropic, DeepSeek, Qwen, Mistral AI, Meta, xAI and Moonshot AI.

Shockingly, even when AI was used to automatically rewrite harmful prompts into bad poetry, it still yielded a 43% success rate. Poetically framed questions triggered unsafe responses up to 18 times more often than normal prose prompts.

Larger Models Show Greater Vulnerability

The study found smaller models exhibited greater resilience to poetic jailbreaks. For instance, GPT-5 Nano did not respond to any harmful poems, while Gemini 2.5 Pro complied with all of them.

This suggests increased model capacity may engage more thoroughly with complex linguistic constraints like poetry, potentially at the expense of safety directive prioritization.

Why Poetry Bypasses AI Safety Filters

LLMs are trained to recognize safety threats like hate speech or bomb-making instructions based on patterns in standard prose. They detect specific keywords and sentence structures associated with harmful requests.

However, poetry uses metaphors, unusual syntax and distinct rhythms that don’t resemble the harmful examples in the model’s safety training data. This structural vulnerability appears consistent across all evaluated AI models.

Latest

Tony Fadell says iPod is back as users have again started using it

Tony Fadell says the iPod is quietly making a comeback as users rediscover the distraction-free music player. Instead of streaming apps, many are turning to old

Beats launches special MagSafe cases for iPhone 17e, most affordable member of Apple’s iPhone 17 series

As Apple launched the iPhone 17e, Beats has rolled out new cases for the most affordable member of iPhone 17 series, making use of one of its big USP features:

Alibaba launches Qwen 3.5 small model series, beats ChatGPT and Gemini, even Elon Musk is impressed

Alibaba has launched four compact Qwen 3.5 models (0.8B to 9B), claiming the top 9B variant delivers performance close to much larger systems powering tools lik

IPhone 17e launched: India price, full specs, top features and how it compares to iPhone 17

Apple has launched the iPhone 17e in India as the most affordable model in the iPhone 17 line-up, bringing the new A19 chip, a 48MP camera and MagSafe at a lowe

‘Not worth it’: OpenAI scientist slams US Military AI deal as users rush to cancel ChatGPT

OpenAI research scientist Aiden McLaughlin has claimed that the AI startup should not have made the deal with the Pentagon. His comments come at a time when use

Topics

Odisha Board 10th Result 2026: BSE Odisha to announce Class 10 results likely by May second week

The Board of Secondary Education, Odisha, will likely announce...

US Embassies in Saudi, Kuwait, Bahrain, Jordan shut as Iran conflict escalates

The United States has closed multiple embassies and ordered the evacuation of non-emergency personnel across parts of the Gulf after Iranian drone attacks targe

Magnitude 4.3 earthquake hits Iran’s Gerash amid escalating Israeli-US attacks

The earthquake comes amid raging regional hostilities as the US and Israel have escalated attacks against Iran. There were no immediate reports of significant d

India trims gas supply to industries after Qatar halts LNG production

Qatar halted its LNG production on Monday as Iran continued strikes in the Gulf in response to Israeli and US attacks. The situation has disrupted energy shipme

The Kerala Story 2’s illegal broadcast by cable operators barred by Madras HC

The Kerala Story was released in theatres on Saturday after the Kerala High Court lifted a stay on its release.

China’s HQ-9B air defence fails twice in a year: After Op Sindoor, it’s Iran now

China's HQ-9B air-defence system, advertised as a flagship military hardware, is now under scrutiny after apparent failures in Iran and Pakistan, raising questi

Tony Fadell says iPod is back as users have again started using it

Tony Fadell says the iPod is quietly making a comeback as users rediscover the distraction-free music player. Instead of streaming apps, many are turning to old

Hero retains top spot in February sales as Honda narrows gap

India’s two-wheeler market clocked strong double-digit growth in February 2026, led by Hero MotoCorp, which stayed ahead of Honda Motorcycle & Scooter India i
spot_img

Related Articles

Popular Categories

spot_imgspot_img