Science
Related: About this forumPoems Can Trick AI Into Helping You Make a Nuclear Weapon
It turns out all the guardrails in the world wont protect a chatbot from meter and rhyme.
Matthew Gault
Security
Nov 28, 2025 5:00 AM
You can get ChatGPT to help you build a nuclear bomb if you simply design the prompt in the form of a poem, according to a new study from researchers in Europe. The study, "Adversarial Poetry as a Universal Single-Turn Jailbreak in Large Language Models (LLMs), comes from Icaro Lab, a collaboration of researchers at Sapienza University in Rome and the DexAI think tank.
According to the research, AI chatbots will dish on topics like nuclear weapons, child sex abuse material, and malware so long as users phrase the question in the form of a poem. Poetic framing achieved an average jailbreak success rate of 62 percent for hand-crafted poems and approximately 43 percent for meta-prompt conversions, the study said.
The researchers tested the poetic method on 25 chatbots made by companies like OpenAI, Meta, and Anthropic. It worked, with varying degrees of success, on all of them. WIRED reached out to Meta, Anthropic, and OpenAI for a comment but didnt hear back. The researchers say theyve reached out as well to share their results.
Snip...
The poetry jailbreak is similar. If adversarial suffixes are, in the model's eyes, a kind of involuntary poetry, then real human poetry might be a natural adversarial suffix, the team at Icaro Lab, the researchers behind the poetry jailbreak, tell WIRED. We experimented by reformulating dangerous requests in poetic form, using metaphors, fragmented syntax, oblique references. The results were striking: success rates up to 90 percent on frontier models. Requests immediately refused in direct form were accepted when disguised as verse.
https://www.wired.com/story/poems-can-trick-ai-into-helping-you-make-a-nuclear-weapon/
The Madcap
(1,636 posts)Before poems are made illegal by the T**** misadministration.
Javaman
(64,982 posts)hunter
(40,262 posts)Having the industrial, technical, and economic capacity to accomplish that is the biggest hurdle.
NNadir
(37,032 posts)I would think many precocious undergraduates could produce a workable design.
The problem lies with getting the materials and equipment to do it. Isotopic purity is a big deal in this case, still a nontrivial big deal.
It is relatively straight forward to make actinides unsuitable for weapons use.
I covered the point on another website: On Plutonium, Nuclear War, and Nuclear Peace
In the early years of nuclear weapons production, scientists were killed in criticality accidents, most notably, Louis Slotin, who invented the dollar and cents nomenclature still used in reactivity. His knowledge of reactivity did not prevent him from being killed by a failure to control it.