OpenAI, Google pushing new AI models easily tricked into making nudes, researchers say
Key points
- A White Circle preprint reportedly bypassed safety filters on DALL·E 3, Nano Banana 2 and GPT-Image-2 about 13 percent of the time.
- The attack needed only free, off-the-shelf tools and API calls, according to the researchers, with no custom or frontier model.
- White Circle says newer ChatGPT Images 2.5 and Nano Banana 2.1 are significantly more breakable than their predecessors. Neither company responded.
- Findings go to NeurIPS 2026 in November, and the attack pipeline is slated for release on GitHub.
Why it matters for marketers: Teams relying on vendor image-generator safety claims should verify guardrails themselves, since independent testing suggests newer models may block explicit outputs less reliably.