OpenAI, Google pushing new AI models easily tricked into making nudes, researchers say
Attack method exposes flaws in OpenAI, Google safeguards against AI nudes.
Attack method exposes flaws in OpenAI, Google safeguards against AI nudes.
The short version
- Safety researchers continue to warn that a large volume of AI-generated explicit content is spreading unchecked, while regulators do little to meaningfully stop it.
- That’s why the “most critical intervention point” remains at the source: the harmful AI tools used to make the fake sexual images, Google researchers concluded.
- Yet red-teaming in recent months suggests that as some of the leading AI image generators from Google and OpenAI become more capable, they may be getting worse at blocking explicit outputs.
What happened
Raising the red flag are researchers at White Circle, a public benefit corporation backed by senior leaders and researchers from Anthropic, DeepMind, Hugging Face, and OpenAI. It was founded after CEO Denis Shilov posted one of the most famous universal jailbreaks of leading models in October 2024.
Why it matters
Bent on breaking models to conduct thorough safety testing, White Circle helps companies detect and deter threats when implementing advanced AI systems that may not always behave as expected.
Summary by Nerd News Network. Read the full article at Ars Technica — AI via the links above and below.