AI hallucination of Chinese nuclear components almost led to US military attack
But the military's overall use of AI seems to be accelerating.
But the military's overall use of AI seems to be accelerating.
The short version
- But the military’s overall use of AI seems to be accelerating.
- The US narrowly avoided boarding a Chinese ship based on an “entirely false” US intelligence report generated with the help of AI tools, according to a CNN report .
- That erroneous intelligence, submitted by a US Special Operations Command analyst, suggested the Chinese ship was transporting nuclear arms program components through the Middle East, according to “four sources familiar with the episode” cited by CNN.
What happened
That chatbot “fused together open-source intelligence with secret signals intelligence in government holdings,” and that information was packaged into an intelligence report that almost set off a disastrous chain of events, according to CNN. One would hope the US military would be aware of these kinds of problems when relying on AI for analysis of intelligence reports.
Why it matters
Last December, the Department of Defense announced it would use Google’s Gemini for Government as the basis for its bespoke “GenAI.mil” platform.
Summary by Nerd News Network. Read the full article at Ars Technica via the links above and below.