Exclusive: US military had close call after using AI for false intelligence report, sources say
A chatbot fused classified signals intelligence with open-source scraps and produced a confident, completely wrong story about what a Chinese ship was carrying. A human believed it. Armed boarders were staged before anyone caught the mistake.
Explain Like I'm 5 — the whole thing in plain language.
A US military analyst asked an AI chatbot a question about a Chinese ship, this spring during the war with Iran. The chatbot combined secret military intelligence with public information and confidently said the ship was carrying parts for a nuclear weapons program. That was wrong. But people believed it: armed sailors got ready to board the ship, and planes were sent up, before someone realized the AI's answer was false.
Nobody got hurt and the mistake was caught before anything happened. But think about how close that is to a real disaster: this was a made-up answer from a chatbot, about a ship from a country the US isn't at war with, and armed people almost acted on it.
One unnamed official said something important: even when a human is checking the AI's work (which the military calls "human in the loop"), nobody has good rules yet for how that human is actually supposed to catch a mistake before it's too late. Another said the military's own AI tools might just be regular chatbots with a different name slapped on.
The honest caveat: this whole story comes from four anonymous sources talking to one news organization. No official document has been made public. That doesn't mean it's false — but it does mean you should treat the general lesson (AI made a big, confident, wrong claim, and it almost mattered) as more solid than any single detail in it.