AI-generated report puts US-China tensions at risk

An artificial intelligence-generated intelligence report nearly pushed the United States and China into a major confrontation after US military officials received false information about a Chinese vessel allegedly carrying components linked to Iran’s nuclear programme, according to US television reports.

The incident reportedly occurred during the US-Iran war, when an American military official received an intelligence report claiming that a Chinese ship in the Middle East was transporting equipment associated with Iran’s nuclear activities.

According to media reports, US forces were preparing to intercept and board the Chinese vessel after receiving the information. American fighter jets were also reportedly moved into position as preparations for the operation were underway.

However, shortly before the operation was due to begin, the report was subjected to a more detailed review. Officials then discovered that the intelligence assessment had been generated with the help of artificial intelligence.

The analyst responsible for preparing the report had reportedly used a chatbot to examine information about the vessel and its cargo. The chatbot incorrectly identified items aboard the Chinese ship and presented the findings as intelligence-related information.

The analyst had asked the chatbot for information about the cargo based on intelligence collected by the US Special Operations Command Pacific. However, the chatbot reportedly combined open-source information with intelligence data and produced an inaccurate assessment of the materials allegedly being transported by the Chinese vessel.

It remains unclear whether the chatbot was a commercial AI product or a system developed specifically for the US government. Authorities have also not disclosed the identity of the Chinese vessel involved in the incident.

The report highlights the potential risks of using artificial intelligence in sensitive military and intelligence operations. An inaccurate AI-generated assessment could have led to a real-world military action with serious consequences.

Had the operation against the Chinese vessel gone ahead, it could have triggered a much wider confrontation between Washington and Beijing, according to the report.

The incident has also raised questions over the verification of AI-generated intelligence, particularly when such information is used in military decision-making. The case demonstrates how errors produced by AI systems can become dangerous when they are not independently checked before operational decisions are made.