US govt says Anthropic AI an 'unacceptable risk' to military
Anthropic's Claude AI model has been in the spotlight in recent weeks both for its alleged use in identifying targets for US bombing in Iran and the company's refusal that its systems be used to power mass surveillance in the United States or lethal fully autonomous weapons systems.
Justifying its decision to cut ties with Anthropic in response to a legal complaint from the firm, the Pentagon -- dubbed the Department of War (DoW) by the Trump administration -- said it "became concerned that allowing Anthropic continued access to DoW’s technical and operational warfighting infrastructure would introduce unacceptable risk into DoW supply chains," in a court document seen by AFP.
"AI systems are acutely vulnerable to manipulation," the government added in the filing to a California federal court.
"Anthropic could attempt to disable its technology or preemptively alter the behavior of its model either before or during ongoing warfighting operations, if Anthropic -- in its discretion -- feels that its corporate 'red lines' are being crossed," it said.
Anthropic's refusal to agree that its AI tech could be deployed by the military for "any lawful use" therefore posed an "unacceptable risk to national security," the document read.
"Anthropic’s behavior more generally caused the Department to question whether Anthropic represented a trusted partner," the government said.
Classification as a "supply chain risk," which Anthropic has challenged in a case against the Pentagon and other arms of the federal government, in theory means that all government suppliers would be barred from doing business with the company.
The designation is typically reserved for organizations from foreign adversary countries, such as Chinese tech giant Huawei.
Other major American tech firms such as Microsoft, which itself both uses Anthropic's Claude model and supplies the US military, have weighed in on the AI company's side.
"This is not the time to put at risk the very AI ecosystem that the administration has helped to champion," Microsoft said in an amicus brief filed with the court last week.