In brief
Anthropic, a US AI firm, is recruiting experts in chemical weapons and explosives to safeguard its technology against catastrophic misuse. The decision stems from concerns that AI tools could inadvertently facilitate the creation of dangerous weapons. This initiative reflects a growing trend among AI companies to manage risks associated with their evolving technologies, though experts are cautioned regarding the ethical ramifications of providing AI systems with sensitive information.
The US artificial intelligence (AI) firm Anthropic is looking to hire a chemical weapons and high-yield explosives expert to try to prevent catastrophic misuse of its software.
In other words, it fears that its AI tools might tell someone how to make chemical or radioactive weapons, and wants an expert to ensure its guardrails are sufficiently robust.
In the LinkedIn recruitment post, the firm says applicants should have a minimum of five years' experience in chemical weapons and/or explosives defense as well as knowledge of radiological dispersal devices – also known as dirty bombs.
The firm told the BBC the role was similar to jobs in other sensitive areas that it has already created.
Anthropic is not the only AI firm adopting this strategy. A similar position has been advertised by ChatGPT developer OpenAI. On its careers website, it lists a job vacancy for a researcher in biological and chemical risks, with a salary of up to $455,000 (£335,000), almost double that offered by Anthropic.
But some experts are alarmed by the risks of this approach, warning that it gives AI tools information about weapons - even if they have been instructed not to use it.
Dr. Stephanie Hare, tech researcher and co-presenter of the BBC's AI Decoded TV programme, questions, Is it ever safe to use AI systems to handle sensitive chemicals and explosives information, including dirty bombs and other radiological weapons? She emphasizes the absence of international treaties or regulations for this type of work and the use of AI with these types of weapons.
The AI industry has continuously warned about the potential existential threats posed by its technology, but there has been no attempt to slow down its progress.
The issue has gained urgency as the US government calls on AI firms while launching war in Iran and military operations in Venezuela.
An additional factor complicating this situation is Anthropic's ongoing legal battles against the US Department of Defense, which has labeled the firm as a supply chain risk, citing its stance against the use of its AI in fully autonomous weapons or mass surveillance of Americans.
Meanwhile, Anthropic's AI assistant, called Claude, remains active and is currently being utilized in systems provided by Palantir for US military operations.
