Anthropic warning: humans may need “kill switches” to shut down rogue AI systems | BBC News

Anthropic, a leading AI firm, suggests that "kill switches" might be necessary for companies developing AI, according to a co-founder. Anthropic scientist Evan Hubinger estimates over a 10% chance of human extinction from AI within the next decade. Geoffrey Hinton, known as the "Godfather of AI" and a Nobel Prize winner, also stated that a 10% chance of AI causing human extinction is not unreasonable.

This report uniquely highlights Anthropic's co-founder suggesting mandatory "kill switches" for AI, unlike previous discussions that focused on the general concept of AI safety.