Anthropic outlines metrics to track AI development at frontier labs: how much AI R&D is done by AI, how well agents are overseen, and how compute is allocated (Anthropic)

Anthropic has outlined new metrics for tracking AI development at frontier labs, focusing on key areas as AI systems become increasingly powerful and self-automating. These metrics include assessing the extent of AI involvement in R&D, evaluating the oversight of AI agents, and monitoring the allocation of computational resources. This initiative aims to provide a structured approach to understanding and managing the rapid advancements in AI technology.

This is the first time Anthropic has publicly outlined specific metrics for tracking AI development, unlike previous general calls for AI safety and oversight.