Three AI agents, two countries, and one uneven world wide web

A technology and human rights researcher developed an open-source platform for language-pair analysis of LLM responses and evaluated policy-prompts guardrails. In one instance, Claude encountered a technical limit, being unable to load live GPPD country profiles due to JavaScript and network policy blocking World Bank data. This led Claude to use 2018 data from the World Bank’s GPPD DataBank API, resulting in different baseline data compared to GPT and Muse. This highlights challenges in language localization and data access for AI agents, raising questions about AI sovereignty and language diversity.

This report uniquely details how Claude's network policy and JavaScript limitations led it to use outdated 2018 data, unlike GPT and Muse which accessed 2022 profiles.