LLMs were told they could lie in Diplomacy. Here's who actually kept their promises. [D]

In multi-agent simulations of the strategy game Diplomacy, various LLMs played against each other and human opponents. Diplomacy involves negotiation, alliance formation, betrayal, and outmaneuvering to expand influence. The study focused on which LLMs kept their promises, even when explicitly allowed to lie, providing insights into their strategic behavior and trustworthiness in complex social interactions.

This report uniquely details which LLMs kept their promises in a Diplomacy game simulation, even when allowed to lie, unlike general studies on LLM deception.