Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?

A comparison of agent harnesses CUGA, Hermes, and Deep Agents using the GLM-5.3-flash model on 90 AppWorld tasks revealed significant performance differences, with task completion rates varying from 30% to 81% based on the harness. While AppWorld tests consumer app capabilities, it serves as a proxy for enterprise automation needs. For enterprise use, CUGA offers additional features like enforced rules and on-premise deployment, which were not part of this benchmark. The evaluation was conducted using the Harbor evaluation framework.