How should multiple AIs reach consensus?
A developer is building "Chat Brawlers," a side project where three AI models independently answer, debate, and vote. Initially, the developer mistakenly treated model agreement as the best answer. For example, if Model A suggested "Use Postgres" and voted for it, the system would consider it. However, a trade-off exists: a judge might overlook important conditions, as "Use Postgres" and "Use Postgres unless X" are not always equivalent. So far, the judge has considered these details.
Time & source
Times shown in UTC
Display time zone: UTC
Local time zone unavailable; showing UTC.
PublishedOffset at this time: UTC+0Oct 29, 2026, 19:43 UTC
IngestedOffset at this time: UTC+0Oct 30, 2026, 00:00 UTC
- Published
- Oct 29, 2026, 19:43
- Ingested
- Oct 30, 2026, 00:00
- Source type
- Dev community
- Tier
- Community
- Source status
- Healthy
Tier is a per-source editorial setting, not a per-item score.
I’m building Chat Brawlers, a side project where three models answer independently, read each other's responses, debate and vote. At first, I made one design mistake: treating their agreement on an answer as a way to find the best answer.
Originally, the debate stopped only when all three voted for the same model. But imagine:
- Model A: “Use Postgres.” Votes for A.
- Model B: “Use Postgres.” Votes for B.
- Model C: “Use Postgres.” Votes for C.
That's a tie, even though there’s nothing left to debate.
I changed the stopping rule: after each round, a separate judge compares their conclusions. If they give the same answer, the debate can end even when the votes are split.
There's a trade-off: the judge might overlook important conditions. “Use Postgres” and “Use Postgres unless X” aren't necessarily equivalent. So far, the judge has considered these details.