Humor Arena: Which LLM is the funniest?

In a humor arena comparing 20 LLM versions on 360 joke prompts, Fable 5 achieved the highest estimated score of 66.8 points per 100 comparisons. Fable 5.1 followed with 58.2 points. A humor-trained judge evaluated four jokes per prompt, with model names hidden. Scores were calculated by assigning one point for a win and half a point for a tie, and models near the top had overlapping uncertainty intervals.

This report uniquely details a humor-focused LLM comparison, unlike typical benchmarks, using 360 frozen joke prompts and a humor-trained judge to rank 20 model versions.