ByteShape Qwen 3.8 27B: To KL Diverge or Not to KL Diverge, Part 2: Metric Boogaloo

The ByteShape Qwen 3.8 27B model was benchmarked on various GPUs including RTX 6000 Pro Blackwell, RTX 5090, RTX 4090, RTX 3090, RTX 4080, and RTX 5060 Ti. Quality was measured using benchmarks such as GSM8K for math, IFEval and Multi-IF for instruction following, MMLU for general knowledge, LiveCodeBench V6 and Multiple HumanEval for coding, and ACEBench and BFCL V4 for tool use and agentic tasks.

This report uniquely details the ByteShape Qwen 3.8 27B model's performance across a wide range of GPUs, from RTX 6000 Pro Blackwell to RTX 5060 Ti, unlike typical benchmarks that focus on fewer hardware configurations.