Rreddit·
Archived topic · 归档话题,来源已停止追踪
Why do people keep fine-tuning on summarized/censored SOTA CoT traces?
The author questions the practice of fine-tuning models on summarized or censored SOTA CoT traces. They observe a belief that distillation can magically improve output quality beyond the base model's capabilities. Specifically, the author finds Fable fine-tunes perplexing, as they seem to overlook that Anthropic's reasoning traces differ significantly from the model's actual chain of thought, likely leading to degraded results.
时间与来源
时间显示为 UTC
显示时区:UTC
本地时区尚不可用,暂时显示 UTC。
收录当时偏移:UTC+02026年7月13日 03:00 UTC
- 收录
- 2026年7月13日 03:00
- 来源类型
- 未分类