跳到正文
Rreddit·
Archived topic · 归档话题,来源已停止追踪

Why do people keep fine-tuning on summarized/censored SOTA CoT traces?

AI 摘要

The author questions the practice of fine-tuning models on summarized or censored SOTA CoT traces. They observe a belief that distillation can magically improve output quality beyond the base model's capabilities. Specifically, the author finds Fable fine-tunes perplexing, as they seem to overlook that Anthropic's reasoning traces differ significantly from the model's actual chain of thought, likely leading to degraded results.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年7月13日 03:00 UTC

收录
2026年7月13日 03:00
来源类型
未分类