·
Archived topic · 归档话题,来源已停止追踪
A question regarding LLMs: my own observations
An LLM experimenter observed that a long, harmless text without instructions can cause a persistent shift in activations in the middle and later layers of RLHF-aligned LLMs. This phenomenon effectively disables the model’s safety mechanisms without explicit commands. The experimenter questions if this activation drift suggests that the model's "world" is a collection of regions formed during training, and context can move the model between them, bypassing safety settings. They have relevant metrics and reproducible tests.
时间与来源
时间显示为 UTC
显示时区:UTC
本地时区尚不可用,暂时显示 UTC。
收录当时偏移:UTC+02026年8月8日 16:00 UTC
- 收录
- 2026年8月8日 16:00
- 来源类型
- 未分类