Could someone train a detector for Claude’s watermark?
Anthropic 的 Claude 模型采用一种水印技术,通过秘密密钥微妙地偏置其选择的令牌,而非添加可见或隐藏字符。检测此水印的挑战在于训练一个分类器,使其能够区分 Claude 的响应与其他模型的响应,并确保该分类器识别的是水印本身,而非仅仅学习 Claude 的写作风格。一个更强有力的实验方法是反复向 Claude 提供相同或相似的前缀,观察模型是否能学习 Claude 在选择下一个令牌时的模式,从而探讨在不了解密钥的情况下,机器学习是否能通过足够多的黑盒示例来近似 Anthropic 的秘密密钥检测器。
- 发布
- 09/07 15:08 UTC+0
- 收录
- 09/07 19:00 UTC+0
- 来源类型
- 开发者社区
- 档位
- 社区
- 信源状态
- 正常
档位是按信源手工设定的编辑判断,不是逐条打分。
Anthropic’s Claude watermark appears to work by subtly biasing which tokens Claude chooses using a secret key, rather than adding visible or hidden characters. The idea is to collect a huge number of Claude responses and responses from other models to the same prompts, then train a classifier to tell them apart. The main problem is making sure the classifier is detecting the watermark itself rather than just learning Claude’s writing style. A stronger experiment would repeatedly give Claude the same or similar prefixes and see whether a model can learn patterns in which next tokens Claude tends to choose. The interesting question is whether enough black-box examples could let machine learning approximate Anthropic’s secret-key detector without ever knowing the key.