跳到正文
RCreddit.com·

Could someone train a detector for Claude’s watermark?

AI 摘要

Anthropic 的 Claude 模型采用一种水印技术,通过秘密密钥微妙地偏置其选择的令牌,而非添加可见或隐藏字符。检测此水印的挑战在于训练一个分类器,使其能够区分 Claude 的响应与其他模型的响应,并确保该分类器识别的是水印本身,而非仅仅学习 Claude 的写作风格。一个更强有力的实验方法是反复向 Claude 提供相同或相似的前缀,观察模型是否能学习 Claude 在选择下一个令牌时的模式,从而探讨在不了解密钥的情况下,机器学习是否能通过足够多的黑盒示例来近似 Anthropic 的秘密密钥检测器。

时间与来源
发布
09/07 15:08 UTC+0
收录
09/07 19:00 UTC+0
来源类型
开发者社区
档位
社区
信源状态
正常

档位是按信源手工设定的编辑判断,不是逐条打分。

正文 · RSS 全文

Anthropic’s Claude watermark appears to work by subtly biasing which tokens Claude chooses using a secret key, rather than adding visible or hidden characters. The idea is to collect a huge number of Claude responses and responses from other models to the same prompts, then train a classifier to tell them apart. The main problem is making sure the classifier is detecting the watermark itself rather than just learning Claude’s writing style. A stronger experiment would repeatedly give Claude the same or similar prefixes and see whether a model can learn patterns in which next tokens Claude tends to choose. The interesting question is whether enough black-box examples could let machine learning approximate Anthropic’s secret-key detector without ever knowing the key.

来源·reddit.com·RSS 全文