返回
TCtechmeme.com
26
·4小时前·媒体报道 · RSS

PatronView's owner details a year of fighting scrapers: 214:1 bot-to-human page loads, 35,000 Claude crawls per referred user, and Amazon's bot referred none (Nick Gray/PatronView)

查看原文
Claude

热度趋势

趋势数据积累中

百分比基于当前可用热度信号,而非评论数或独立用户人数。

AI 摘要

PatronView 的所有者 Nick Gray 详细介绍了其拥有 150 万页面的网站与网络爬虫对抗一年的经历。他指出,机器人与人类的页面加载比例高达 214:1,每个推荐用户产生了 35,000 次 Claude 爬取,而亚马逊的机器人则没有带来任何推荐。Gray 分享了他在此过程中尝试过的策略、遇到的失败以及目前行之有效的方法。

Nick Gray / PatronView:

Owner of 1.5M-page site PatronView on a year of fighting scrapers: 214:1 bot-to-human page loads, 35K Claude crawls per referred user, Amazon bot referred none — A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now. August 7, 2026

PatronView's owner details a year of fighting scrapers: 214:1 bot-to-human page loads, 35,000 Claude crawls per referred user, and Amazon's bot referred none (Nick Gray/PatronView) · BuzzRadr