← 返回日报
略读 预计 1 分钟

You should probably check on your smart appliances

摘要

正文说明管理员为防 AI 公司大规模抓取网页设置了 Anubis,这是 Hashcash 类 Proof-of-Work 方案,单个用户额外负载可忽略,批量爬虫成本会显著增加。作者认为这是临时方案,未来会通过 fingerprinting 识别 headless 浏览器(如字体渲染方式),让合法用户无需触发 Pow 挑战。文章提醒用户需启用现代 JavaScript 特性,建议为该域名关闭 JShelter 或同类插件。

荐读理由

Anubis 是 PoW 方案结合 JS 指纹识别的折中方案,可迁移到自己网站搭建反爬验证机制,能让 AI 爬虫成本显著上升,保护资源不被抢占

原文

Making sure you're not a bot!

Loading...

You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone.

Anubis is a compromise. Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.

Ultimately, this is a placeholder solution so that more time can be spent on fingerprinting and identifying headless browsers (EG: via how they do font rendering) so that the challenge proof of work page doesn't need to be presented to users that are much more likely to be legitimate.

Please note that Anubis requires the use of modern JavaScript features that plugins like JShelter will disable. Please disable JShelter or other such plugins for this domain.

Lobsters · 3 赞 · 0 评 讨论 → 阅读原文 →

这条对你有帮助吗?