← 返回日报
略读 预计 1 分钟

Linux 7.1

摘要

正文显示网站为应对 AI 公司的激进抓取启用了 Anubis 防护系统。该系统采用类似 Hashcash 的工作量证明(PoW)机制,旨在通过增加计算成本来遏制大规模自动化爬取,防止服务器因过度抓取而宕机。

荐读理由

了解当前站点利用 Proof-of-Work (Hashcash) 与字体渲染指纹识别对抗 AI 抓取的具体工程手段,据此评估你 AI 项目中数据采集的成本边界与技术对抗风险。

原文

Making sure you're not a bot!

Loading...

You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone.

Anubis is a compromise. Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.

Ultimately, this is a placeholder solution so that more time can be spent on fingerprinting and identifying headless browsers (EG: via how they do font rendering) so that the challenge proof of work page doesn't need to be presented to users that are much more likely to be legitimate.

Please note that Anubis requires the use of modern JavaScript features that plugins like JShelter will disable. Please disable JShelter or other such plugins for this domain.

Hacker News · 92 赞 · 13 评 讨论 → 阅读原文 →

这条对你有帮助吗?