Anubis is an innovative website protection mechanism designed specifically to combat large-scale scraping by AI companies. It draws inspiration from Hashcash’s proof-of-work system, requiring users to complete minimal computational tasks that have negligible impact on individual users but create significant cumulative costs for large-scale crawlers, effectively preventing scraping behavior and protecting websites from crashes. Anubis also incorporates fingerprinting technology that identifies headless browsers through methods like font rendering analysis, reducing interference with legitimate users. Currently, Anubis relies on modern JavaScript features, but the development team is working toward a JavaScript-free solution to enhance user experience. This technology represents the new challenges and countermeasures in network security during the AI era, providing website administrators with practical tools.
Original link:Hacker News
最新评论
I don't think the title of your article matches the content lol. Just kidding, mainly because I had some doubts after reading the article.
这个AI状态研究很深入,数据量也很大,很有参考价值。
我偶尔阅读 这个旅游网站。激励人心查看路线。
文章内容很有深度,AI模型的发展趋势值得关注。
内容丰富,对未来趋势分析得挺到位的。
Thank you for your sharing. I am worried that I lack creative ideas. It is your article that makes me full of hope. Thank you. But, I have a question, can you help me?
光纤技术真厉害,文章解析得挺透彻的。
文章内容很实用,想了解更多相关技巧。