惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

S
SegmentFault 最新的问题
V
Visual Studio Blog
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
量子位
月光博客
月光博客
阮一峰的网络日志
阮一峰的网络日志
T
Tailwind CSS Blog
GbyAI
GbyAI
爱范儿
爱范儿
Y
Y Combinator Blog
宝玉的分享
宝玉的分享
有赞技术团队
有赞技术团队
罗磊的独立博客
Recent Announcements
Recent Announcements
博客园 - 司徒正美
M
MIT News - Artificial intelligence
小众软件
小众软件
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
B
Blog RSS Feed
A
About on SuperTechFans
Hugging Face - Blog
Hugging Face - Blog
Apple Machine Learning Research
Apple Machine Learning Research
雷峰网
雷峰网

Cloudflare changelogs | AI Crawl Control

Pay Per Crawl advanced configuration Introducing Redirects for AI Training · Changelog Tools to prepare your site for the agentic Internet · Changelog Advanced WAF customization for AI Crawl Control blocks · Changelog Analytics enhancements · Changelog New reference documentation · Changelog AI Crawl Control Read Only role now available · Changelog New AI Crawl Control Overview tab · Changelog Pay Per Crawl (Private beta) - Discovery API, custom pricing, and advanced configuration · Changelog Crawler drilldowns with extended actions menu · Changelog New Robots.txt tab for tracking crawler compliance · Changelog Enhanced AI Crawl Control metrics with new drilldowns and filters · Changelog Enhanced crawler insights and custom 402 responses · Changelog Introducing Pay Per Crawl (private beta) · Changelog AI Crawl Control refresh · Changelog
AI Crawl Control · Changelog
2024-09-23 · via Cloudflare changelogs | AI Crawl Control

AI Crawl Control

Every site on Cloudflare now has access to AI Audit, which summarizes the crawling behavior of popular and known AI services.

You can use this data to:

  • Understand how and how often crawlers access your site (and which content is the most popular).
  • Block specific AI bots accessing your site.
  • Use Cloudflare to enforce your robots.txt policy via an automatic WAF rule.
View AI bot activity with AI Audit

To get started, explore AI audit.