惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

罗磊的独立博客
美团技术团队
Apple Machine Learning Research
Apple Machine Learning Research
Hugging Face - Blog
Hugging Face - Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
月光博客
月光博客
WordPress大学
WordPress大学
The Cloudflare Blog
阮一峰的网络日志
阮一峰的网络日志
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
博客园_首页
博客园 - Franky
博客园 - 司徒正美
酷 壳 – CoolShell
酷 壳 – CoolShell
爱范儿
爱范儿
Jina AI
Jina AI
Last Week in AI
Last Week in AI
雷峰网
雷峰网
IT之家
IT之家
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
博客园 - 聂微东
小众软件
小众软件
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
V
V2EX

Cloudflare changelogs | AI Crawl Control

Pay Per Crawl advanced configuration Introducing Redirects for AI Training · Changelog Tools to prepare your site for the agentic Internet · Changelog Advanced WAF customization for AI Crawl Control blocks · Changelog Analytics enhancements · Changelog New reference documentation · Changelog AI Crawl Control Read Only role now available · Changelog New AI Crawl Control Overview tab · Changelog Pay Per Crawl (Private beta) - Discovery API, custom pricing, and advanced configuration · Changelog Crawler drilldowns with extended actions menu · Changelog New Robots.txt tab for tracking crawler compliance · Changelog Enhanced AI Crawl Control metrics with new drilldowns and filters · Changelog Enhanced crawler insights and custom 402 responses · Changelog Introducing Pay Per Crawl (private beta) · Changelog AI Crawl Control refresh · Changelog
AI Crawl Control · Changelog
2024-09-23 · via Cloudflare changelogs | AI Crawl Control

AI Crawl Control

Every site on Cloudflare now has access to AI Audit, which summarizes the crawling behavior of popular and known AI services.

You can use this data to:

  • Understand how and how often crawlers access your site (and which content is the most popular).
  • Block specific AI bots accessing your site.
  • Use Cloudflare to enforce your robots.txt policy via an automatic WAF rule.
View AI bot activity with AI Audit

To get started, explore AI audit.