惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Project Zero
Project Zero
D
Darknet – Hacking Tools, Hacker News & Cyber Security
Scott Helme
Scott Helme
Know Your Adversary
Know Your Adversary
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
WordPress大学
WordPress大学
AWS News Blog
AWS News Blog
小众软件
小众软件
www.infosecurity-magazine.com
www.infosecurity-magazine.com
Jina AI
Jina AI
AI
AI
美团技术团队
人人都是产品经理
人人都是产品经理
S
Secure Thoughts
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
V
Visual Studio Blog
宝玉的分享
宝玉的分享
Security Latest
Security Latest
P
Privacy & Cybersecurity Law Blog
C
Cisco Blogs
大猫的无限游戏
大猫的无限游戏
Google Online Security Blog
Google Online Security Blog
L
LINUX DO - 最新话题
罗磊的独立博客
Recent Announcements
Recent Announcements
H
Hacker News: Front Page
博客园 - 【当耐特】
K
Kaspersky official blog
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
SecWiki News
SecWiki News
Schneier on Security
Schneier on Security
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
Apple Machine Learning Research
Apple Machine Learning Research
F
Full Disclosure
Google DeepMind News
Google DeepMind News
V
V2EX
博客园 - 聂微东
量子位
云风的 BLOG
云风的 BLOG
C
Check Point Blog
J
Java Code Geeks
Exploit-DB.com RSS Feed
Exploit-DB.com RSS Feed
W
WeLiveSecurity
Engineering at Meta
Engineering at Meta
V2EX - 技术
V2EX - 技术
Vercel News
Vercel News
L
LINUX DO - 热门话题
T
The Exploit Database - CXSecurity.com
L
Lohrmann on Cybersecurity
The GitHub Blog
The GitHub Blog

Fastly Blog

Fastly Fastly Fastly Fastly Fastly Fastly Fastly Six Common Live Streaming Mistakes (And How to Avoid Them) How Fastly and Skyfire Enable Trusted Agentic Commerce at the Edge Bot Defense is Table Stakes. Machine Traffic Requires a Business Strategy AI Traffic Grew 6.5x Faster Than Human Traffic This Year Python SDK Beta: How the Language of AI Runs Faster and Safer with Fastly Give AI Agents the Markdown They Actually Want How to Configure Local Logging for an On-Prem Next-Gen WAF Agent Accountability Without Control Is Breaking Security Leadership Fastly Joins the Agentic AI Foundation (AAIF) to Guide Edge AI Interoperability The E-commerce Industry in the AI Era: Has the Agentic Flood Hit? No Margin for Error: What the FIFA World Cup Teaches Us About Performance at the Edge Why iGaming Infrastructure is Breaking and What Comes Next The Publishing Industry in the AI Era: Why Bot Strategy is Now a Business Strategy Bad Performance Kills SaaS/PaaS Growth — Why Your CDN Matters Why your code is safe from Copy Fail on Fastly Compute Myth or Marvel: Claude Mythos and What it Means for Security Introducing Compliance Audit Reports Supporting Google Private AI Compute with Privacy-Preserving Edge Infrastructure Fastly Nearly Half the Web Isn’t Human: Inside Fastly’s Threat Insight Report Media over QUIC: Can Streaming Finally Have Both Scale and Low Latency? Introducing Fastly’s Redesigned Homepage: Your Central Hub for Actionable Insights The False Choice of Indiscriminate Blocking: Why Technical Precision is the New Standard for an Open Internet What is CVE-2026-23869? React Server Components Security Alert Fastly enables first-party tagging for Google Advertisers Shrink Your Bill With Efficient Software Your AI coding agent just got better at Fastly Fastly Ranked as a Leader in the 2026 Forrester Wave™ for Edge Development Platforms Fastly at RSAC 2026: New Advances in AppSec, Bot Management, and Deception Mastering the Edge: What Golf Can Teach Us About Speed, Precision, and Performance Real-Time CDN Monitoring for Live Events with Bronto Imperva Alternatives Best content delivery networks for bot management Vibe Shift? Senior Developers Ship nearly 2.5x more AI Code than Junior Counterparts Maximizing Compute Performance with Log Explorer & Insights Fastly CDN Expands Scaling Fastly Network: Balancing Requests | Fastly Best Practices for Multi-CDN Implementations | Fastly Compute@Edge: Serverless Insights by Company | Fastly Fastly can teach you about the Wasm future in just 6 talks Fastly's Observability Unleashed: New Updates and Insights Optimizing your multi-CDN infrastructure to improve performance Stay ahead of attackers by pushing your security perimeter to the edge Are APIs the Key to Digital Innovation or a Trojan Horse? Fastly Academy: on-demand learning at your fingertips. | Fastly 30 Years of Web: Building for Tomorrow 4 Ways Legacy WAF Fails to Protect Your Apps Adobe boosts performance and MTTR with Epsagon and Fastly logs | Fastly Beta" A New Serverless Compute Environment Early TLS at Fastly Technical trainings & the future of edge delivery at Altitude 2016: a year in review Innovation Capacity Defined: Tech Stack Values | Fastly Deep Log Visibility Offered by Logentries | Fastly Caching the Uncacheable: CSRF Security Increase Your Hit Ratio With This Simple Tip
Fastly + Scalepost: Extending the Fastly platform to manage AI Crawlers
2025-09-12 · via Fastly Blog

John Agger

Principal Industry Marketing Manager, Media & Entertainment, Fastly

Tools like ChatGPT, Perplexity, and Claude are reshaping how digital publishers and content creators engage with their audiences. Instead of clicks and page views, entire answers are now generated on the fly, often drawing directly from the content the creators worked hard to produce. As these platforms become go-to channels for news, entertainment, and commerce, the lack of visibility leaves companies uncertain about their true influence and content adoption in a rapidly growing part of the digital publishing landscape.

ScalePost recently introduced a set of tools that gives publishers and brands clear visibility into how their content appears in AI answers: what’s cited, by whom, and how often, so they can measure presence and improve it. These tools are currently utilized by revenue, marketing, and SEO teams. 

But before diving deeper into how the solution works, it’s worth stepping back to understand why the Fastly platform is uniquely suited for innovation like this. Built to be extended, customized, and enhanced, Fastly gives developers and partners the foundation to create new capabilities at the edge, making solutions like ScalePost possible in the first place.

How Fastly Delivers Unmatched Visibility and Extensibility

Developers and third-party companies continuously enhance the value of Fastly, thanks to our flexible, developer-friendly, and highly customizable architecture. Online businesses can run services and applications directly at the edge, delivering immediate performance improvements and gain greater control over how traffic is managed. This makes Fastly not just another CDN, but an edge platform that grows alongside its users and strengthens their investments over time.

A key differentiator is the visibility Fastly provides. With instant and complimentary log files, companies gain a true real-time data source that shows exactly what’s happening across their traffic. ScalePost, for example, leverages this capability to provide its customers with an accurate and instant view of how content is being accessed and referenced by AI platforms. Where other providers only offer a fraction of log data, often with significant delays, and often at a cost, Fastly makes 100% of customer logs available immediately. That level of transparency empowers businesses to detect issues faster, unlock deeper insights, and build solutions their customers can trust. It’s this combination of openness, speed, and completeness that makes Fastly the strongest complement to any CDN strategy.

ScalePost: Restoring Visibility and Regaining Control

In recent weeks, we’ve looked at a range of solutions built on the Fastly platform aimed at helping content owners capture revenue when their work is scraped. New to this category is ScalePost, which measures how content or brands are cited and positioned in AI answers, then guides publishers or brand owners on how to expand their presence where it matters.

Traditional analytics only measure human referrals and pageviews; they don’t reveal whether an article or brand is powering an AI-generated answer. Once you understand how LLM platforms are using your content and brand, you can make informed decisions: optimize Answer Engine Optimization (AEO) visibility by shaping the content and formats most likely to surface in AI answers; explore monetization opportunities where licensing and partnerships are active today, and where demand is likely to grow; and control access using rules to block unwanted crawlers or set the terms under which they reach your content.

ScalePost delivers actionable signals directly into existing workflows. Integration APIs expose a company’s “AI search footprint,” showing which URLs, headlines, or entities are being lifted into LLM answers. Classification data enables fine-grained policy enforcement, determining which bots are allowed, throttled, or blocked at the edge, while performance metrics and AEO insights inform optimization strategies. By combining Fastly’s edge-native visibility - built on architecture designed from the ground up to run at the network edge to deliver real-time insight - with ScalePost’s correlation layer, Fastly customers gain an instant, reliable, developer-friendly way to detect, classify, and manage AI bot traffic as part of their broader infrastructure strategy.

To sum up, Scalepost provides the following features:

  • Visibility into your AI search footprint: Spot when, where, and how your articles, headlines, and brands are appearing across popular chatbots. This is a core AEO signal.

  • Mentions and context: See which content or brands perform best in AI answers, and how you compare against competitors or peers.

  • Actionable insights for AEO: Go beyond pageviews and clicks to understand how AI platforms are shaping reach and influencing brand perception.

Shedding Light on Hidden Infrastructure Costs

ScalePost also helps engineering and operations teams explain rising infrastructure costs that traditional analytics overlook. AI bots crawling at scale can significantly increase bandwidth, origin egress, and compute utilization, but because this traffic isn’t tied to human sessions, it never appears in referral or revenue reports. The result is a widening gap between infrastructure spend and measurable return. By classifying and correlating AI bot requests with edge-level logs, ScalePost exposes the true drivers of increasing infrastructure cost. Teams can then quantify non-revenue traffic, tune caching and delivery policies, and decide when to throttle, block, or license AI consumption. Put another way: ScalePost turns unexplained costs into measurable activity that can be actively managed.

Fastly’s HTTPS real-time log streaming makes it simple to activate ScalePost, with no impact on human visits. Once enabled, you’ll have immediate access to a real-time dashboard and historical trends, giving you clear visibility into how AI interactions with your content evolve over time.

For more information, visit scalepost.ai and Fastly’s AI bot management pages.