惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

NISL@THU
NISL@THU
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
D
Darknet – Hacking Tools, Hacker News & Cyber Security
阮一峰的网络日志
阮一峰的网络日志
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
WordPress大学
WordPress大学
IT之家
IT之家
Cyberwarzone
Cyberwarzone
博客园_首页
博客园 - 聂微东
V
Visual Studio Blog
Cisco Talos Blog
Cisco Talos Blog
V
Vulnerabilities – Threatpost
Google DeepMind News
Google DeepMind News
Schneier on Security
Schneier on Security
Exploit-DB.com RSS Feed
Exploit-DB.com RSS Feed
The Hacker News
The Hacker News
雷峰网
雷峰网
Last Week in AI
Last Week in AI
Spread Privacy
Spread Privacy
L
Lohrmann on Cybersecurity
O
OpenAI News
人人都是产品经理
人人都是产品经理
AWS News Blog
AWS News Blog
小众软件
小众软件
T
Tailwind CSS Blog
The Cloudflare Blog
L
LINUX DO - 最新话题
有赞技术团队
有赞技术团队
Know Your Adversary
Know Your Adversary
The GitHub Blog
The GitHub Blog
L
LINUX DO - 热门话题
Y
Y Combinator Blog
Stack Overflow Blog
Stack Overflow Blog
B
Blog
MyScale Blog
MyScale Blog
S
SegmentFault 最新的问题
S
Schneier on Security
The Last Watchdog
The Last Watchdog
Application and Cybersecurity Blog
Application and Cybersecurity Blog
Security Archives - TechRepublic
Security Archives - TechRepublic
大猫的无限游戏
大猫的无限游戏
罗磊的独立博客
Blog — PlanetScale
Blog — PlanetScale
博客园 - Franky
I
InfoQ
P
Proofpoint News Feed
量子位
S
Security @ Cisco Blogs

Fastly Blog

Fastly Fastly Fastly Fastly Fastly Fastly Fastly Six Common Live Streaming Mistakes (And How to Avoid Them) How Fastly and Skyfire Enable Trusted Agentic Commerce at the Edge Bot Defense is Table Stakes. Machine Traffic Requires a Business Strategy AI Traffic Grew 6.5x Faster Than Human Traffic This Year Python SDK Beta: How the Language of AI Runs Faster and Safer with Fastly Give AI Agents the Markdown They Actually Want How to Configure Local Logging for an On-Prem Next-Gen WAF Agent Accountability Without Control Is Breaking Security Leadership Fastly Joins the Agentic AI Foundation (AAIF) to Guide Edge AI Interoperability The E-commerce Industry in the AI Era: Has the Agentic Flood Hit? No Margin for Error: What the FIFA World Cup Teaches Us About Performance at the Edge Why iGaming Infrastructure is Breaking and What Comes Next The Publishing Industry in the AI Era: Why Bot Strategy is Now a Business Strategy Bad Performance Kills SaaS/PaaS Growth — Why Your CDN Matters Why your code is safe from Copy Fail on Fastly Compute Myth or Marvel: Claude Mythos and What it Means for Security Introducing Compliance Audit Reports Supporting Google Private AI Compute with Privacy-Preserving Edge Infrastructure Fastly Nearly Half the Web Isn’t Human: Inside Fastly’s Threat Insight Report Media over QUIC: Can Streaming Finally Have Both Scale and Low Latency? Introducing Fastly’s Redesigned Homepage: Your Central Hub for Actionable Insights The False Choice of Indiscriminate Blocking: Why Technical Precision is the New Standard for an Open Internet What is CVE-2026-23869? React Server Components Security Alert Fastly enables first-party tagging for Google Advertisers Shrink Your Bill With Efficient Software Your AI coding agent just got better at Fastly Fastly Ranked as a Leader in the 2026 Forrester Wave™ for Edge Development Platforms Fastly at RSAC 2026: New Advances in AppSec, Bot Management, and Deception Mastering the Edge: What Golf Can Teach Us About Speed, Precision, and Performance Real-Time CDN Monitoring for Live Events with Bronto Imperva Alternatives Best content delivery networks for bot management Vibe Shift? Senior Developers Ship nearly 2.5x more AI Code than Junior Counterparts Maximizing Compute Performance with Log Explorer & Insights Fastly CDN Expands Scaling Fastly Network: Balancing Requests | Fastly Best Practices for Multi-CDN Implementations | Fastly Compute@Edge: Serverless Insights by Company | Fastly Fastly can teach you about the Wasm future in just 6 talks Fastly's Observability Unleashed: New Updates and Insights Optimizing your multi-CDN infrastructure to improve performance Stay ahead of attackers by pushing your security perimeter to the edge Are APIs the Key to Digital Innovation or a Trojan Horse? Fastly Academy: on-demand learning at your fingertips. | Fastly 30 Years of Web: Building for Tomorrow 4 Ways Legacy WAF Fails to Protect Your Apps Adobe boosts performance and MTTR with Epsagon and Fastly logs | Fastly Beta" A New Serverless Compute Environment Early TLS at Fastly Technical trainings & the future of edge delivery at Altitude 2016: a year in review Innovation Capacity Defined: Tech Stack Values | Fastly Deep Log Visibility Offered by Logentries | Fastly Caching the Uncacheable: CSRF Security Increase Your Hit Ratio With This Simple Tip
Fastly + Scalepost: Extending the Fastly platform to manage AI Crawlers
2025-09-12 · via Fastly Blog

John Agger

Principal Industry Marketing Manager, Media & Entertainment, Fastly

Tools like ChatGPT, Perplexity, and Claude are reshaping how digital publishers and content creators engage with their audiences. Instead of clicks and page views, entire answers are now generated on the fly, often drawing directly from the content the creators worked hard to produce. As these platforms become go-to channels for news, entertainment, and commerce, the lack of visibility leaves companies uncertain about their true influence and content adoption in a rapidly growing part of the digital publishing landscape.

ScalePost recently introduced a set of tools that gives publishers and brands clear visibility into how their content appears in AI answers: what’s cited, by whom, and how often, so they can measure presence and improve it. These tools are currently utilized by revenue, marketing, and SEO teams. 

But before diving deeper into how the solution works, it’s worth stepping back to understand why the Fastly platform is uniquely suited for innovation like this. Built to be extended, customized, and enhanced, Fastly gives developers and partners the foundation to create new capabilities at the edge, making solutions like ScalePost possible in the first place.

How Fastly Delivers Unmatched Visibility and Extensibility

Developers and third-party companies continuously enhance the value of Fastly, thanks to our flexible, developer-friendly, and highly customizable architecture. Online businesses can run services and applications directly at the edge, delivering immediate performance improvements and gain greater control over how traffic is managed. This makes Fastly not just another CDN, but an edge platform that grows alongside its users and strengthens their investments over time.

A key differentiator is the visibility Fastly provides. With instant and complimentary log files, companies gain a true real-time data source that shows exactly what’s happening across their traffic. ScalePost, for example, leverages this capability to provide its customers with an accurate and instant view of how content is being accessed and referenced by AI platforms. Where other providers only offer a fraction of log data, often with significant delays, and often at a cost, Fastly makes 100% of customer logs available immediately. That level of transparency empowers businesses to detect issues faster, unlock deeper insights, and build solutions their customers can trust. It’s this combination of openness, speed, and completeness that makes Fastly the strongest complement to any CDN strategy.

ScalePost: Restoring Visibility and Regaining Control

In recent weeks, we’ve looked at a range of solutions built on the Fastly platform aimed at helping content owners capture revenue when their work is scraped. New to this category is ScalePost, which measures how content or brands are cited and positioned in AI answers, then guides publishers or brand owners on how to expand their presence where it matters.

Traditional analytics only measure human referrals and pageviews; they don’t reveal whether an article or brand is powering an AI-generated answer. Once you understand how LLM platforms are using your content and brand, you can make informed decisions: optimize Answer Engine Optimization (AEO) visibility by shaping the content and formats most likely to surface in AI answers; explore monetization opportunities where licensing and partnerships are active today, and where demand is likely to grow; and control access using rules to block unwanted crawlers or set the terms under which they reach your content.

ScalePost delivers actionable signals directly into existing workflows. Integration APIs expose a company’s “AI search footprint,” showing which URLs, headlines, or entities are being lifted into LLM answers. Classification data enables fine-grained policy enforcement, determining which bots are allowed, throttled, or blocked at the edge, while performance metrics and AEO insights inform optimization strategies. By combining Fastly’s edge-native visibility - built on architecture designed from the ground up to run at the network edge to deliver real-time insight - with ScalePost’s correlation layer, Fastly customers gain an instant, reliable, developer-friendly way to detect, classify, and manage AI bot traffic as part of their broader infrastructure strategy.

To sum up, Scalepost provides the following features:

  • Visibility into your AI search footprint: Spot when, where, and how your articles, headlines, and brands are appearing across popular chatbots. This is a core AEO signal.

  • Mentions and context: See which content or brands perform best in AI answers, and how you compare against competitors or peers.

  • Actionable insights for AEO: Go beyond pageviews and clicks to understand how AI platforms are shaping reach and influencing brand perception.

Shedding Light on Hidden Infrastructure Costs

ScalePost also helps engineering and operations teams explain rising infrastructure costs that traditional analytics overlook. AI bots crawling at scale can significantly increase bandwidth, origin egress, and compute utilization, but because this traffic isn’t tied to human sessions, it never appears in referral or revenue reports. The result is a widening gap between infrastructure spend and measurable return. By classifying and correlating AI bot requests with edge-level logs, ScalePost exposes the true drivers of increasing infrastructure cost. Teams can then quantify non-revenue traffic, tune caching and delivery policies, and decide when to throttle, block, or license AI consumption. Put another way: ScalePost turns unexplained costs into measurable activity that can be actively managed.

Fastly’s HTTPS real-time log streaming makes it simple to activate ScalePost, with no impact on human visits. Once enabled, you’ll have immediate access to a real-time dashboard and historical trends, giving you clear visibility into how AI interactions with your content evolve over time.

For more information, visit scalepost.ai and Fastly’s AI bot management pages.