惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

J
Java Code Geeks
Stack Overflow Blog
Stack Overflow Blog
B
Blog RSS Feed
C
Check Point Blog
D
Docker
Y
Y Combinator Blog
Recent Announcements
Recent Announcements
Google DeepMind News
Google DeepMind News
MongoDB | Blog
MongoDB | Blog
博客园_首页
Apple Machine Learning Research
Apple Machine Learning Research
量子位
有赞技术团队
有赞技术团队
IT之家
IT之家
大猫的无限游戏
大猫的无限游戏
D
DataBreaches.Net
M
MIT News - Artificial intelligence
B
Blog
阮一峰的网络日志
阮一峰的网络日志
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
腾讯CDC
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
V
V2EX
月光博客
月光博客

Datadog | The Monitor blog

Introducing our open source AI-native SAST Instrument and monitor Boomi integration flows with OpenTelemetry and Datadog Not all index scans are equal: How we cut query latency by over 99% Platform engineering metrics: What to measure and what to ignore Integrate Recorded Future threat intelligence with Datadog Cloud SIEM CI/CD security: threat modeling using a MITRE-style threat matrix CI/CD security: How to secure your GitHub ecosystem Ingress NGINX is EOL: A practical guide for migrating to Kubernetes Gateway API Operating agentic AI with Amazon Bedrock AgentCore and Datadog LLM Observability: Lessons from NTT DATA Introducing the Datadog Code Security MCP Capture and analyze custom heatmaps in Session Replay Understand session replays faster with AI summaries and smart chapters Monitor ClickHouse query performance with Datadog Database Monitoring How we designed empathetic alert sounds for on-call engineers Search and act across Datadog to resolve issues faster with Bits Assistant Measure the business impact of every product change with Datadog Experiments Analyzing round trip query latency Configuring JavaScript caches for better performance Introducing Bits AI Dev Agent for Code Security Datadog achieves ISO 42001 certification for responsible AI Monitor Nutanix clusters, hosts, and VMs with Datadog Monitor Juniper Mist in Datadog A new Host Map for modern infrastructure Annotate traces to improve LLM quality with Datadog LLM Observability What’s new in Cloud SIEM: AI-powered investigations, enhanced threat intelligence, and scalable security operations Explore Kubernetes with native OpenTelemetry data Monitor Oracle Fusion Cloud Applications with Datadog Announcing the Datadog Terraform provider v4.0.0 Scaling Kubernetes workloads on custom metrics How to design cloud environments for AI-powered threat analysis
Pinpoint performance issues in downstream services with t...
Scott Richardson, Garrett Sibinga, Aaron Kaplan · 2023-07-21 · via Datadog | The Monitor blog
Scott Richardson

Scott Richardson

Garrett Sibinga

Garrett Sibinga

Aaron Kaplan

Aaron Kaplan

Visibility into the upstream and downstream dependencies of your services is key to maintaining a performant microservices environment. Application developers and SREs rely on this visibility to quickly trace issues back to the source, which is essential during incidents—when time is of the essence—throughout day-to-day operations, and as systems evolve and scale. But troubleshooting issues can be difficult when your resources receive traffic from numerous sources, and issues often originate multiple steps upstream.

We’re pleased to announce the Dependency Map Navigator, which provides detailed visibility into the flow of traffic through your resources, such as specific endpoints or queries, from your upstream to your downstream service dependencies. This visibility lets you quickly pinpoint repetitive requests to services in downstream call paths and troubleshoot issues in upstream services.

In this post, we’ll provide an overview of how the Dependency Map Navigator can help you:

  • Zero in on load amplification in downstream services

  • Expedite incident response by quickly identifying large upstream callers

Zero in on load amplification in downstream services

Load amplification occurs when a resource sends a substantially higher number of requests to a downstream service than it receives, as in cases of the n+1 problem—a common instance of which is repetitive querying to a database. Load amplification drags down application performance and drives up costs. But it can also be difficult to identify, and engineers are often under-equipped to determine which specific upstream call paths have triggered load amplification in downstream services.

With the Dependency Map Navigator, you can quickly pinpoint load amplification in your call paths. You can access the Dependency Map via the Service Catalog or Service Map in APM. Each Service Page includes a table of resources, and each Resource Page has a Dependency Map with the Navigator.

The Dependency Map displays the upstream and downstream service dependencies of any resource you select. You can hover over each node on the map to view service metrics, including requests per second, error rate, and average latency. You can click on each node to access the relevant Service Page or host map, as well as related traces, monitors, logs, and processes.

The Dependency Map Navigator flags services experiencing load amplification and sorts them by severity

On the left-hand side, the Dependency Map Navigator flags services that are experiencing load amplification and sorts them by severity. In the Navigator, you can expand each service undergoing load amplification to see repetitive spans. Load amplification is calculated by comparing the number of requests received by the selected resource with the number of requests received by each downstream service. Traffic volume is indicated in the map by the weights of the edges connecting the nodes, enabling at-a-glance evaluation.

Expedite incident response by quickly identifying large upstream callers

Without the ability to trace traffic to your resources back to specific upstream callers, incident response can become prolonged and disorganized. By identifying the upstream services that are sending the most traffic to affected endpoints, the Dependency Map provides vital information for incident investigations and helps facilitate internal coordination among teams. From the Dependency Map, you can easily pivot to the Service Catalog, where you can identify which team owns a particular service and access their dedicated Slack channels, Jira boards, and GitHub repositories with a single click.

Let’s say you’re an SRE who’s been paged about elevated latency in one of your endpoints. Using the Dependency Map Navigator, you can quickly identify the upstream dependencies issuing the highest proportion of calls to that endpoint. From there, you can begin your incident investigation by inspecting those callers’ Service Pages or any associated monitors. The screenshot below shows the red service node borders the Dependency Map uses to indicate monitor alerts.

The Dependency Map Navigator provides a solid starting point for incident investigation by identifying large upstream callers

Speed up troubleshooting and optimize performance in your services

Real-time visibility into dependencies is particularly important due to the dynamic nature of cloud-based infrastructure. With the Dependency Map Navigator, engineering teams can quickly zero in on costly performance inefficiencies in downstream services and expedite troubleshooting during incidents. Datadog APM users can start using the Dependency Map Navigator with their instrumented applications today. If you’re new to Datadog, get started with a 14-day free trial.