惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Jina AI
Jina AI
博客园 - Franky
Apple Machine Learning Research
Apple Machine Learning Research
酷 壳 – CoolShell
酷 壳 – CoolShell
阮一峰的网络日志
阮一峰的网络日志
量子位
雷峰网
雷峰网
宝玉的分享
宝玉的分享
V
Visual Studio Blog
博客园_首页
小众软件
小众软件
The Cloudflare Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
大猫的无限游戏
大猫的无限游戏
博客园 - 聂微东
S
SegmentFault 最新的问题
博客园 - 【当耐特】
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
博客园 - 叶小钗
月光博客
月光博客
博客园 - 三生石上(FineUI控件)
人人都是产品经理
人人都是产品经理
WordPress大学
WordPress大学

Datadog | The Monitor blog

Introducing our open source AI-native SAST Instrument and monitor Boomi integration flows with OpenTelemetry and Datadog Not all index scans are equal: How we cut query latency by over 99% Platform engineering metrics: What to measure and what to ignore Integrate Recorded Future threat intelligence with Datadog Cloud SIEM CI/CD security: threat modeling using a MITRE-style threat matrix CI/CD security: How to secure your GitHub ecosystem Ingress NGINX is EOL: A practical guide for migrating to Kubernetes Gateway API Operating agentic AI with Amazon Bedrock AgentCore and Datadog LLM Observability: Lessons from NTT DATA Introducing the Datadog Code Security MCP Capture and analyze custom heatmaps in Session Replay Understand session replays faster with AI summaries and smart chapters Monitor ClickHouse query performance with Datadog Database Monitoring How we designed empathetic alert sounds for on-call engineers Search and act across Datadog to resolve issues faster with Bits Assistant Measure the business impact of every product change with Datadog Experiments Analyzing round trip query latency Configuring JavaScript caches for better performance Introducing Bits AI Dev Agent for Code Security Datadog achieves ISO 42001 certification for responsible AI Monitor Nutanix clusters, hosts, and VMs with Datadog Monitor Juniper Mist in Datadog A new Host Map for modern infrastructure Annotate traces to improve LLM quality with Datadog LLM Observability What’s new in Cloud SIEM: AI-powered investigations, enhanced threat intelligence, and scalable security operations Explore Kubernetes with native OpenTelemetry data Monitor Oracle Fusion Cloud Applications with Datadog Announcing the Datadog Terraform provider v4.0.0 Scaling Kubernetes workloads on custom metrics How to design cloud environments for AI-powered threat analysis
Empower engineers to take ownership of Google Cloud costs...
2024-04-02 · via Datadog | The Monitor blog

Google Cloud provides a wide range of services and tools to help engineering teams reduce the complexity of migrating and deploying applications in the cloud. As engineering teams work to improve the performance, reliability, and security of their applications, they also need to be conscious of cloud costs. But engineers often don’t have access to cost data, or they only see cost data in monthly reports. This limited visibility makes it difficult to understand the relationship between cost fluctuations and infrastructure changes across the services they own. In order to empower engineers to take ownership over the costs of the resources they’re deploying, everyone across your organization needs access to cost and observability data in the same platform.

To help teams address this challenge, we’re pleased to announce that Datadog Cloud Cost Management now supports Google Cloud, which complements our existing support for AWS and Azure. In this post, we’ll explore how Cloud Cost Management provides total cost observability for engineering teams. We’ll also show you how you can use Cloud Cost Management to:

Cost observability for engineering teams

As DevOps engineers are increasingly responsible for provisioning their own infrastructure, they need to understand the total cost to run their services, share that cost data with other engineering teams, and ultimately optimize their services. That’s why Datadog Cloud Cost Management provides total visibility into cost data from Google Cloud and other providers and unifies it with telemetry data from your environment, all in one platform. By incorporating cost data into the same platform that engineers already use to monitor their services, teams can take ownership of their own costs without disrupting their existing workflows.

Engineers can understand their service costs and view this cost data alongside telemetry data from their resources, deployments, and more, allowing them to understand how changes—such as code deployments and infrastructure upgrades—actually impact costs. Datadog collects detailed telemetry data from key components of your Google Cloud environment, including:

  • CPU, memory, and other resource metrics from services like Google Compute Engine (GCE) and Google Kubernetes Engine (GKE)
  • BigQuery and Cloud SQL storage metrics
  • Usage data from serverless applications running on Cloud Functions and Cloud Run

By correlating this observability data with cost data, engineers can get granular insights into their teams’ contributions to costs, uncover savings opportunities, and avoid cost overruns.

Unlock cost visibility

Granular visibility into cost data is essential for empowering engineers to take control over their own spend. However, technologies like Kubernetes operate on shared resources, which makes it difficult to precisely attribute costs to individual teams. Instead of tracking the total cost of a Kubernetes cluster, it can be more helpful to understand the cost of individual services you’re running, or see which teams are contributing the most to the cluster’s costs.

In Datadog Cloud Cost Management, you can use tags to isolate resources from Google Kubernetes Engine (GKE) and then drill down further by grouping by tags like team and service. For example, the following screenshot indicates that the platform team’s GKE costs have increased 27 percent over the past few days, compared to the previous period.

Datadog Cloud Cost Management shows that the platform team's GKE costs have increased 27 percent over the past few days, compared to the previous period.

Engineers on each team can use Cloud Cost Management to gain a clearer understanding of how much their team has specifically contributed to the cost of shared resources, and investigate unexpected changes in costs.

Uncover cost savings opportunities

Incorporating cost data into the same platform as observability data also empowers you to proactively uncover inefficiencies and reduce wasteful spend. By directly comparing cost data with metrics like CPU utilization, you can quickly spot underutilized resources that you can downsize or remove without affecting customers.

In the following example, the cost breakdown table on our out-of-the-box Google Cost Savings Opportunities dashboard shows that the shopist service is consistently underutilizing its Compute Engine instances, indicating that you may be able to downsize. If you decide to take action, you can pivot to track key performance metrics, such as checkout latency, to ensure that this change does not negatively impact your end-user experience.

Datadog Cloud Cost Management provides an out-of-the-box Google Cost Savings Opportunities dashboard that can help highlight opportunities to optimize cloud spend.

This dashboard can also help you identify opportunities to clean up abandoned resources in your environment. For example, the following graph visualizes Cloud SQL databases’ CPU and memory utilization. The size of each circle corresponds to its cost. By focusing on larger circles in the lower-left corner of the graph (i.e., databases that have relatively higher costs and are utilizing a small percentage of CPU and memory), you can identify potential opportunities to reduce waste. In this example, it looks like a database was created for testing, but it is not using much of its resources. In this case, you can easily reach out to the owner of this database to confirm that it is no longer needed. By taking action after identifying these kinds of cost savings opportunities, teams can promote a culture of cost ownership and take more control over their own cloud spend.

Datadog's Google Cost Savings Opportunities dashboard can help reduce waste from resources that may no longer be needed, such as a database that was created for testing but is no longer being used.

Avoid cost overruns

To automatically stay on top of cost changes over time, you can also set up automated monitors. Cost monitors can help you track the cost of resources you spin up, but they can also monitor a combination of costs and any other data that matters to your business.

For example, if you’re building an ecommerce app, you may find it useful to create a monitor that notifies you when the week-over-week change in the cost per customer checkout exceeds a certain percentage. These monitors can help engineering teams proactively avoid cost overruns as they scale their infrastructure and mitigate unexpected cost increases before they spiral out of control. With this data in hand, teams can also build features with an eye on cost efficiency and promote a culture of cost ownership.

Cost change monitors can help automatically alert you when the week-over-week change in the cost per customer checkout exceeds a certain percentage.

Full observability for your Google Cloud environment

Datadog Cloud Cost Management enables engineers to view cost data in context with observability data, so they can take ownership of their costs. With Cloud Cost Management, FinOps and DevOps teams can collaborate more efficiently to optimize cloud spend and strategically improve the cost efficiency of their services without impacting their customer experience. To learn how to get started with Cloud Cost Management, visit our documentation. If you’re not already using Datadog, you can sign up for a 14-day free trial.