惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

量子位
云风的 BLOG
云风的 BLOG
小众软件
小众软件
IT之家
IT之家
T
Tailwind CSS Blog
WordPress大学
WordPress大学
S
SegmentFault 最新的问题
美团技术团队
博客园 - 叶小钗
V
V2EX
博客园 - Franky
大猫的无限游戏
大猫的无限游戏
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
阮一峰的网络日志
阮一峰的网络日志
博客园 - 【当耐特】
罗磊的独立博客
博客园_首页
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
爱范儿
爱范儿
宝玉的分享
宝玉的分享
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
Jina AI
Jina AI
月光博客
月光博客
有赞技术团队
有赞技术团队

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
THE MOST IMPORTANT CONCEPT: MEASURING RELIABILITY: SLO, S...
Aisalkyn Aid · 2026-05-07 · via DEV Community

Aisalkyn Aidarova

Site Reliability Engineering is not just monitoring or fixing servers.

It is:

Applying software engineering principles to operations to make systems reliable at scale.

That means:

  • You don’t manually fix things → you automate
  • You don’t guess → you measure
  • You don’t react → you design for failure

Core mindset

A normal engineer asks:

“Is the system working?”

An SRE asks:

“How well is it working, how often does it fail, and how much failure is acceptable?”


Before SRE existed, companies said:

System should be reliable

Enter fullscreen mode Exit fullscreen mode

That means nothing.

SRE changed that to:

Reliability must be measurable

Enter fullscreen mode Exit fullscreen mode

This is where SLI, SLO, SLA come in.


🧠 PART 3 — SLI (SERVICE LEVEL INDICATOR)

What it really is

An SLI is:

A real measurement of user experience

Not system metrics like CPU — but user-facing metrics.


Examples

Instead of:

CPU = 70%

Enter fullscreen mode Exit fullscreen mode

We measure:

Request success rate
Request latency
Error rate

Enter fullscreen mode Exit fullscreen mode


Real example

Imagine your API:

  • 1000 requests
  • 990 succeed
  • 10 fail

Your SLI:

Success rate = 99%

Enter fullscreen mode Exit fullscreen mode


Important rule

SLI must reflect USER experience

Enter fullscreen mode Exit fullscreen mode

If user is unhappy → your SLI is wrong


🧠 PART 4 — SLO (SERVICE LEVEL OBJECTIVE)

What it really is

SLO is:

A target you set for your system performance


Example

You define:

99.9% of requests must succeed

Enter fullscreen mode Exit fullscreen mode

That is your SLO.


Why SLO exists

Because perfection is impossible.

So instead of:

System must never fail ❌

Enter fullscreen mode Exit fullscreen mode

We say:

System can fail within limits ✅

Enter fullscreen mode Exit fullscreen mode


Another example

Latency SLO:

95% of requests < 200ms

Enter fullscreen mode Exit fullscreen mode


Key idea

SLO defines acceptable reliability

Enter fullscreen mode Exit fullscreen mode


🧠 PART 5 — SLA (SERVICE LEVEL AGREEMENT)

What it really is

SLA is:

Business contract based on SLO


Example

If uptime < 99.9% → customer gets refund

Enter fullscreen mode Exit fullscreen mode


Important difference

Concept Purpose
SLI measurement
SLO internal goal
SLA external contract

🧠 PART 6 — ERROR BUDGET (THIS IS SENIOR LEVEL)

This is the most important concept in SRE.


What it is

If your SLO is:

99.9% uptime

Enter fullscreen mode Exit fullscreen mode

Then:

0.1% failure is allowed

Enter fullscreen mode Exit fullscreen mode

That is your error budget


In real time

~43 minutes downtime per month

Enter fullscreen mode Exit fullscreen mode


Why it matters

It creates balance:

Developers → want speed
SRE → want stability

Enter fullscreen mode Exit fullscreen mode

Error budget decides:

If budget remains → deploy
If exhausted → stop releases

Enter fullscreen mode Exit fullscreen mode


Real rule

No error budget = no deployments

Enter fullscreen mode Exit fullscreen mode


🧠 PART 7 — HOW WE MEASURE AVAILABILITY

Formula

Availability =

(Total time - downtime) / total time

Enter fullscreen mode Exit fullscreen mode


Example

30 days = 720 hours
Downtime = 2 hours

(720 - 2) / 720 = 99.72%

Enter fullscreen mode Exit fullscreen mode


SRE levels

Level Meaning
99% basic
99.9% production
99.99% critical
99.999% extreme

🧠 PART 8 — LATENCY (WHY AVERAGE IS WRONG)

Average lies.


Example

99 requests = 100ms
1 request = 10 seconds

Enter fullscreen mode Exit fullscreen mode

Average looks fine — but system is broken.


Solution

Use percentiles:

  • P50 → normal
  • P95 → slow users
  • P99 → worst users

Real SLO

95% of requests < 200ms

Enter fullscreen mode Exit fullscreen mode


🧠 PART 9 — MONITORING (WHAT SRE ACTUALLY WATCHES)

Golden Signals (Google SRE)

  1. Latency
  2. Traffic
  3. Errors
  4. Saturation

What this means

You monitor:

How fast?
How many?
How broken?
How loaded?

Enter fullscreen mode Exit fullscreen mode


Tools

  • Prometheus
  • Grafana
  • CloudWatch
  • ELK

🧠 PART 10 — ALERTING (VERY IMPORTANT)

Bad alert:

CPU > 80%

Enter fullscreen mode Exit fullscreen mode

Good alert:

Error rate > 5% for 5 minutes

Enter fullscreen mode Exit fullscreen mode


Rule

Alert only when users are impacted

Enter fullscreen mode Exit fullscreen mode


🧠 PART 11 — INCIDENT MANAGEMENT

Incident = system failure affecting users


SRE process

  1. Detect
  2. Respond
  3. Fix
  4. Learn

Postmortem

Must be:

Blameless

Enter fullscreen mode Exit fullscreen mode


You document

  • timeline
  • root cause
  • impact
  • fix
  • prevention

🧠 PART 12 — RELIABILITY ENGINEERING

You design systems that:

Expect failure

Enter fullscreen mode Exit fullscreen mode


Example

Instead of 1 server:

ALB → multiple EC2 → DB replicas

Enter fullscreen mode Exit fullscreen mode


Goal

No single point of failure

Enter fullscreen mode Exit fullscreen mode


🧠 PART 13 — SCALING

Vertical

bigger machine

Enter fullscreen mode Exit fullscreen mode

Horizontal

more machines

Enter fullscreen mode Exit fullscreen mode


SRE prefers

Horizontal scaling

Enter fullscreen mode Exit fullscreen mode


🧠 PART 14 — NETWORKING (WHAT YOU DID)

You must understand:

  • VPC
  • routing
  • NAT vs IGW
  • TGW
  • PrivateLink

🧠 PART 15 — AUTOMATION

Rule:

If you repeat it → automate it

Enter fullscreen mode Exit fullscreen mode


Tools

  • Terraform
  • Bash
  • Python

🧠 PART 16 — CI/CD

You must know:

  • pipelines
  • deployments
  • rollback

Strategies

  • rolling
  • blue/green
  • canary

🧠 FINAL UNDERSTANDING

SRE is:

Measure → Define → Monitor → Improve → Automate

Enter fullscreen mode Exit fullscreen mode


💬 PERFECT INTERVIEW ANSWER

SRE focuses on maintaining system reliability by defining measurable objectives like SLOs, monitoring system health, managing incidents, and automating infrastructure while balancing system stability with development velocity.