惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Y
Y Combinator Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
V
V2EX
博客园 - 三生石上(FineUI控件)
Hugging Face - Blog
Hugging Face - Blog
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
罗磊的独立博客
博客园_首页
量子位
雷峰网
雷峰网
GbyAI
GbyAI
小众软件
小众软件
酷 壳 – CoolShell
酷 壳 – CoolShell
D
DataBreaches.Net
H
Hackread – Cybersecurity News, Data Breaches, AI and More
The Cloudflare Blog
IT之家
IT之家
WordPress大学
WordPress大学
人人都是产品经理
人人都是产品经理
Apple Machine Learning Research
Apple Machine Learning Research
P
Proofpoint News Feed
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
博客园 - 聂微东

Resend RSS Feed

6 Tips for Accessible Emails Welcoming Manoel do Amaral, our new Brand Designer Welcoming Michael Vaz, our new Customer Success Engineer Six Steps to Improve Your Sender Reputation Welcoming Tatira Andrade, our new Executive Assistant Welcoming Pedro Ivo Hudson, our new Design Engineer Welcoming Diel Duarte, our new Open source Engineer Welcoming Areia Spinner, our new Recruiter Resend Forward: A Conference about Craft React Email 6.0 Custom Tracking Domains AI Email Editor Introducing Automations Welcoming Ahmed Tolba, our new SRE Engineer Welcoming Aneil Singh, our new Founding Account Executive Welcoming Lucas Motta, our new Software Engineer Welcoming Trey Knowles, our new Founding Account Executive Welcoming Anxhela Carciu, our new SRE Engineer Introducing DMARC Analyzer Welcoming Evan Thibodeau, our new Customer Success Engineer Welcoming Derich Pacheco, our new Software Engineer Welcoming Alec Ventura, our new Data Engineer Welcoming Felipe Freitag, our new Software Engineer Welcoming Mateusz Wos, our new Software Engineer Email automation for OpenClaw How to Create a DevTools Agent Skill Introducing Email Skills Why You Should Embrace the Promotions Tab Slater Smith, our new Customer Success Engineer Do You Need a Warmup Service?
Incident report for February 15, 2026
Cassio Zen, Felipe Volpone, Zeno Rocha · 2026-02-16 · via Resend RSS Feed

On February 15, 2026, starting at 10:19 PM UTC, Resend experienced an incident that caused email sending delays and errors loading the dashboard.

The outage lasted 3 hours and 31 minutes, with full service recovery at 1:50 AM UTC.

No emails were lost during this incident. However, most of the emails were delayed, and the dashboard was inaccessible due to database connection exhaustion.

We're really sorry if you were affected by this incident. You trust Resend with your emails, and we take that seriously. This post is a transparent account of what happened, how we responded, and the steps we're taking to prevent this from happening again.

Incident overview

The database reached its maximum connection limit, with idle connections not being released fast enough under load. This caused connection exhaustion across the system, preventing the dashboard and non-email API operations from functioning normally.

We resolved the outage by:

  1. Reducing connection pool sizes
  2. Limiting idle connection times
  3. Setting stricter connection limits per database role

Email sending continued to work throughout the incident, but delivery was delayed by approximately 2 hours on average, with all queued emails fully delivered by the end of the incident.

Timeline (UTC)

All times are in Coordinated Universal Time (UTC)

  • 22:20: Alerts were triggered for request latency
  • 23:07: Noticed dashboard operations getting slow
  • 23:55: Internal incident escalation and investigation
  • 00:00: Posted on status page, updating every 30-60 minutes until resolution
  • 00:19: Enabled attack mode out of abundance of caution (visitors had to complete a security challenge before accessing the dashboard)
  • 00:22: Reduced the maximum database connection pool size
  • 00:42: Scaled up compute resources for executing server functions
  • 00:50: Altered maximum number of connections for the application's database role
  • 00:59: Observed a drop in the number of active database connections while processing the email queue at full speed
  • 01:03: Observed the number of 5xx errors decreasing significantly
  • 01:36: No more pending emails in the queue

Background

Yesterday, due to a lack of configuration in one of our databases, a service went from an average of 60 database connections usage to over 330. This spike was unusual because it was not correlated to the actual traffic.

Graph showing database connections increasing
Graph showing database connections increasing

We have applications using different sets of combinations for: deployment type (long-lived, serverless, cron-based, etc), Postgres library and database connection config (direct vs using Pooler). This mixed setup made it hard to ensure a healthy usage of the database connections.

Since we built the email sending platform to be resilient to database unavailability, emails were delayed but not lost.

How we responded

After identifying the database starvation issue, we realized the Max Pool Size for the database clients was too high, allowing that single application to use more database connections than it needed.

Graph showing database connections decreasing
Graph showing database connections decreasing

We decreased the initial number twice, in a time interval of 20 minutes, allowing Resend's services to recover and open new connections to the database. After that, we altered the max number of connections for the faulty application (using Postgres connection limit configuration).

After approximately 40 minutes, the whole platform recovered and started reprocessing the delayed emails.

It's important to note that the internal escalation process took way longer than it should have, and we're actively working on improving it.

Moving forward

To prevent this from happening again, here's what we're changing:

1. More resilient database connections

  • Reviewing every Postgres role configuration to ensure that all applications have the proper limits on the number of connections they can open.
  • Isolating a few critical tables as a separate database to reduce the blast radius of heavy load times.

2. Better incident response

  • Improving the on-call rotation and escalation processes to reduce initial response time.
  • Implementing a better way for customers to contact us during dashboard incidents.

Thank you to everyone who reported issues and gave us feedback. We hear you, and we're acting on it. If you have questions or concerns, please reach out to us.