Keeping inventory accurate across Shopify, warehouses, and marketplaces sounds simple. At scale, it is one of the hardest engineering problems in ecommerce.

A single API call after each sale works fine at 200 orders a day. At 20,000 concurrent transactions, it collapses.

Here is what breaks first:

• Overselling when two orders hit the same SKU simultaneously
• Stale counts when a warehouse update takes minutes to reflect
• Silent failures when a sync call times out with no retry
• Duplicate decrements when a webhook fires twice

These are predictable failure modes of monolithic sync. A distributed architecture fixes all of them.

---

The Four Layers You Need

1. Event Producer Layer
Captures inventory change events from Shopify webhooks, WMS, POS, and marketplaces.

2. Message Queue Layer
Events land in a durable queue (Kafka, RabbitMQ, SQS). Nothing gets lost.

3. Microservices Processing Layer
Dedicated services consume events, apply business logic, push updates downstream.

4. State Store Layer
Redis holds the current inventory truth. Shopify is updated from here asynchronously.

Each layer scales independently. Each can fail without taking down the others.

---

Event-Driven Is the Only Foundation That Works

Stop polling. React to events.

Shopify fires these webhooks you need to capture:

• inventory_levels/update
• orders/create
• orders/cancelled
• refunds/create

Each webhook hits your receiver, gets acknowledged immediately, then lands on a queue for async processing.

Never process a webhook synchronously inside the HTTP response window. Timeouts will cause missed events and your inventory will drift.

---

Microservices Breakdown

One service, one job. Deploy and scale them independently.

---

Solving Concurrency: Three Patterns

Two orders. One unit left. Both read stock as 1. Both decrement. Stock hits -1.

Here is how you stop it:

Optimistic Locking
Version numbers on every record. Assert version has not changed before writing. Retry on conflict. Best for low-contention SKUs.

Pessimistic Locking
Lock before reading. One writer at a time. Slower but safe. Use during flash sales.

Atomic Counters (Recommended)
Redis DECRBY is atomic. Use Redis as your inventory counter, sync to Shopify asynchronously. Fastest and most reliable for high volume.

---

Fault Tolerance Checklist

• Dead Letter Queue on every message queue
• Exponential backoff: 1s, 2s, 4s, 8s on API retries
• Idempotency keys on every sync operation
• Circuit breakers to stop hammering degraded services
• Correlation IDs on every event for end-to-end tracing

If you skip any of these, you will debug silent inventory drift at 2am.

---

Caching Strategy

Do not hit the Shopify API on every inventory read.

Use write-through caching with Redis:

1. Every update writes to Redis first
2. Shopify sync happens asynchronously
3. Reads always hit Redis (fast)
4. Webhook fires? Invalidate the cache key immediately

TTL of 30 to 60 seconds works for most inventory read patterns.

---

Which Queue Should You Pick?

SQS is the right default. Move to Kafka only when you need strict event ordering at millions of events per day.

---

Metrics to Watch

• Queue lag (messages behind)
• Sync latency (event to Shopify update)
• DLQ message count
• Inventory mismatch rate
• API rate limit hits

Set alerts on DLQ growth and queue lag. These are your earliest warning signals before inventory starts drifting.

---

Bottom Line

A distributed Shopify inventory sync system rests on four things:

1. Event-driven ingestion
2. Queue-based async processing
3. Atomic counters for concurrency
4. Idempotent operations throughout

Get these right and oversells, stale counts, and silent sync failures become engineering history rather than daily incidents.

---

Originally published on KolachiTech