Multi-tenant Real-time Game Chat — Fixing Write Bottlenecks Through Key Design
A chat server designed to be shared by several games: channel-level Valkey sharding cut ACK p95 from 767.6ms to 6.6ms, and a dev load test held 20,002 CCU for 900s.
- ACK p95 (6K msg/s)
- 767.6ms 6.6ms
Single node → 4-shard cluster
- Dev load held
- 6,000 CCU target 20,002 CCU · 900s
3.3x the target concurrency sustained