How it works
Bound the queue
A finite queue makes overload visible and defines where the system will wait, reject, or shed work instead of failing through memory exhaustion.
Propagate the signal
Protocols can pause reads, reduce request concurrency, lower batch size, or return overload responses that callers respect.
Protect latency
Rejecting some work early can preserve useful latency for admitted requests because an unbounded queue only converts overload into long waits.
Choose the policy
Dropping newest, dropping oldest, sampling, and prioritizing each fit different workloads and business guarantees.