This part of a series on concurrent servers shows how Go handles the problem: launch one cheap, M:N-scheduled goroutine per client, avoiding async/await since the runtime already uses epoll for I/O. It then covers cases where you should still bound concurrency—compute-heavy tasks, limited downstream resources, and malicious clients—via a channel-as-semaphore pattern or a worker pool. Tradeoff noted: goroutines are cheap, but unbounded concurrency can still exhaust CPUs or file descriptors.
Dropbox explains how it reduced transfer latency for distant users by deploying Points of Presence and edge proxy servers in multiple regions, absorbing the TCP slow-start and TLS handshake delays that undersea-cable round trips impose. Proxies hold persistent connections to data centers over private backbone links, with TLS 1.2, PFS, and certificate pinning preserving security. Reported gains vary by market (40% to 3x median speedups), and implementation details remain high-level.
An engineer traveling from the US to India found direct Tailscale connections failed due to symmetric CGNAT on Indian ISPs, forcing traffic through shared DERP relays throttled to ~2.2 Mbits/sec. Self-hosted Tailscale Peer Relays (a node with an open UDP port) restored 27-35 Mbits/sec and cut latency ~150ms by removing the Chicago relay hop. The article explains NAT diagnosis tools and relay setup; DERP remains the fallback, and the tradeoff is operating and exposing a relay on your own infrastructure.