THE COLLECTION
Library
Everything you’ve found. Nothing you need to save twice.
6 articlesBrowse at your own pace.
c
How to effectively debug when you no longer understand the code
The author fixed three production bugs with the Claude agent while not fully understanding the code. The method uses a control case, high-fidelity signals, and a matrix that maps hypotheses to facts. Teams must build data collection and verification into infrastructure. Agents give wrong answers when they only read code.
copyconstruct.medium.comCindy SridharanOct 15, 202675 minadvancedRead7 answers
e
Everyone is doing Git on S3 wrong
The article argues that Git-on-object-storage designs using a write-ahead log, like Cursor's Continuity, gain durability and read scaling but remain effectively single-writer and still need full repositories on disk. The author presents Enroute, which instead uses per-repository Raft consensus, stateless compute nodes, optimistic locking, and a segment/layer format confining deltas to commit ancestry, with S3 for durability. Reported peak exceeds 7,600 pushes per second into one repository; reads benchmark near stock Git, but clients pay more to decode served deltas, and garbage collection remains unsolved.
enroute.shOct 13, 202619 minadvancedUnread
H
Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL
A rank-1 LoRA adapter is only a few MB, so async GRPO can span separate HF Jobs: trainer and vLLM replicas swap adapters via a mounted Storage Bucket instead of NCCL, with a proxy adding auth, broadcasting adapter loads, and routing rollouts by KV prefix. Five instrumented runs chase the bottleneck between training and generation; packing, dropping gradient checkpointing, and raising in-flight caps cut 500 steps from 3h27m to 53min at equal reward. Tradeoffs: FUSE sync lag, retry logic, concurrency caps.
Hugging FaceAmine Dirhoussi, Quentin Gallouédec, Kashif Rasul, Sergio PaniegoFeb 24, 202528 minadvancedUnread
U
Uber’s Real-Time Push Platform
Uber replaced mobile app polling—which reached 80% of gateway traffic—with RAMEN, a server-push platform built on Server-Sent Events plus a custom sequence-number/acknowledgment protocol for at-least-once delivery. Scaling forced a rewrite from Node.js with Ringpop gossip sharding to Netty with ZooKeeper/Helix, reaching 1.5M concurrent connections and 250K messages/sec. A newer gRPC bidirectional streaming version addresses delayed acks, unidirectional transport, and text-only payload limits.
Uber Engineering17 minadvancedUnread
U
Service-Oriented Architecture: Scaling the Uber Engineering Codebase As We Grow
Uber recounts migrating from a monolithic codebase to a microservices SOA (500+ services) to handle rapid growth, which solved coupling and deployment problems but introduced issues of obviousness, safety, and resilience. They adopted Apache Thrift for strict cross-language service contracts and built client-publishing tooling, drawing on Netflix Hystrix and Twitter Finagle for fault tolerance. Tradeoffs include immature Thrift tooling for Python and Node, and no header support complicating authentication and tracing.
Uber Engineering5 minintermediateUnread
C
Saving another 100TB of RAM with math (and Rust)
Cloudflare cut ~100TB of RAM from its Pingora Backend Router by attacking pingora-ketama's consistent-hashing rings on two fronts: packing the per-point struct from 8 bytes to 6 (25% savings, done via a raw byte array because Rust's alignment rules negate simply shrinking the index field), and reducing hashes per server by 90%, justified by a derived formula (CV_k = sqrt((N-1)/(Nk+1))) showing the last 90,000 of ~100,000 hashes bought only ~0.7% error reduction while 32-bit collisions actually made error worse at high hash counts. The tradeoffs are that fewer hashes raises the theoretical load-imbalance error margin, and changing the ring re-routes cacheable requests and would invalidate cached content, so both rings ran side by side per request and the rollout proceeded data-center by data-center to limit cache churn and blast radius.
CloudflareSep 18, 202614 minintermediateUnread