WAITING FOR YOU

Unread

No deadlines. Just things worth spending time with.

58 articles

grapheneos.social

Could not extract a readable article. The page may require JavaScript, a login, or a subscription.

Improving infrastructure efficiency for growing demand in the age of AI

Dropbox argues that as AI-driven demand grows, getting more from existing infrastructure matters as much as building new data centers. The post describes a system-level approach spanning power management (Deep Sleep), workload rebalancing, higher storage density via SMR drives, and failure-rate-driven hardware lifecycle decisions, reporting watts per petabyte improved over 50% since 2020. Tradeoffs include density versus power/cooling needs, energy savings versus latency, and longer hardware life versus reliability risk.

How we used DSPy to turn AI evaluations into better responses in Dash chat

Dropbox built trajectory-based LLM-as-judge evaluations for its Dash chat agent, then used DSPy's GEPA and MIPROv2 optimizers in two stages: calibrating judges against a small human-labeled set, then optimizing the agent's system prompt via offline replay of historical chats. Reported gains include 26% fewer incomplete answers, 13% fewer missed key aspects, and 5.4% lower token usage. The tradeoffs: automation requires strict guardrails, and weak evaluation signals risk brittle improvements.

Testing cookie behavior across hundreds of web surfaces with our in-house auditor

Dropbox describes an in-house cookie auditor built with Playwright that simulates privacy-conscious visitors (US, EU, and Global Privacy Control signals) across 200+ web surfaces, verifying consent choices persist and only appropriate cookies load. The article argues browser automation was the easy part; most effort went into translating legal concepts into testable rules, maintaining a current URL inventory via traffic-data analysis, and separating real violations from false positives. Classifications live outside the code so privacy staff can update rules without engineering releases.

How well do agents use test/verification techniques?

An empirical eval of 26 prompt conditions (TDD, fuzzing, property-based testing, formal methods, and testing skills) given to coding agents implementing Zstd in Rust, ~80 runs each. Nothing beat the default no-instructions baseline; agents apply techniques superficially—vacuous proofs, trivial random tests—while TDD and popular testing skills underperformed. A brief hand-written skill nudging risky-area checks and structured randomization scored best, suggesting expert guidance matters more than naming techniques.

There's no point at which turning your brain off will work

The author argues that 'brain-off' LLM use—having agents write code and just relaying failures back (being a 'meat proxy')—still produces poor-quality software, failing on out-of-distribution problems and overfitting to tests or metrics. Even if it eventually yields good software, it won't benefit the employee, since a company could run the LLM loop without them and lay them off. He contends the present is the worst time to disengage, as companies are eager to cut low-contribution roles.

Have it both ways: stay discoverable in search while disallowing AI training

Cloudflare argues that mixed-use crawlers (Applebot, Bingbot, Googlebot) forced site owners to choose between search discoverability and refusing AI training. Its new Disallow AI Training setting publishes a robots.txt preference that 'Accountable' operators honor, keeping search while blocking training; Block now applies to mixed-use crawlers too, affecting search. Settings migrate automatically on September 15, with stricter presets for ad-funded sites. Cloudflare frames AI summaries, with only partial controls today, as the next unresolved tradeoff.

When scanners miss the attack: how Cloudflare Client-Side Security protects storefronts

Cloudflare details four malicious JavaScript campaigns found on storefronts—affiliate-commission hijacking, clickless affiliate theft, a remote-code backdoor, and a paid-traffic cloaker—that VirusTotal and URLScan largely missed, arguing behavioral ML analysis beats signature scanning for gated, conditionally executing scripts. The detection pipeline combines a graph neural network, a lightweight LLM on Workers AI, and a weighted frontier-model voting ensemble with human review. It is a vendor post promoting Cloudflare Client-Side Security, so evidence is detailed but conclusions favor the product.

Saving another 100TB of RAM with math (and Rust)

Cloudflare cut ~100TB of RAM from its Pingora Backend Router by attacking pingora-ketama's consistent-hashing rings on two fronts: packing the per-point struct from 8 bytes to 6 (25% savings, done via a raw byte array because Rust's alignment rules negate simply shrinking the index field), and reducing hashes per server by 90%, justified by a derived formula (CV_k = sqrt((N-1)/(Nk+1))) showing the last 90,000 of ~100,000 hashes bought only ~0.7% error reduction while 32-bit collisions actually made error worse at high hash counts. The tradeoffs are that fewer hashes raises the theoretical load-imbalance error margin, and changing the ring re-routes cacheable requests and would invalidate cached content, so both rings ran side by side per request and the rollout proceeded data-center by data-center to limit cache churn and blast radius.

Astra for Coding: Why Are We Doing This Again?

The author ran a fully autonomous 'software factory' with GPT 6 Astra for 35 hours (~$1200, 79 commits, 75k lines of code) and got nothing usable. His core complaint is that the model's token-efficient 'codegolf' Python for tool calls leaks into committed code, producing unreadable and bizarre output, and that it won't stop on oversized tasks. He argues training rewards local metrics over human readability, and doubts these costlier models still fit day-to-day software engineering versus other use cases.