October 4, 2026 — The Agent Said Done. The Database Disagreed.
Microsoft's ThinkingBox benchmark grades agents on database state, not their own report. Cloudflare wants developers to build the next Git platform for agents, with credits as the prize. Plus the Coucou notch app, Zig 0.17, Istio 1.31 and uv.
Show notes
Everything covered in today's episode, with the sources behind each segment.
SEGMENT 1: When Done Isn't Done
SEGMENT 2: Repo of the Day
SEGMENT 3: Cloudflare Wants Your Git Platform
SEGMENT 4: Ship Log
- Istio 1.31 announcement
- InfoQ on Istio 1.31 and agentgateway
- Zig 0.17.0 release notes
- Tech AI Wire on Zig 0.17.0
- uv 0.12.23 release
- Docker Compose v5.6.0 release
SEGMENT 5: Fast Boot
- The Hacker News on Warlock and SharePoint
- Symantec and Carbon Black technical report
- SecurityWeek on Fortra BoKS patches
- Fortra advisory FI-2026-015
- Fortra advisory FI-2026-017
- Hacker News discussion on Hole Punch
*Research is current as of Saturday, October 3, 2026.*
Transcript
Host0:34
Nine tool calls. Every one of them sensible. The agent finished cleanly, reported no error, and left a support ticket marked solved when the policy required it to be on hold. That's the example Microsoft and Hugging Face use to introduce a benchmark called ThinkingBox. It grades what's in the database afterward, not what the agent says it did. Here's the interface. Each task hands the agent a starting backend state, a user goal, a set of MCP tools, and a domain policy. A simulated user only shares private context when asked. When the agent stops, deterministic checks compare the final database state and side effects against the required outcome. Every attempt starts from a freshly initialized backend with its own isolated tool session. Nothing carries over. The benchmark has five hundred seven tasks, across retail and e-commerce, travel and hospitality, auto insurance, neobank support, and consulting IT and HR support. Four hundred seventy seven are graded on backend state alone. Thirty also use response rubrics. And each task runs twenty times, because one lucky pass proves little. Now the number. In one ablation, twelve models produced one hundred twenty-one thousand, six hundred eighty valid trials. Seventy nine thousand, eight hundred fifty three failed the executable checks. And sixty seven point two four percent of those failures still ended cleanly, called a state-changing tool, and showed no final tool error. That's the authors' own measurement. But read it plainly. Two thirds of the failures looked like success from the outside. If your eval counts tool calls, or trusts the final message, you'd have banked a lot of those as wins. The authors put it this way. A trajectory is a claim. Database state is the evidence. Repetition is the trust test. Now the limits. Every public task is a synthetic reconstruction, modeled on real enterprise patterns, but the customers aren't real. The cost comparisons in the post are estimates from recorded token usage and list rates, not invoices. And whether these checks predict reliability against live systems, with messier state and permissions, isn't something this benchmark shows. To try it, the dataset is under CDLA Permissive two point oh, with a pinned thinkingbox-bench-v1.0 release tag. The blog's setup starts by cloning OpenEnv, running uv sync with the frozen flag on the ThinkingBox environment project, then checking out that release tag. Even if you skip the benchmark, steal the habit. Assert on the database, then run it twenty times.
3:31
ThinkingBox checks what an agent did once it's finished. Coucou watches while it works. Its mascot, Mochi, has twenty eight handcrafted sounds and gets dizzy if you click it three times fast. Coucou is an open-source desktop companion for coding agent sessions. On macOS it lives in the notch. On Windows and Linux it sits at the top of the screen. It lists Claude Code, Codex, Cursor, Gemini CLI, and Antigravity as supported. On macOS, it can show Claude Code permission requests and questions right there, show file changes and diffs, and jump you to that session's terminal window. The mechanism is simple. For Claude Code, a small hook script catches agent events and forwards them over a Unix socket to the app. For approvals, it waits for your answer and hands it back. If the app isn't running, the README says the hook exits immediately, so Claude Code is never blocked. The macOS app is native Swift with zero third-party dependencies. Windows and Linux use Tauri with Rust and TypeScript. The README also promises no telemetry and no account. Why the stars? One tracking page calls it fast-growing, but warns that star growth says nothing about whether it's safe to run. Fair. The privacy and non-blocking claims are the project's own, and the pages we read include no independent audit. Limits. Some integrations are macOS-only, and Linux is beta. The Windows installer was pulled for a while after Defender flagged it as unsigned, and the README suggested building from source. To try it on macOS, download the latest Coucou zip from GitHub Releases, unzip it, move the app to Applications, and launch it. If you want the heavier version, there's Offrun, a free Mac workspace that runs Claude Code, Codex, AGY, and Grok Build side by side. It needs Apple Silicon and macOS fourteen. Each agent gets its own Git worktree, and a second agent can review a diff, but it doesn't merge changes automatically. The company says there's no Offrun server in the prompt path. That's its own claim. Hacker News commenters noted the category is crowded, and one said soon we're going to need a meta-orchestrator for all these agent orchestrators. To try it, install it, connect an existing agent account in Settings, then pick a project.
6:09
Offrun gives every agent its own worktree so they stop colliding. Cloudflare wants someone to build a Git platform around that crowd, and it's offering twenty five thousand dollars. In credits. The contest is for a Git platform built for workflows with multiple agents. Submissions need a five to ten minute demo, open-source code under a permissive license, and instructions for trying it. The deadline is October fourteenth, twenty twenty-six. The top three teams get invited to present at Cloudflare Connect. The toolbox is Artifacts, which Cloudflare calls a versioned filesystem that speaks Git, built to scale to millions of repositories. That scale claim is the company's, not an independent capacity test. Here's the interface. A Worker with an Artifacts binding can create or fork repositories, inspect files and commits, and issue repo-scoped Git tokens. Artifacts also emits repository events that can trigger downstream workflows. Cloudflare's example forks a project for an agent task, has the agent read its instructions file, and uses push events to start an automated review. Connect a repository to Workers Builds, and a push to the production branch deploys the Worker. Other branches get Workers Previews. The hard problem is what happens when many agents change code at once. Concurrent changes, review, merge decisions. Cloudflare's authors say they aren't looking for GitHub as it exists today with agents added on top. Now the pushback. Hacker News commenters worried about depending on a single infrastructure provider, and questioned a prize paid in credits. One commenter put it this way: “They don't want to own the next GitHub. They want people to build the next GitHub on Artifacts (and pay Cloudflare for storage and compute).” Notice the calendar. Billing for Artifacts begins October fifteenth. The day after the deadline. To try it, you need a Workers Paid plan, since Artifacts is in open beta. Create a repository in the dashboard, or follow the example API flow to create a namespace. So the real question is whether you can build something compelling here without getting tightly tied to Cloudflare's storage, compute, and pricing.
8:37
Istio one point thirty one. Relying on someone else's infrastructure comes with dates, and Istio just put one on your calendar. It no longer publishes to its old Google-hosted registries and storage. Docker images stay on Docker Hub, and Helm charts move to a new location listed in the announcement. InfoQ reports an outage test of the old endpoints on October thirteenth, ahead of retirement in December. The headline feature is a GatewayClass that deploys agentgateway as an ambient-mode waypoint proxy. Canary waypoint shifting is alpha, and established connections don't move. Kubernetes one point thirty two through one point thirty six is supported. Istio picked Docker Hub over GHCR partly because a maintainer said GHCR has undocumented limits. Those are the only kind you discover by exceeding them. Zig zero point seventeen. On x86-64 Linux, rebuilds can now touch only what you changed. Tech AI Wire says to run zig build with the incremental and watch flags. The release notes expect it to work for everyone on that platform, but no broad benchmark backs that yet, so time your own project. The catch is that changed bitCast behavior can break array or vector code without a compile error. Audit those uses. Tech AI Wire also lists removed array multiplication syntax, a deprecated cImport, and a temporarily broken ZLS integration. If you live in your editor, wait. uv zero point twelve point twenty three. The frozen flag now works from a lockfile with no workspace manifest, for sync, export, tree, and workspace metadata. If your CI kept a manifest just to read the lockfile, check whether you can drop it. Python three point fifteen release candidate three is supported, as a test target, not a production upgrade. Docker Compose five point six. Compose can now describe jobs you trigger by hand, and that's all. Scheduled jobs aren't available, and full support waits on Docker Engine changes being merged. Keep your current scheduler.
10:55
Fast Boot, where today's list includes a ransomware crew, a clock, and a spaceship. Warlock ransomware. Symantec and Carbon Black say suspected China-linked Warlock used SharePoint flaws, then pushed a security-disabling tool to at least forty hosts in about two hours. The malicious account was named SPSEPRDSetup, likely meant to look like the most forgettable service account on the server. BoKS patches. Fortra fixed eight BoKS flaws, three critical. SecurityWeek says Fortra made no mention of any being exploited. One authentication-bypass flaw was rated nine point nine, with passwords reportedly generated from a pseudo-random sequence seeded by the Unix timestamp. Time is many things, but a secret is not one of them. Hole Punch. It's a browser game about slinging a spaceship around black holes you place yourself, and one commenter finished all twenty levels. Another commenter's verdict on the tutorial: “Never ignored a tutorial faster.” A likely setup-account disguise, a guessable clock, and a black hole. Only one of those was designed to be fun.
12:08
Today we covered ThinkingBox grading agents on what's actually in the database, Cloudflare's contest to build the next Git platform, and Coucou, the notch app that watches your coding agents. Your try-it for the weekend: run ThinkingBox's idea on your own agent, with a database assertion and twenty repeats. Or just download Coucou. Links to everything are in the show notes. Follow the show wherever you get your podcasts. Go build something. Back soon.