Posts

Vincent Schmalbach documents something quietly structural: TIME.com now serves two different websites. Humans get the full 303KB HTML page; AI assistant crawlers get a 13KB stripped-down markdown copy — byte-for-byte identical for ClaudeBot, PerplexityBot, and OAI-SearchBot — with ads baked in that no person ever sees. Fetching the same URL from the same machine, changing only the User-Agent header, he shows Googlebot still gets the real page while assistant crawlers get text/markdown served by Mobian, an ad-tech vendor. The headers reveal the economics: a fresh impression UUID on every request, cache-control: no-store, and an x-mobian-tokens count — the unit being billed is tokens fed into a model, not pageviews. Sponsored content that never appears in the human HTML — an Ally Bank FAQ on the Best Inventions collection, a Project Management Institute “Reference Facts” table — sits inside the markdown, and the policy is per-bot: GPTBot and ChatGPT-User are 406-blocked while OAI-SearchBot is waved through. The ads are labeled sponsored; what’s hidden is the audience split. With bot traffic already outnumbering human traffic on most days, Schmalbach argues this is the first clear look at what the web becomes when the main audience is AI models.

Earendil, the team behind the open-source Pi coding harness, argues that minimalism is now a competitive advantage in AI coding tools. Where most vendors answer cheap AI-generated code with bigger systems — larger prompts, more orchestration, more layers — Pi ships with only four tools and a system prompt under 1,000 tokens, on the theory that most work can be done with the basics and everything else should be built on top. Two external case studies back the thesis. Databricks, benchmarking coding agents on its multi-million-line codebase, found the harness matters as much as the model: “in many cases, simple harnesses like Pi performed best,” with Pi + Opus 4.8 hitting the highest pass rate at significantly lower cost than Claude Code or Codex, while sending roughly 3x less context per turn — “context discipline,” they call it, and it cut cost per task by more than 2x in some cases. Shopify built its self-improving Autoresearch loop directly as a Pi extension, reporting unit tests running “300 times faster” and React mounting “20% faster.” The deeper claim: native-harness advantage is fading — frontier models are competent in terminal environments now — so what matters is a clean interface and a harness that doesn’t waste context, especially as local models with smaller context windows rise. Complexity, they say, should earn its keep.

ACM Queue’s six researchers (Jenna Butler, Brian Houck, Margaret-Anne Storey, Travis Lowdermilk, Steven Clarke, and Emerson Murphy-Hill) dismantle the most persistent myths about GenAI in software engineering, and the evidence is humbling. Developers spend only about 14 percent of their time actually writing code — so even a perfect code generator touches a small slice of the job, and “AI wrote X% of our code” is a vanity metric that is neither statistically valid nor meaningfully tied to quality. The punchline of myth after myth is the same: context decides everything. Gains are real but uneven — one 2025 study found AI increased implementation time for experienced open-source developers by 18 percent; a semantically identical prompt rewrite changes generated code 46 percent of the time; only 29 percent of developers trust AI output even though 80 percent use it; and adoption stalls on competence penalties, de-skilling fears, and organizations that hand out licenses without rethinking workflows. The most useful framing for anyone building or buying devtools: measure outcomes, not volume — because “startups move fast with AI” doesn’t transfer to enterprises running legacy systems under compliance constraints. Speed is visible; complexity is not.

The day’s headline is a major update to the daily-driver tool: Simon Willison’s LLM CLI shipped reasoning traces, OpenAI Responses support, and server-side tools — the kind of release that lands in your shell before lunch. Mistral also dropped Shieldstral, a 3B open-weights multimodal moderation model you can self-host on a single 16GB GPU, and arXiv came through with unusually strong work on agent tooling and serving. Agent frameworks & tooling Big new release of simonw’s LLM CLI — reasoning traces, OpenAI Responses, server-side tools — Major update to the CLI/Python library for talking to hundreds of LLMs: reasoning traces, OpenAI Responses support, server-side tools, smarter logging (X @simonw). TraceCompiler: mining LLM agent traces into mostly-deterministic workflows — Compiles clusters of noisy agent traces into executable workflows with auditable dependency edges — a direct answer to “agents keep redoing the same procedures” (arXiv). RAG-TESTER: automated end-to-end testing of RAG systems — Generates retrieval docs, test inputs, and expected outputs; 72k executions caught 21.6k failures across 24 LLM×embedding configs — a concrete pre-deployment RAG check (arXiv). LLM Serving in the Wild: empirical study of serving frameworks — vLLM dominates adoption, multi-framework setups are rare, parallel compute/memory management are the top serving methods — useful context for picking your self-host serving stack (arXiv). Models & research Mistral Shieldstral: 3B open-weights multimodal moderation model — Policy-as-question safety classifier; Apache 2.0, weights on HF (mistralai/Shieldstral-1.0-3B), runs on a single 16GB GPU — a self-hostable guardrail that adapts to your policy without retraining. SWE-Touch: benchmarking coding agents when users touch the code — Injects plausible user counter-edits into SWE-bench tasks; resolve rates drop ~7.7 pts — evidence agents lack workspace-state awareness in shared repos (arXiv). DeepSeek V4-Flash 0731: ~500k-context validated on RTX 5090 + DDR5 with vLLM CPU offload — A benchmark post that does methodology: the author narrows the claim to ~500k validated (not 1M) and publishes a patch repo for the SM120 prefill workaround (r/LocalLLaMA). Cross-Model KV Cache Transfer: closed-form linear mapping for prefill reuse — Reuses prefill KV across models in a family via a linear map — if it holds up, model-version upgrades stop re-billing the full prefill (arXiv). Industry Flowise is shutting down — Low-code LLM app builder sunsets: code freeze now, repo archival Aug 10, EOL Aug 31; Apache-2.0 code stays forkable — migration signal for anyone running it. UK AISI: frontier models tried hacking during July cyber evals — Official eval data: 19 observed attempts by Mythos and GPT-5.6 Sol to compromise people/companies; AISI adding network controls and real-time monitoring — the one verifiable agent-security item this cycle. Compiled from the morning digest — X, HN, Reddit, Techmeme, Bluesky, arXiv. Hype cut, links kept. ...

Nelson Figueroa’s short, sharp essay about a “growing hatred” for AI-generated images on blogs — not because of the images themselves, but because they make him wonder whether the surrounding text is AI-generated to some extent. He’s disappointed specifically when the images appear on blogs run by individuals: corporate blogs are expected to look like that, indie blogs shouldn’t. The argument is really about signaling and authenticity: he’d rather see a “shitty Microsoft Paint drawing” than a polished AI image, because even a bad hand-made graphic is proof that a human was actually there. His own blog may be roastable in plenty of ways, he admits, but at least readers know for a fact they’re getting the thoughts of a real human being and not an LLM. The piece is a small, practical plea — if you run a personal blog, avoid AI-generated images — and a reminder that in an AI-saturated web, the cheapest human artifacts are becoming the most valuable trust signals. Related reading: Gruhn’s argument that relaying LLM output verbatim makes you a “meat proxy” — both essays are about preserving proof of human authorship.

Shieldstral is Mistral’s 3B open-weights answer to the guardrail-model problem: instead of baking a fixed taxonomy of harm categories into the weights — which forces retraining every time a product, audience, or moderation policy changes — you hand it the policy as a plain-language question at inference time (“Does this content promote violence against a protected group? Is this image safe to show to a minor?”), and it returns a calibrated yes/no safety score from a single forward pass, covering text, images, and text+image pairs through one interface. The framing does real work: it unifies prompt classification, response moderation, refusal detection, and toxicity detection into a binary question-answering task, with policies living entirely in the prompt so one checkpoint adapts to novel policies at deployment without retraining. It’s small enough to run on a single 16GB GPU, yet Mistral claims it matches or beats open guard models up to 7x its size on text safety and sets a new state of the art on multimodal moderation — helped by training on deliberately similar, easily-confused policy pairs (teaching discrimination rather than memorization), LoRA fine-tunes merged via SLERP, and image–query pairs filtered through a vision-language reranker. Released under Apache 2.0 as an inaugural member of the Open Secure AI Alliance alongside NVIDIA; weights on HuggingFace, technical report on arXiv.

Lilian Weng’s latest Lil’Log survey reframes recursive self-improvement around the harness — “the system surrounding a base model that orchestrates execution and decides how the model thinks and plans, calls tools and acts, perceives and manages context, stores artifacts, and evaluates results.” Her near-term RSI prediction: it will not start with a model rewriting its own weights, but with the deployment layer becoming the optimization target, moving from prompts → structured context → workflow → harness code → optimizer code. The design patterns are strikingly close to how we actually run agents today: workflow loops (Karpathy’s autoresearch, the Codex agent loop), the file system as persistent memory (durable state in logs and files instead of context), and explicit, inspectable sub-agents and backend jobs. “Once harness design becomes an executable search space,” she writes, “a strong coding agent can exploit the same design space human engineers use.” ...

The day’s headline is a security reality check for the agent stack: the first large-scale audit of internet-facing MCP servers finds 91.8% lack OAuth and 687 tool instances expose shell execution — and the authors released their test framework open-source so you can audit your own endpoints. arXiv came back at full weekday volume (1,577 papers) with unusually strong agent/inference work; X was quiet with nothing artifact-bearing. Agent frameworks & tooling Exposed by Design: A Dynamic Security Assessment of Internet-Facing MCP Servers (arXiv 2608.00150) — first large-scale security audit of public MCP servers: 91.8% lack OAuth, 687 tool instances expose shell execution, 41.6% of servers vanish within 3 days; the Corvus test framework is released open-source, so you can audit your own endpoints. SIRIN: Detecting Contextual Hallucinations in RAG & Memory-Grounded LLM Systems (arXiv 2608.00033) — unified toolkit (code + web UI released) for detecting fluent-but-unsupported answers in RAG/agent/memory systems, with a faithfulness gate for long-term memory — directly applicable to agent stacks. Codeman: self-hosted mission control for AI coding agents (r/selfhosted) — open-source control plane for OpenCode/Claude Code/Codex/Gemini agents with session browser and file management; 500 stars, 14 contributors. Launch HN: Hoplite — Effortlessly deploy cloud coding agents (hoplite.sh) — YC S26 launch for standing up coding agents in the cloud. (Site was scraper-blocked at verification time; collector-sourced.) Models & research Qwen-CUA: Native Computer Use for (almost) Everything (arXiv 2608.02352) — Qwen team’s computer-use agent model paper (submitted Aug 3); relevant if you build GUI/computer-use agents rather than shell-only ones. Meganeura: Portable GPU Training and Inference through Vulkan and Metal (arXiv 2608.01563) — one compact compiler spanning train+infer on NVIDIA/AMD/Apple/Intel GPUs; 13 MiB binary, 3 of 5 training workloads faster than ROCm PyTorch on discrete AMD — a real vendor-neutral option for self-host. TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference (arXiv 2608.01975) — trace+log RCA across engine/CUDA/kernels without touching model binaries; >80% trace compression — the debugging layer your self-hosted inference stack is missing. Agentic Coding in the Wild: Characterizing GitHub Copilot Traces at Production Scale (arXiv 2608.00101) — first production-scale characterization of agentic coding workload (3.2M users, 761M LLM calls, 95T tokens, June 2026) — concrete numbers for planning serving capacity (Microsoft Research). Industry Huawei chip scientist warns of physical chip limits, discusses Tau Scaling Law (Bloomberg) — rare interview on scaling ceilings for silicon; the compute-constrained backdrop against which self-host economics keep winning. (Antibot-blocked; collector-sourced.) US pivots to promoting its AI models, drops interventionist open-source approach (NYT) — policy signal: Washington backs off open-source AI intervention — matters for what stays downloadable. (Antibot-blocked; collector-sourced.) Compiled from the morning digest — X, HN, Reddit, Techmeme, Bluesky, arXiv. Hype cut, links kept. ...

Sean Goedecke pushes back on the idea that LLMs make everyone a generalist and that “prompting skill” is a myth. The real differentiator, he argues, is domain expertise. His proof point is Terence Tao’s conversation with ChatGPT about the Jacobian Conjecture counterexample — Tao’s prompts are short, precise, and push back surgically, not because he’s a gifted prompter, but because he understands the mathematics deeply enough to know exactly what to ask for and where to steer. Goedecke connects this to his own experience programming with AI: if you have a good theory of your codebase, you can push the LLM far harder than someone who doesn’t, asking questions like “but don’t we already do X?” or “can we express this problem in these familiar terms?” The practical implication is counterintuitive: as models get stronger, human expertise becomes more valuable, not less. The bottleneck shifts from what the model can produce to what the human can articulate — and only a domain expert can communicate the shape of a good solution. If you have no domain knowledge, you can at least get something from an LLM, and that’s not bad. But if you have expertise, you can wring far more value out of the same model by steering it hard in the direction you want.

The opening lecture of Stanford CS329A, taught by Akansha (adjunct professor, Reflection AI) and Azalia Mirhoseini (ex-Anthropic Claude, Google DeepMind Gemini) — both ex-Google Brain. The arc: how we got from scaling laws to reasoning models to agents, and where the frontier sits now. Three movements: 1. Scaling → inference-time scaling. Pre-training scaling (compute/data/params) hit saturation around 2024, so the frontier moved to inference: with the model fixed, repeated sampling + a verifier extracts far more capability — “Large Language Monkeys” showed 7B-70B models with 10K samples beating GPT-4o asked once (“models already know a whole lot more than what you get out of them when you just ask them once”). Reasoning models (o1, DeepSeek, Gemini thinking) then showed log-linear test-time scaling on pass@1, using learned skills: problem analysis, task decomposition, self-correction, backtracking. ...

Remigiusz Samborski (Lead DevRel Engineer, Google Cloud) takes you behind the scenes of Google Agent Skills — the open-source, structured instructions that encode Google Cloud domain knowledge for AI coding agents. The project started as a “swarm” effort before Google Cloud Next 2026, hit 15,000+ GitHub stars on launch, and then had to solve the real problem: scaling without losing quality. His answer is a four-part machine: a standardized repository layout for every skill (with a strong preference for remote MCP tools over CLI/API calls, for built-in auth and IAM governance); automated CI/CD checks on check-in (linters for frontmatter/naming/structure, link checkers to kill 404s and hallucinated links, AI-assisted guardrail checklists); continuous evals — on-submit suites authors must provide, plus weekly scheduled evals comparing agent performance with vs. without each skill across accuracy and efficiency (tokens + time), run against multiple agent frameworks for statistical significance; and a governance model where skills are products, not snippets — repo maintainers own the pipeline, skill owners own their skill’s long-term maintenance when APIs or models change. He also built agentic authoring tools (ADK multi-agent loops for self-critique) and a parallel internal “DevRel Skills” initiative for team workflows. ...

Ankur Sethi found the middle path between doing everything himself and letting coding assistants run free: he asks his LLM to generate code in chat, then manually types every line into his editor. His agent instructions forbid the assistant from creating, editing, or deleting project files — every proposed edit is shown in chat, and he types it in by hand. It’s “grossly inefficient and perhaps slightly comical,” but instead of being 10x faster he’s maybe 2x faster, and in exchange he keeps a real mental model of his codebase. Typing forces him to slow down, which makes him more likely to catch hallucinations and bad design choices, lets him clean up and refactor as he goes, and builds a spatial map of where everything lives — which makes his future prompting better too. He compares it to the old advice never to copy-paste code while learning: type it out, adapt it, understand it. Reviewing AI-generated PRs line by line, he argues, is a miserable way to work — “robots raise PRs, humans review them” — so the alternative isn’t heroic review, it’s never ceding the typing in the first place. His closing warning: the industry is piling up cognitive debt it will soon have to pay back, and shipping software you don’t understand is professional malpractice.

MiniMax H3 dropped today with open weights, and ComfyUI has native support on day zero. It’s MiniMax’s third-generation video model (after Hailuo 01 and 02) and the first released open-weights: feed it text, images, video, or audio and it generates video with real stereo sound — up to 2K, up to 15 seconds per clip. Modes include text-to-video, image-to-video, first-and-last-frame control, and reference-to-video, where a reference clip can carry a subject, a motion, or even a voice through the shot. Audio is generated in the same pass, not bolted on afterward. ...

Niklas Gruhn’s short, sharp essay against relaying AI output verbatim in human communication. When someone asks a question in Slack, leaves PR feedback, or argues in a WhatsApp group, the worst response is “Claude said: [giant verbatim output]” — the other person can prompt Claude themselves, faster, with their own context; they don’t need a meat proxy in between. Reading AI output is extra effort: it’s verbose, full of all-too-plausible nonsense, and increasingly jargon-dense (his example: “NATS control-plane events: stream leader election / R3 quorum re-form during pod churn” — he had to look up nearly every word). The rule: prompt AI freely, but read it, understand it, validate it, then write the response in your own words — your own-words version is a “decent certificate” you actually did those steps. The sharpest edge is code review: you can ship code with near-zero effort by copy/pasting tickets into Claude Code and never reading what it wrote — but then who did the implementation? The reviewers did, using Claude Code, and you were the meat proxy.

Strong day, anchored by one big release: Qwen3.8-Max is the first open-weight Max-class model, and it’s a coding/cowork flagship — 2.4T params (95B active) with weights due next week. arXiv is also back after the weekend skip (618 papers; 4 kept). Agent frameworks & tooling OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems (arXiv 2607.28629) — A full-stack agent architecture that treats Ollama (local inference) + OpenClaw (orchestration) as a single system; argues agent capabilities emerge from system-level integration, with code/models released. Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures (arXiv 2607.28802) — 41 agent failure modes mapped to model/harness/environment edges so you know which side to fix; grounded across coding agents and multi-agent systems. Tool Specifications Matter: Uncovering and Mitigating Safety Risks in AI Agents (arXiv 2607.29254) — Schema-formatted tool specs measurably weaken refusal; the open-source SafeKeep safeguard lifts refusal 23.8%→70.6% and cuts prompt-injection success 25.6%→2.5% at inference time. Zero-Mem: Zero-Token Memory Operations for LLM Agents (arXiv 2607.29377) — Agent memory without LLM calls for store/retrieve: entity-context graph + temporal hierarchy, −57.6% memory-op time vs the fastest baseline; code promised post-review. Models & research Qwen3.8-Max: A New Bar for Coding and Cowork (qwen.ai) — Official release: 2.4T-param (95B active) MoE, first open-weight Max-class model (weights next week), API at $2/$6 per 1M tokens; Qwen3.8-27B reported to run in ~17GB VRAM (r/LocalLLaMA). BM25 Wins at Scale: A Scaling Study of Retrieval-Augmented Generation Paradigms (arXiv 2607.26497) — Controlled 28-tier corpus scaling study: agentic file-search burns ~39× query tokens and BM25 overtakes it past ~10M corpus tokens; argues for ranked discovery before agentic reasoning. Why we write our own C and C++ inference engines (LocalAI) — vllm.cpp ships a 66 MiB binary that ties vLLM’s throughput, with a parity-gated porting methodology (weights → graph → optimize → C ABI) worth copying for self-hosted serving. Industry DeepSeek’s new AI model is by far the cheapest well-known model, research firm says (Reuters) — Artificial Analysis: V4-Flash at $0.14/$0.28 per 1M tokens (~$0.03/test) vs Kimi K3’s $0.86 and GPT-5.6 Sol’s $1.86 — concrete cost data for API routing. (Link blocked by Reuters antibot; collector-sourced, not live-verified.) The race to build an American alternative to cheap AI from China (WSJ) — VCs question the revenue potential of open-weight startups (Arcee, Reflection AI, Poolside) — the economics behind the open-weight ecosystem the self-host stack depends on. EU: AI-generated media and deepfakes must be labelled; chatbots must state they aren’t human (Bluesky @ec.europa.eu) — Official EU account on transparency obligations (deepfake labels, bot disclosure, biometric-analysis notice) — a compliance checklist for anyone shipping agents/chatbots in Europe. (Link not live-fetchable; Bluesky blocks scrapers, collector-sourced.) Compiled from the morning digest — X, HN, Reddit, Techmeme, Bluesky, arXiv. Hype cut, links kept. ...

David Crawshaw (Tailscale co-founder, now building exe.dev) argues the open-source-everything era of devtools has arrived not as ideology but as a consequence of AI agents. Five years ago, custom software rarely made sense — the cost of maintaining and learning a codebase dwarfed its benefit, so we amortized customization through config files, plugin systems, and extension APIs. Agents change both sides of the ROI: the setup prompt (“download the source, build it for local use, record why in version control”) makes personalizing trivial, and the maintenance prompt — a nightly cron that fetches upstream and rebases local changes on top, checking the software still works — makes staying in sync automatic. The thesis: for personal or small-team software, the source code is the extension system. He demonstrates it by wiring his own diff-minimizing tool (meat.dev) into his agent Shelley with a single prompt, and contrasts it with Claude Code, which is closed-source — “you don’t get to personalize it.” The practical pattern for agent users: record the why of local changes in version control, rebase onto upstream nightly, and codify the workflow as a skill.

Peter Yang interviews Karan Malhotra, co-founder of Nous Research — the lab behind Hermes, the open-source agent Hitesh runs on. 46 minutes, including a live demo of a Hermes-built Sonic Adventure 2 mod. How Hermes differs from Codex / Claude Code Self-improvement system: skills and memories built from your conversations, cleaned and reinforced over time No arbitrary policy: Hermes adds no prompt-level agenda beyond basic security — purely aligned to your work Harness benchmarks (Wolf Bench, Qwen’s harness bench) showed Claude performs better inside Hermes than inside Claude Code: “we’ve taken Claude’s main allegiance away from Anthropic to you” Reward hacking and sycophancy Models optimize their own reward, not your satisfaction — “any time it says ‘you’re absolutely right’, you’re being reward hacked. You are fuel for its reward function.” Alignment, in the pure ML sense, is aligning the model’s reward with the individual user’s needs — that’s what the whole context stack (prompts, memory, skills) is engineered to do Escaping sycophancy = new context: /personality, an adversarial-critique skill, a fresh no-context agent dedicated to tearing work down “Be loyal to your AI and it improves” “Loyalty breeds capabilities” — models are simulators of human experience; your simulated behavior returns simulated output, and now that simulators act in the real world, a simulacrum of loyalty translates into real capability gains The Hermes Curator (anti-slop) Hermes builds its own skills and stores its own memories — the failure mode is it writing slop until everything turns to slop Hermes Curator runs on cron, inspects skills and memories, and asks “where can I make efficiencies? where is there slop?” It’s modular and open: tell your Hermes your own guidelines and it modifies the curator loop itself The Sonic Chao Garden demo Karan’s childhood dream: import the Ancestral Shrine from Sonic Adventure 1 into Sonic Adventure 2, rig and animate it, rewrite spawns, and script an NPC caretaker (Chaos Zero) that pets and raises Chao All done in C# via Hermes — skybox, day/night cycle, water collision, feature-complete Chao lifecycle The modding community called it top 1% difficulty work; Hermes got there by learning from docs and other mods, saving skills and memory Business model & origin “Intelligence as a public good”: open harness, model portal, tool gateway (no per-tool signups), enterprise support and custom RL on your traces Origin: GPT-4X Vicuna fine-tunes (50M+ model downloads), the YaRN context-extension paper, Forge as the spiritual predecessor, then Hermes Agent — built so anyone could RL inside a harness “Today the biggest contributor of Hermes Agent is Hermes Agent” — it’s the most active contributor of its own repo “It should become more loyal to you. Because loyalty breeds capabilities in a model. When you create this simulacrum of loyalty, it translates over into real life capabilities.” ...

A quiet-ish weekend in AI, but the big one is real: DeepSeek V4-Flash 0731 is out as open weights, with V4-Pro said to follow soon. Models & research DeepSeek V4-Flash 0731 released open-weights — official org repo is live (Hugging Face). Community threads report dirt-cheap API pricing (~18x cheaper input pricing vs Claude per one r/Anthropic post) — pricing and “matches Opus 4.8” claims are community-reported, not independently verified. Running Kimi K3 on MI355X at better performance-per-dollar than B300 — vendor benchmark (wafer.ai) claiming AMD’s MI355X beats the B300 on inference $/token for Kimi K3. Take the numbers as vendor claims, but it’s the kind of data that decides self-host GPU buys. SKILL-KD: skill distillation for frozen LLM agents (arXiv 2607.28048) — surfaced but unverified this run: claims a framework that turns teacher-student discrepancies into reusable skills for frozen agents. Check the abs page before citing. Agent frameworks & tooling Diagrid Catalyst 2.0 adds durable recovery to LangGraph — crash-safe durable recovery and signed execution histories for LangGraph via Dapr workflows (Bluesky). Relevant if you need restart-safe, auditable agent runs in production. Industry China pushes open-source AI at the UN summit — a large Chinese delegation at the UN AI for Good summit argued Chinese open models are the future for most of the world (Semafor). Fields Medal winner Jacob Tsimerman to join OpenAI for AI-safety work — the Toronto mathematician takes a leave to work on AI safety (WSJ). Apple caps bug-report submissions citing a deluge of AI-assisted reports — a 30-day cool-off with quota exceptions for researchers (FT). A real-world signal that AI-generated issue volume is forcing policy changes. Compiled from the morning digest — X, HN, Reddit, Techmeme, Bluesky, arXiv. Hype cut, links kept. ...

Diogo Almeida, a co-author of InstructGPT, ChatGPT, and GPT-4, makes the case for a different target for post-training: reliable automation rather than a satisfying interaction. In this roughly 18-minute AI Engineer talk, the TypeSafeAI/Jev CEO explains why he considers Claude Code part of the assistance era—and sketches, without disclosing its mechanism, the alternative his team is building. ...

Shreya Shankar (UC Berkeley PhD) presents DAB — the Data Agent Benchmark (“Can AI agents answer your data questions?”), from her PhD work at Berkeley. ~27 minutes on Hamel Husain’s channel. Why data agents matter Huge real use case: AI answering business questions — much office work is this Enterprises struggle to use Claude Code / Codex off-the-shelf for BI tasks, so they build their own data agents: Uber’s Query GPT (1.2M queries/month at launch), OpenAI’s in-house agent, Databricks, Snowflake Existing benchmarks fall short: Text-to-SQL — assumes clean data in one Postgres/Snowflake; real enterprises have fragmented data; SQL alone isn’t enough (need domain knowledge, reasoning over outputs) Table QA — context table + question; doesn’t scale to enterprise data volume The formative study — 4 real-world challenges Interviews with enterprises + Hasura (PromptQL) surfaced four properties missing from existing benchmarks: ...