Wednesday’s top story: Stealing Reasoning Traces from Proprietary LLM APIs — researchers demonstrate that the encrypted chain-of-thought blocks returned by OpenAI, Anthropic, and Google APIs can be decoded by feeding them to weaker models from the same provider, enabling reasoning distillation, private data extraction, and hidden prompt injection. It led HN (#1, 627pts), r/LocalLLM (435pts), and Wired. Also today: Nvidia dropped Nemotron 3.5 Lightning plus a model-routing library, a strong arXiv day on agent skill construction and workflow reliability, the first official ChatGPT desktop app for Linux, and Mojo 1.0.

Models & research

  • Stealing Reasoning Traces from Proprietary LLM APIs — Researchers (Panfilov, Shumailov, Andriushchenko et al.) demonstrate that encrypted chain-of-thought reasoning blocks returned by OpenAI, Anthropic, and Google APIs can be decoded by feeding them to weaker models from the same provider. By scraping 315K reasoning blocks from public repos, they recovered 367 PII artifacts and 182 credentials. Enables four attack vectors: distilling proprietary reasoning, private data extraction, revealing hazardous content hidden inside reasoning (even when the model’s visible output safely rejects), and invisible prompt injection embedded inside encrypted blocks. arXiv paper at 2608.09867 (CC-BY 4.0). Responsible disclosure completed; cryptographic mitigations proposed. (HN 627pts #1 · r/LocalLLM 435pts · Wired · arXiv)

  • Nvidia Nemotron 3.5 Lightning (30B MoE) + NeMo Switchyard — New open-weight 30B MoE model built for high-volume agentic tasks. Claims 4× faster output and 30% faster agent task completion vs. class peers. NeMo Switchyard is an open-source model routing library that intelligently routes prompts to the most cost-effective model per step. Partners include Nous Research (integrated into Hermes), LangChain, Cognition, Ramp. Available on Hugging Face, OpenRouter, build.nvidia.com. (HN 234pts · Nvidia blog)

  • Quantization Degradation in LLMs: A Signal-Noise Perspective — Systematic study of how quantization degrades model quality across bit-widths, methods, and model scales. Frames degradation as SNR: quantization errors introduced per-module can be attenuated, preserved, or amplified across layers. Larger models benefit from weaker error amplification. Practical guidance for choosing quantization precision in self-hosted setups. (arXiv · submitted Aug 8)

Agent frameworks & tooling

  • SkillSmith: Enhancing Locally Deployed Agents via Automatic Skill Construction and Evolution — Cloud-Local agent collaboration framework that auto-constructs skills from Cloud Agent task exploration and evolves them using Local Agent execution feedback. With Qwen3.6-27B (SLM) as backbone, SkillSmith achieves task effectiveness comparable to Cloud Agents using frontier LLMs on AppWorld and WorkBench. Reduces average actions per task from 36.1 to 9.9. Good fit for anyone building local agent pipelines with smaller models. (arXiv · submitted Aug 8)

  • CAP: A Scalable Benchmark for Evaluating Cross-Site Browser Agents with Complex Actions and Perception — 420 tasks across 108 real-world websites and 24 domains. Builds workflows by abstracting websites into structured “site cards” capturing complex UI operations and perceptual requirements, then recomposes into cross-site workflows. Current agents show low success rates; perception-heavy interactions remain a major bottleneck. Accepted to COLM 2026. (arXiv · COLM 2026)

  • FlowScout: From Execution Feedback to Reliable Tool-Using Agent Workflows — Execution-guided framework that mines common tool coordination skeletons from historical records, then refines workflow topology via Monte Carlo tree search guided by execution feedback (stdout, error codes, outputs). Improves tool invocation correctness by 92.69% and execution quality by 17.66% vs. PM4Py, ReAct, and AFlow. (arXiv cs.LG · submitted Aug 10)

  • LLMVisor: Real-Time Latency Attribution Model for Multi-Tenant LLM Serving — Real-time latency attribution for multi-tenant LLM serving systems. Identifies which tenants, models, or request patterns are causing latency spikes in shared inference infrastructure. Practical for anyone operating shared GPU serving. (arXiv · submitted Aug 9)

Industry

  • OpenAI ChatGPT Desktop App for Linux (Preview) — First official Linux desktop client for ChatGPT, supporting ChatGPT Work and Codex. Computer Use is limited to in-app browser only. Preview release — signals OpenAI’s commitment to the Linux desktop for agentic workflows. (Techmeme)

  • Mojo 1.0 — Modular’s AI-first language reaches stable 1.0 with Python ecosystem compatibility, full GPU support, lambda closures, and improved LSP. Supports GLM-5.2 and Nemotron-H hybrid Mamba-2 models in MAX. Mojo compiler + toolchain commitment to open-source in 2026 stands. (HN 391pts · Lobsters)

  • CoreWeave Q2: Revenue +112% YoY to $2.58B, $104B Backlog — CoreWeave reports $104B revenue backlog with 1.5 GW of contracted power. Super Micro Q4 revenue +93% YoY to $11.1B. Both signal unabated AI infrastructure demand. (Techmeme/CNBC · Bloomberg)

All gathered items - what was cut and why (12)