Friday’s AI news is strongest on deployment constraints and agent reliability, rather than frictionless desktop AI. Muse Spark Open leads: its multimodal weights offer another self-hosting option, but substantial memory requirements and commercial restrictions make hardware and license checks the first task. Around it, GPT-Load adds reversible redaction, ToolBottleneckBench separates harness failures from model failures, FEB-30 checks persistent memory independently of answers, and Agent Step-Up binds approvals to exact calls. Meta’s scraping terms and Anthropic’s evaluator-access agreement warrant close reading; a revised spec-driven development study, a live-clock game benchmark, and remote KV-cache measurements supply practical questions about maintenance, inference latency, and when loading cached state costs more than recomputing it.

Lead — Muse Spark Open releases weights, with substantial deployment requirements

  • Muse Spark Open releases multimodal agent weights — a new self-hosting option, not a model that fits an ordinary desktop GPU.
    • Model card: 816B total / 42B active parameters · 1M-token context · text/image/video/audio input, text output.
    • Gated BF16 and NVFP4 weights require at least 2TB and 700GB GPU memory respectively, according to the card.
    • The advertised desktop setup uses two M5 Ultra Mac Studios; listed frameworks include MLX, vLLM, SGLang, and llama.cpp.
    • Vendor scores, Spark versus GLM-5.3: MCP-Atlas 89.2 versus 84.2; Terminal-Bench 2.1 76.4 versus 83.9. No blanket winner.
    • Attribution required; model-as-a-service businesses above $20M aggregate annual revenue need a separate agreement, with specified exceptions.
    • Flag: open-weight, not permissively open-source; restrictions cover derivatives. Advertised framework support is not a locally verified deployment. (HN 826 · 415c)

Policy & provenance

  • Meta’s commercial terms claim broad website-scraping permission — businesses using its platforms face a consequential consent decision before October 30.

    • Primary terms authorize associated-site crawling, test credentials, and training on collected content.
    • No separate opt-out; dissenting businesses are told to stop commercial use.
    • Meta says crawling is unchanged and robots.txt remains available; legal experts question whether contractual permission overrides blocking.
    • Flag: enforceability and paywall reach remain unsettled—not blanket legal permission. (HN · Techmeme)

  • Anthropic embeds six METR evaluators — assess the access and publication contract, not just the “independent audit” label.

    • METR receives hardware, office space, and internal-tool access roughly comparable to Anthropic’s risk-assessment teams.
    • Anthropic cannot veto publication, but may require predefined redactions; METR can publicly dispute those redactions.
    • Customer data, privileged information, and model architectures are generally excluded; other partnerships have weaker access/publication rights.
    • Flag: voluntary access arrangement, not completed certification, public architecture disclosure, or statutory supervision. (Techmeme)

Agent frameworks & tooling

  • GPT-Load adds reversible outbound text redaction — a self-hosted gateway can hide matched identifiers while restoring client-side tool arguments.

    • MIT repository: Go/Docker Compose, default SQLite, credential scheduling and failover.
    • Redaction docs: restoration needs intact authenticated ciphertext; images/audio/files are excluded. Enabled body logs retain originals.
    • Version 2 cannot migrate 1.x data in place; deploy separately.
    • Flag: cloud inference remains external; optional external JEV guardrails fail open on incomplete reviews. (r/selfhosted)

  • ToolBottleneckBench separates tool pressure from harness limits — diagnose truncation and budget exhaustion before blaming model tool selection.

    • Controlled tasks vary catalog, visible menu, workflow, or record encoding across 21 model/harness configurations.
    • Six truncation-heavy configurations: a 16× completion cap shrinks the menu penalty from 43.7 to 2.7 points.
    • 91.5% of exactly graded failures hit harness limits; MIT code/data support offline analysis.
    • Flag: synthetic tasks, mostly single-realization core cells; not proof larger menus are harmless generally. (arXiv 2610.21098)

  • FEB-30 checks memory state separately from answers — answering correctly does not establish that persistent facts were stored or updated correctly.

    • Thirty generated fact-evolution trajectories cover six categories; inspect the store after each ingestion.
    • Main system, 11 runs: 16.8-point mean absolute state/QA divergence; operation classification accuracy is 20.1%.
    • Separately score extraction, updates, retrieval, and final answers—not just recall.
    • Flag: synthetic data, judge-based scoring; not an OpenViking benchmark. Announced repository returns 404. (arXiv 2610.22209)

  • Agent Step-Up binds approval to the executed call — trusted rendering and immutable arguments matter more than moving the approval button elsewhere.

    • Reference gateway renders canonical arguments, obtains a WebAuthn digest signature, and executes the stored call once.
    • Fifteen model approvers: 30%→98% attack catch rate, but 16% rejection of harmless near misses.
    • Second-device confirmation adds no measurable benefit over trusted on-host confirmation here.
    • Flag: secure-enrollment/honest-rendering assumptions; modeled flooding succeeds 45–60%. No human-user efficacy trial. (arXiv 2610.21063)

  • Spec-driven development study adds practitioner evidence — October 15’s expanded revision examines planning costs and spec decay, not merely artifact counts.

    • Interviews: 21 practitioners, eight tool makers; repository analysis covers 266 active/popular projects.
    • Participants report more reliable agents alongside planning/review costs and spec-maintenance problems.
    • Distinguish living requirements from archived changes; assign ongoing spec/code checks.
    • Flag: observational/self-selected, not a productivity trial. Replication link returns 404; corpus predates this revision. (arXiv 2608.25202v4)

Models & research

  • RealtimeBench keeps games running during inference — stronger paused-game reasoning can lose to faster decisions when actions arrive late.

    • Across 180 tasks and six game types, live-clock averages are GPT-6.1-sol 1.51 versus Jev 13.51.
    • TORSI’s slow teacher improves instructions between attempts; the fast actor makes no teacher calls during gameplay.
    • Two rounds raise Jev’s progress score to 24.19/100, not a 24.19% task-completion rate.
    • Flag: structured text states omit visual-perception latency; resettable teacher practice and same-environment transfer limit generalization. (arXiv 2610.20665)

  • Remote KV hits can cost more than recomputing — measure cache loading against GPU prefill, not against network latency alone.

    • GLM-5.3 on 8×B300: 16k-token remote hit 0.88s versus 0.31s recompute.
    • Rank-sharded Valkey, asynchronous loading, and client fixes cut hit-heavy replay p99 from 83.32s to 0.67s.
    • Replay serves 98.5% of prompt tokens remotely; this primed workload differs from the production regression.
    • Flag: one run per condition, specialized hardware; LMCache changes submitted upstream, merge status unverified. (arXiv 2610.21500)
All gathered items - what was cut and why (6)
  • Neural Networks Are Already Clean - DEDUP: October 15’s standalone already covers the essay and discussion. (HN · Techmeme · lobste.rs)
  • Why are we even doing all this? - DEDUP: Last night’s standalone already covers the guest essay. (lobste.rs)
  • MAI-Base-2 training report - LOW_UTILITY: Post-training continues; no public downloadable checkpoint verified. The 4–12× claim concerns fitted pretraining efficiency, not serving speed. (Techmeme · Microsoft AI)
  • Perplexity SPACE announcement - UNVERIFIABLE: No usable repository/docs located; 118 unsuccessful vendor breakout attempts do not establish containment. (Techmeme · Semafor)
  • 100B phone ambition - LOW_UTILITY: A 2028 aspiration, not an available device or model result. (r/LocalLLaMA)
  • Radeon/Qwen throughput thread - STALE: September 15 post without a checked new result. (r/LocalLLM)