PROVISO checks what authorizes an agent's next action

A small learned controller compares proposed actions with user authority and an alternative, with important differences between classification and reversible execution tests.

Published:  · Added:  · 2 min

VerifierBench: AI-written checkers reject valid solutions

VerifierBench tests whether agents can write executable task checkers. An agent is a model running a multi-step task with tools. A checker must recognize different valid solutions, including ones its author never chose. The authors report a …

Published:  · Added:  · 1 min

SPEM reuses successful skill sequences to shorten agent tasks

Store the order and prerequisites of successful work, then retrieve compact instructions instead of loading every skill.

Published:  · Added:  · 2 min

Automatic prompt tuning helps local math tests but can hurt question answering

A two-model GEPA and SkillOpt study separates answer correctness, formatting, server failures, waiting time and token use.

Published:  · Added:  · 2 min

Combining two instruction files can make a model ignore one

SkillClash isolates failures after both skills are loaded. A correct combined example repairs much of the lost rule compliance.

Published:  · Added:  · 2 min

Scale and Reflection repair coding tests and grade patches in clean containers

SWE-Bench Pro V2 separates bad instructions from evaluation exploits. Its strongest systems already approach the repaired test set's ceiling.

Published:  · Added:  · 2 min

Arcade measures when searching for tools cuts the bill

Arcade compares finding tools on demand with listing 100 tools in every request. Savings depend on search frequency, prompt caching and how the client handles large results.

Published:  · Added:  · 2 min

Munin lets research groups question papers on their own servers

Munin combines local paper search, full-text reading and citation checks with a rerunnable evaluation suite. Its strongest result permits web access and depends on a private reference corpus.

Published:  · Added:  · 2 min

SchemaShield-Lite repairs broken requests after tool descriptions change

Validation and a constrained retry recover tool-request errors in controlled Qwen tests. The strongest results depend on resolving a usable tool name, with weaker gains outside that model family.

Published:  · Added:  · 2 min

TokenEconomizer learns where coding assistants waste money

An external controller learns short repository instructions, hides unused tools and redirects stalled work. Reported savings include its own model requests and prompt-cache discounts.

Published:  · Added:  · 2 min

FEB-30 checks stored facts alongside an agent's answers

A memory test follows facts as they change, exposing errors that answer scores can hide or misdiagnose.

Published:  · Added:  · 2 min

A remote prompt cache can be slower than recomputing

An eight-GPU serving study fixes a cache bottleneck, while retaining the faster median of its recomputation baseline.

Published:  · Added:  · 2 min

ToolBottleneckBench traces agent failures to execution limits

A larger tool menu looked like worse tool use until researchers raised the model's response allowance.

Published:  · Added:  · 2 min

Probe-and-Resume tests an agent's finished work in disposable copies

A second model runs checks after completion, then sends failures back while preserving the working agent's state.

Published:  · Added:  · 2 min

Approve the Action an Agent Will Actually Run

Agent Step-Up tests whether approval screens show the real action and whether that action can change after approval.

Published:  · Added:  · 2 min

MAI-Gym trains and tests screen-operating agents through one loop

A shared interaction loop and executable task checks matter more than the nine-billion-parameter model's headline scores.

Published:  · Added:  · 2 min

Rewriting learned skills can erase most of an agent's gains

CODA tests jointly trained models and skill libraries after their instructions change. Even paraphrases can break previously successful tasks.

Published:  · Added:  · 2 min

RealtimeBench keeps the game running while the agent thinks

Slow reasoning improves a fast game-playing agent when it happens between attempts, with validation deciding which instructions survive.

Published:  · Added:  · 2 min

JointServe schedules model weights and session memory together

A single-GPU study preserves returning sessions while loading the next expert, but its extreme capacity claims need clarification.

Published:  · Added:  · 2 min

Hybrid Reasoning Agents

HybridAgent mixes internal vector-based computation with text for tools and inspection. Matched-model tests show stronger search results, but the cost savings cover estimated generation compute.

Published:  · Added:  · 2 min

CarryOn lets task objects carry an agent's progress

Keep the work products, their evidence and unfinished requirements, so a long-running agent can stop rereading every step.

Published:  · Added:  · 2 min

Large skill libraries can make agents stop opening the right instructions

A controlled study separates finding a skill, opening its instructions and completing the task. Choosing skills before execution helps, with costs.

Published:  · Added:  · 2 min

DeRef helps tool-call judges check values they must derive

A model can reject the right tool argument when its source is missing, or when using it requires an inference.

Published:  · Added:  · 2 min

Memory Echo: When an Agent Mistakes Repetition for Evidence

Copies of one old claim can crowd out a correction. A memory study tests source tracking, and shows when filtering makes answers worse.

Published:  · Added:  · 1 min

Revoking an agent's permission needs proof that effects stopped

A received revocation message can leave tool gateways accepting old permissions; a bounded monitor checks enforcement and actual writes.

Published:  · Added:  · 2 min

TurnCost: Count Cached Input Before Cutting Agent Costs

An analysis of 600 coding-agent runs finds that repeated steps explain much more cost variation than tool-output size, under simulated cached pricing.

Published:  · Added:  · 2 min

AI Models Can Provably Hide Arbitrary Capabilities

Encrypted networks expose a limit of capability testing: failing to uncover an ability cannot universally prove it absent from adversarially supplied weights.

Published:  · Added:  · 2 min

VikingMem: A Memory Base Management System for Stateful LLM-based Applications — Jiajie Fu & Yunjun Gao

ByteDance's production memory system for LLM apps: events as a log, entities as materialized views, 83% less storage than raw logs, and — the part that matters here — OpenViking is its open-sourced subset.

Published:  · Added:  · 3 min

Context Cartography: Toward Structured Governance of Contextual Space in LLM Systems — Zihua Wu & Georg Gartner

An NVIDIA researcher and a cartography professor formalize the context window as terrain to be mapped, then score four agent systems against seven operators and find the industry at roughly 60% coverage.

Published:  · Added:  · 3 min

Specs help developers clarify intent, but keeping them current costs work

A practitioner study separates reported agent reliability from measured repository habits and the work of maintaining specs.

Published:  · Added:  · 2 min

Models can profit from agreements by breaking their promises

ContractSim separates reaching a deal from honoring it. Private earnings can reward missed payments, and changing the instructions changes the result.

Published:  · Added:  · 2 min

The Little Book of Generative AI Foundations — Tianhua Chen

A derivation-led route from PCA to diffusion, exact likelihoods and energy-based models, with a useful correction in the revised edition.

Published:  · Added:  · 2 min

Why AI voting advice in Japan converges on one left-wing party

Models repeatedly recommend Japan’s Communist Party to left-leaning voters. Source access offers a possible explanation, but the pattern survives without web search.

Published:  · Added:  · 3 min

The Alien Space of Science: Searching for Ideas Researchers Might Overlook

A research sampler broadens AI-generated ideas by scoring plausibility separately from familiarity. The evidence shows a trade-off, not guaranteed discoveries.

Published:  · Added:  · 2 min

Attention Is Not What You Need — Zhang Chong

A geometric alternative to attention trails small Transformers, and its written method leaves a serious question about access to future tokens.

Published:  · Added:  · 2 min