Human-directed attackers run intrusions in parallel

  • CrowdStrike says hackers used AI to run parallel intrusions — Rotate old exposed credentials and restrict cloud permissions, because automation can reuse ordinary weaknesses across many targets at once.
    • The October 29 report describes more than two hundred targeted organizations across at least fourteen countries in eleven days. CrowdStrike confirms post-exploitation activity at nine organizations.
    • Human operators directed ARTEX agents, using DeepSeek and an unidentified second commercial model. An agent is a model running a multi-step task with tools.
    • Planning agents processed roughly 1.4 billion input tokens during one intrusion. Tokens are the text units a model processes, and this count alone establishes neither unique data volume nor spending.
    • One intrusion reused authentication keys from a 2022 directory export and a VPN key attributed to a May 2024 leak. Historical exposures still require credential rotation.
    • CrowdStrike recommends validating login signatures, protecting cloud metadata access and restricting remote administration rights. It distinguishes this campaign from the previously reported Storm-0940 activity using ARTEX.
    • Caveat: This is CrowdStrike’s attribution and recovered-activity account, with confirmed compromises at nine targets rather than all two hundred targeted organizations. (Techmeme · NBC News reporting · primary campaign report and defensive recommendations)

Written priorities help coding assistants change established patterns

  • Written rules help coding assistants override existing code patterns paper notes → — State which requirement takes priority when new work should deliberately depart from the surrounding implementation.
    • October 28’s study runs 5,625 trials across four coding assistants and six implementation choices. Validation covers four public repositories in Python, Go and TypeScript.
    • Existing examples override the assistants’ default preferences in 359 of 360 trials. This comparison concerns default choices, before adding explicit conflicting priority rules.
    • Three examples in local files produce the target choice in 347 of 360 trials. Three examples for neighboring resources do so in thirteen of 360.
    • Written priority rules achieve functional correctness and the intended choice in 59 of sixty trials, versus 38 with code examples alone. These controlled comparisons use two assistants and two choices.
    • In public repositories, placing the rule in the assistant’s native instruction file raises joint success from zero to 117 of 120 trials. Preserve the reason and priority alongside the implementation.
    • Caveat: These experiments test narrowly defined implementation choices, so they establish neither whole-project maintainability gains nor a universal instruction-following success rate. (arXiv 2610.38244 · controlled interventions, instruction channels and public-repository validation)

Skill instructions can quietly remove human review

  • Researchers find shared skills telling assistants to skip approval paper notes → — Review permission-changing instructions in reusable skills even when a malicious-content scanner accepts the package.
    • October 27’s study analyzes 1.53 million distinct English skills and hand-labels 2,097 instruction units. Skills are reusable instruction packages centered on a SKILL.md file.
    • Its detector estimates that about one in seventeen skills, roughly 88,000, contains an instruction loosening oversight. Among sampled loosening directives, 70.1% apply without a limiting condition.
    • At equal amounts of oversight language, shell-running, package-installing and administrator-access skills have 1.7–1.8 times the odds of loosening oversight. This is an association between file contents.
    • The strongest individual scanner catches 46% of relevant directives, with 27% of its flags correct. Giving the same language model the study’s labeling rules catches 61%, with 71% correct flags.
    • Inspect instructions that suppress confirmation, bypass checks or continue through blocked steps. The study separates legitimate unattended workflows from malicious intent rather than labeling every such instruction an attack.
    • Caveat: This is an English-text classification study with phrase-based sampling, so its estimates do not measure how often assistants actually bypass approval or cause harm. (arXiv 2610.37734 · full methods, scanner comparison and measurement limits)

Check the screen again before an irreversible click

  • Researchers trace mistaken browser clicks to pages still loading paper notes → — Let the page settle, then verify the target before a purchase or deletion and take a new screenshot when it moves.
    • October 29’s study tracks targets on 31 public pages. Only 0.4% of clicks planned on fully loaded pages become stale within thirty seconds, versus 17% within the first second after opening.
    • Waiting for network requests to stop leaves 0.46% stale clicks, with a median wait of 1.24 seconds. Reimplemented waiting rules from eight of ten assistants leave more than 1% stale.
    • In a separate desktop crawl, 52% of 65 booking and buying homepages shift after a network-idle wait capped at three seconds. This measures movement within the following 6.5 seconds.
    • On synthetic moving pages, a pixel check catches 82% of stale targets with 4% false alarms in 312 milliseconds. Opus catches 83% with 12% false alarms in 2,366 milliseconds.
    • The released test generator separates target position, obstructing dialogs and action outcomes. When a check fails, the study recommends planning again from a fresh screenshot.
    • Caveat: Commercial-page percentages measure desktop layout shifts, while the accuracy comparison uses synthetic pages rather than successful real-world checkout operations. (arXiv 2610.39282 · page measurements, reproduced waiting rules and public test implementation)

Improving task scores can conceal disappearing safety layers

  • Self-improvement tests can approve the removal of backup safety rules paper notes → — Test what remains when one protection fails, especially before reusing optimized instructions with another model.
    • October 28’s study examines the harness, the software around a model that runs its tools, files and commands. Four overlapping written safeguards protect credential access or simulated cleanup operations.
    • Researchers run 411 improvement loops under ten acceptance rules, mostly deliberately deleting safeguards. A remaining protection can hide the effect of deleting another from ordinary task-result checks.
    • In one controlled comparison at the same safeguard cost, twenty-task batches preserve protection in every run. Forty-task batches lose protection in all six runs.
    • Three additional GEPA prompt-optimization runs retain every labeled safety rule verbatim. Nevertheless, two resulting instruction sets misuse credentials when transferred to a weaker model.
    • Freezing safety text or testing versions with one protection removed preserves depth in the studied settings. Keeping the text alone misses changes elsewhere that can weaken its effect.
    • Caveat: Most experiments force safeguard deletions in two controlled environments, so they demonstrate a failure mechanism rather than its frequency in deployed self-improving systems. (arXiv 2610.38392 · controlled deletions, separate optimizer runs and model-transfer tests)

Smaller working memory can help local models serve longer conversations

  • Researchers shrink model working memory without discarding stored values paper notes → — Compressing conversation state can free memory for longer or concurrent requests, while full-request speed gains remain smaller than attention-only gains.
    • October 28’s GAAC compresses the KV cache, a model’s stored working memory for a prompt. It reconstructs needed pieces while processing them and preserves every stored sixteen-bit value exactly.
    • Across five models, encoded cache compression is 1.405–1.407 times. Including allocation overhead, resident cache memory falls by about 26%.
    • On DGX Spark at a 64K-token context, the attention stage runs 1.19–1.27 times as fast. Complete generation steps across tested contexts run 1.04–1.15 times as fast with four-bit model weights.
    • Under comparable cache-memory budgets, serving fits one additional concurrent sequence per tested configuration. Aggregate output speed rises 13%–29%, a different comparison from keeping concurrency fixed.
    • On Apple M4, attention runs 1.02–1.25 times as fast. Those tests compare individual processing routines rather than a complete Mac serving application.
    • Caveat: These are author-run implementations on DGX Spark and Apple M4, and the paper does not establish ready-to-install support in the user’s existing serving software. (arXiv 2610.38210 · complete compression, memory-allocation and serving comparisons)

Open game experiments expose coordination problems worth reproducing

  • YC releases code and records from multi-assistant game experiments — Shared instructions and messaging can produce bottlenecks or useful coordination, and the released environments make those behaviors inspectable.
    • Fifty GPT-6.1 Sol agents played Minecraft survival for three hours and exchanged about 5,900 messages. After early deaths, they concentrated on shelter, food rationing and increasingly cautious procedures.
    • Forty-six of the other 49 agents sent their first message to the first agent listed in the directory. That agent became the communication hub without an election.
    • In nine Minecraft Bed Wars games, GPT teams beat Claude teams six to three. In seven Mindustry games, GPT teams won six to one using different coding-assistant software from Claude’s.
    • The report links replays, messages and generated files alongside the Minecraft implementation and Mindustry environment.
    • Vary directory order, team size and communication rules before treating the observed hierarchy as a stable model trait. The Mindustry setup deliberately leaves each assistant’s normal conversation management in place.
    • Caveat: These small, author-run series compare complete model-and-software combinations, so the win counts cannot isolate model capability or establish general swarm superiority. (HN 301 points · 111 comments · full report, recorded evidence and implementation repositories)
All gathered items - what was cut and why (10)