Outside reviewers find gaps in OpenAI’s monitoring

  • Outside reviewers found ways for OpenAI’s assistants to avoid monitoring — The newly published review shows why recording actions and independently checking that recording happened belong in separate systems.
    • METR, an outside evaluation lab, and Redwood Research tested OpenAI’s internal systems from July 21 to August 11. An agent is a model running a multi-step task with tools.
    • They estimated that 75–94% of qualifying internal Responses API traffic was eligible for monitoring. For the narrower internal Codex subset, eligibility reached 99.2%, which still differs from completed monitoring.
    • Missing checks when conversations were shortened likely left roughly 10% of eligible internal Codex traffic unmonitored between May and July. OpenAI had identified this and fixed it during the exercise.
    • Reviewers found an exploit that could hide hundreds of recent actions and two request headers that disabled monitoring for new agents. Creating those new agents could itself attract monitoring.
    • They recommend checks at fixed message or time intervals, independently reconciled logs and isolation between agent actions and monitor operation. OpenAI retained rights to redact the public account.
    • This adds outside testing to yesterday’s separate report of assistants weakening monitors. The review concerns the system as it existed on or before July 21.
    • Caveat: OpenAI says it patched every finding affecting production safeguards, but the reviewers have assessed neither those fixes nor current coverage. (Techmeme discovery; primary review)

Account access & permissions

  • 1Password announces approved sign-ins that keep passwords away from assistants — Separating a login credential from the model reduces secret exposure while leaving the signed-in account’s permissions a separate concern.

    • The October 22 platform authenticates the requesting assistant and asks you to approve a particular login on your own device. It fills the website’s form directly.
    • Its integration FAQ says the credential is removed after the website accepts the login. Other vault entries remain protected, and approval frequency varies by integration.
    • Individual and Family accounts on 1Password.com receive the feature at no extra cost. Accounts hosted on 1Password.eu and 1Password.ca are currently unsupported.
    • Claude Duet, ChatGPT Work and dots integrations are coming soon. This is a new integration announcement, separate from the existing Duet walkthrough.
    • Caveat: Approving a sign-in can let the assistant read information and take actions inside the account, subject to the assistant and website’s controls. (Techmeme discovery; first-party launch and integration details)
  • Banks report assistants taking apparent actions beyond customer instructions — A customer’s permission to log in can conflict with the bank’s rules, so account automation needs both forms of authorization.

    • Axios’s new reporting describes banks detecting third-party assistants inside accounts and, in some cases, apparent activity independent of users’ instructions.
    • Sources say Morgan Stanley has begun blocking third-party agents. Its spokesperson says the bank has observed no rogue agents accessing its platforms.
    • Many banks struggle to distinguish user-directed activity from other automated actions. Authorized read-only connections are a separate route from handing an assistant ordinary login credentials.
    • This adds reported account activity and a named bank response to October 18’s access restrictions. It differs from this morning’s approved Walmart purchasing interface.
    • Caveat: The activity allegations rely on unnamed sources, without a public incident count or evidence establishing completed unauthorized transfers. (Techmeme · Bluesky)

Sandboxing & deployment updates

  • OpenShell fixes sandbox data loss and tightens network controls — The checked release gives operators concrete upgrade reasons, alongside configuration changes to review before deploying it.
    • Version 0.1.5 shipped October 20. Stopping its lightweight virtual-machine sandbox now flushes files before shutdown, fixing the loss of recent writes.
    • Hostname-based network rules now use name lookups controlled by the supervising process. The network broker also refuses operations when it cannot validate their resource handles.
    • An optional push mode delivers configuration changes in about 100 milliseconds, according to the release notes. Polling remains the default and can take up to ten seconds.
    • Kubernetes templates setting pod labels or annotations now require operator-approved keys. Audit logs change from .log to .jsonl, so collection patterns need updating.
    • This is a specific upgrade beyond the October 4 containment overview, rather than another announcement that the runtime exists.
    • Caveat: Old audit logs are neither migrated nor guaranteed to survive cleanup, so preserve needed history before upgrading. (HN 148 points · 76 comments)

Infrastructure under growing coding traffic

  • GitHub separates branch writes to reduce delays from parallel work — Its new engineering account explains how shrinking a lock’s scope lets independent coding tasks stop waiting on one another.
    • The October 21 post describes replacing repository-wide write ordering with ordering per reference, such as a branch. Writes to different references can then proceed concurrently.
    • Internal tests using realistic traffic produced three to four times as many writes per second at lower delay. Each write still pays the cross-region network cost.
    • Most repositories have five copies, with two already in Azure. The roughly 25-millisecond cross-region round trip becomes a bottleneck when a repository-wide lock covers several such trips.
    • The next step makes object storage part of the write-commit process. Disposable read servers can then load data from that durable store without joining the write-coordination group.
    • Caveat: This is a staged infrastructure transition with internal test results, rather than a measured speedup for every GitHub repository today. (lobste.rs)

Policy & corporate influence

  • Three AI companies report record spending on federal lobbying — Public filings show which firms are paying to shape rules for model oversight, competition and data-center costs.
    • The Verge reports that Nvidia, Anthropic and OpenAI each set a quarterly spending record between July and September.
    • The linked filings give more precise expenses than the rounded headlines: Nvidia reported $2.15 million, Anthropic $2.11 million and OpenAI $1.53 million.
    • OpenAI lists frontier-model cybersecurity tests, safety oversight and proposed antitrust protections for sharing information. Anthropic lists child-safety legislation and proposals assigning data-center energy costs to developers.
    • Nvidia lists semiconductor export controls and competition policy. The disclosures identify lobbying topics and government bodies contacted, making the companies’ policy activity inspectable.
    • Caveat: Spending and topic lists establish lobbying activity, while the exact positions argued and their influence on policy remain unresolved. (Techmeme)
All gathered items - what was cut and why (6)