AI Brief, November 1: ChatGPT account takeover, Anthropic distillation blocks, AI-ranked victims

A ChatGPT sandbox escape that hijacked accounts, Anthropic blocking suspected distillation, and malware using an LLM to rank victims.

By Sean Weldon

Security leads the day: Simon Willison walks through Parameter Labs' chain of bugs that turned a ChatGPT share link into an account takeover, and Cisco Talos documents a stealer that outsources victim triage to an LLM. Elsewhere, builders got new evidence on coordinated small models, framework token costs, and long-horizon agent planning.

ChatGPT HTML preview sandbox escape let a share link take over accounts

Simon Willison writes up Parameter Labs' exploit against ChatGPT's artifacts pattern, now called HTML previews, where custom HTML runs in a sandboxed iframe. He describes the chain: the MathLive library's virtual keyboard could be triggered from a sandboxed frame via postMessage, the handler used innerHTML with no check on which frame sent the message, and that allowed injecting an unsandboxed iframe. OpenAI's CSP blocked inline scripts but allowed YouTube, whose oEmbed endpoint could reflect executable JavaScript. The result was a share URL that could exfiltrate another signed-in user's private data or act on their behalf. Willison says OpenAI closed the hole and paid a bug bounty he considers too small for the severity.

Why it matters: Anyone shipping interactive AI-generated artifacts inherits this threat model: frame sandboxing, postMessage origin checks and CSP allowlists all have to hold at once, and a single trusted script domain can undo the rest.

Sources: Simon Willison

Researcher says Anthropic flagged his account for 'training a competitor'

In a post on X that drew attention among builders, Jiahao Shao says Anthropic tagged his account for training a competitor even though, by his account, he never distilled Claude and his rollouts came from a strong open-source model while Claude only helped submit jobs and run analysis. He says work touching RFT, SFT or training larger models now gets him blocked, downgraded from Opus 5.5 to Opus 5, or has the session killed outright. He argues the anti-distillation stance is a double standard given that frontier models were trained on the open web. Anthropic's side is not represented in the post.

Why it matters: If your pipeline uses Claude anywhere near fine-tuning or RL work, even for orchestration or analysis, account-level enforcement is a live operational risk worth isolating from production.

Sources: twitter.com / Hacker News discussion

Memdoor workflow runs five Qwen3.8-27B agents on LiveCodeBench Hard

The Memdoor team-solve example implements the GVS5H (Lee, 2026) method as eight YAML files with no code: a planner, two ideators, a solver and a manager, plus a repair worker. Each agent starts from a fresh context and communicates only through files on disk, and a script that runs the samples decides success rather than a model. Running the same model, Qwen3.8-27B, the authors report the first ten problems of the LiveCodeBench Hard list with five passes each, graded on hidden tests. They are explicit about limits: the claim is parity with the reference harness, not a gain, scores of 9.8 and 9.6 are the same at that sample size, the contests date from spring 2025 so contamination cannot be ruled out, and the Fable 5 column was not run in this harness.

Why it matters: It is a copyable blueprint for multi-agent coding with mid-size open models, and the writeup models the honesty you need when comparing your own agent stack against a frontier baseline.

Sources: github.com / Hacker News discussion

Talos: VOLTA infostealer uses an LLM to rank victims by monetization value

Cisco Talos describes VOLTA-AUTODOXER, a self-deleting Windows stealer with an optional AI layer. After harvesting browser credentials, cookies, cards, wallet seed phrases, Discord, Telegram, Steam and Roblox sessions, Microsoft OAuth tokens, SSH and cloud keys and Wi-Fi profiles, it enriches the haul using stolen sessions, searching Gmail for receipts to confirm a home address and pulling UberEats and DoorDash order history. The bundle is POSTed to OpenRouter with a system prompt telling the model to act as a forensic intelligence analyst and return sections titled "WHAT THEY'RE WORTH" and "THEIR OPSEC." Talos notes a hardcoded temperature of 0.2 and a fallback chain from Claude to Kimi to Gemini that triggers on refusal phrases like "I can't," and says all endpoints are third-party controlled with no actor-owned infrastructure.

Why it matters: Refusal resilience is now being engineered into crimeware, and the abuse surface is plain API access, so providers and anyone reselling inference should expect this traffic pattern.

Sources: blog.talosintelligence.com / Hacker News discussion

Benchmark measures how much JavaScript frameworks cost coding agents in tokens

Nolan Lawson built a Pokemon app against the PokeAPI with Opus 5.5 at high effort across multiple frameworks, taking the median of five runs each and testing output against a spec conformance suite based on the accessibility tree. He reports that SvelteKit, Gracile+Lit and Angular were the most expensive to build, attributing SvelteKit's cost to agents reading the v3 migration guide every run and Angular's to total code size. Angular failed to produce a working app twice, so he used three iterations. He also found official MCPs and skills were often ignored: Nuxt's MCP was never used, and agents read the Next.js skill file in one of five runs. Hono+htmx did roughly the same job as Angular with about 70% of the code.

Why it matters: Code size now maps directly to the ongoing token cost of maintaining a codebase, and shipping an MCP or skill file is no guarantee agents will actually load it.

Sources: nolanlawson.com / Hacker News discussion

TechCrunch: OpenAI reportedly lowers its funding target ahead of planned IPO

TechCrunch reports, citing the Financial Times, that OpenAI has lowered the target for its current round after earlier reports of a larger raise at a higher valuation, with a first close expected to come in below even the reduced target. The FT said the round will be led by a group of investors from the United Arab Emirates, with a subsequent retail offering for wealthy individuals potentially making up the remainder. A Wall Street Journal follow-up reported the company has secured part of the total so far and that fundraising met a "tepid" response from some large investors. TechCrunch says it has asked OpenAI for comment and notes a broader tech sell-off driven by investor wariness about AI infrastructure spending.

Why it matters: Tighter capital for the largest model provider is an upstream signal for compute availability and the pace of capacity expansion that API customers depend on.

Sources: TechCrunch AI

GPT-5.6 Sol completes a peaceful Factorio run in 13.5 hours of game time

Ryan Madden reports getting GPT-5.6 Sol, running in Codex at low thinking level, through a peaceful Factorio run with no biters in 13.5 hours of game time. A run manager let the model play programmatically through a small Python library that enforced the same constraints human players face, including player reach and fog of war. He says the rocket launch required significant manual effort from the model, which papered over late-game failures to connect production systems by repeatedly ferrying supplies between areas. He calls it an improvement over GPT-5.5, which failed to use transport belts at all, and plans to test other models, thinking levels and non-peaceful runs.

Why it matters: A legible long-horizon task with hard physical constraints is a useful read on where agent planning still breaks down: not early execution, but connecting subsystems as the build scales.

Sources: ryanmadden.net / Hacker News discussion


How this brief is made: each morning, stories are picked from AI lab announcements, analysts, Hacker News, Hugging Face Daily Papers and the tech press, then summarized with AI assistance from the linked sources. Every item links to where its facts came from.

Sean Weldon builds apps and custom software at 22Atlas.

Start your build

More about Sean