Exploits Now Beat Patches: Open Source Security in the AI Era with Patrick Smyth, Chainguard

Frontier AI has fundamentally changed the risk tolerance and threat landscape for open source and the software supply chain, collapsing the gap between vulne

By Sean Weldon

Exploits Now Beat Patches: Open Source Security in the AI Era

Abstract

Frontier artificial intelligence has altered the economics of software exploitation, compressing and ultimately inverting the interval between vulnerability disclosure and weaponization. Drawing on incident reports and Mandiant M-Trends telemetry, this synthesis argues that the open source software supply chain now operates in a materially more adversarial environment than it did two to three years ago, and that conventional remediation cadences are no longer viable. Evidence indicates the mean patch-to-exploit gap has moved from +63 days (2018-2019) to approximately −70 days, that supply chain malware incidents have risen from roughly monthly to near-daily frequency, and that newly exposed surfaces - CI/CD systems, developer workstations, and the agentic layer - receive disproportionately little scrutiny. A four-surface defensive model is examined alongside concrete 2026 priorities: artifact signing, cryptographic provenance, package cooldown periods, minimal rebuilt base images, and accelerated remediation SLAs.

1. Introduction

The software supply chain comprises the aggregate of upstream code, build infrastructure, and distribution channels on which an organization's running systems depend. Its security posture has historically rested on an implicit assumption of attacker scarcity: exploitation required skill, time, and motivation that few possessed. Generative AI relaxes each of these constraints simultaneously, and the resulting shift is quantitative as well as qualitative.

The central thesis advanced here is that risk tolerance, not merely risk, has changed. Controls that were defensible under a 63-day exploitation lag become negligent under a negative lag. Notably, only an estimated 1-2% of a typical organization's running code stack is application code written by its own engineers; the remainder is operating system, runtime, and third-party dependency layers outside direct control, which is precisely the terrain AI-assisted attackers now exploit most efficiently.

Key terminology is used as follows. A zero-day denotes a vulnerability exploited before a patch exists. Provenance denotes verifiable, cryptographically attested metadata describing how an artifact was built and from what sources. A soft target denotes infrastructure that is security-relevant but historically excluded from the review rigor applied to production application code. This analysis proceeds by establishing the threat-actor and trust-degradation context (Section 2), examining empirical trends in exploitation timing, malware frequency, and attack surface expansion (Section 3), consolidating actionable technical findings (Section 4), and discussing broader implications (Section 5).

2. Background and Related Work

Reported incidents suggest a uniform upward shift in actor capability rather than the emergence of a distinct new adversary class. A 17-year-old student in Osaka used ChatGPT to author scripts and exfiltrate more than 4.4 million records from Japan's largest internet café chain, later monetizing a stolen payment card to purchase Pokémon cards. FunkSec, a suspected Algerian actor assessed as semi-technical, compromised 85 targets within a few months. A single unidentified individual used Claude Code across the full operational lifecycle - target selection, file organization, execution, and ransom correspondence - against 17 organizations spanning healthcare, government, and large enterprises. As the source material summarizes: "Everyone goes a level up in terms of threat. So if you were an actual engineer before, now you're a team. If you were actually a team before, now you're advanced persistent threat level."

The Eternal September analogy - originally describing the irreversible dilution of Usenet norms by continuous influxes of newcomers - provides a useful framework for the present moment. High-trust ecosystems, including package registries and open source maintainer communities, degrade toward low-trust, adversarial equilibria when the cost of participation falls. AI lowers the cost of participation specifically for attackers, producing norm collapse without a corresponding increase in defensive capacity, which motivates the four-surface defensive model examined in Section 3.

3. Core Analysis

3.1 The Inversion of the Patch-to-Exploit Timeline

Mandiant M-Trends data shows the average gap between patch release and exploitation was 63 days in 2018-2019. A secular trend driven by broader digital transformation - including domains such as hospitals adopting Python-based tooling - tightened this gap through 2021-2023. Beginning in 2023-2024, and accelerating sharply over the past year, AI-driven tooling compressed the gap further; the average is now approximately −70 days, meaning exploitation typically precedes patch availability. As stated directly in the source material: "The exploit on average hits before the patch." Traditional remediation cadences - scan, triage, fix within roughly 30 days - are now far too slow for a meaningful share of attacks, prompting the observation that "30 days may as well be a million years in terms of some of these attacks that have been happening."

3.2 Escalating Frequency and Mechanics of Supply Chain Malware

Supply chain malware incidents have risen from roughly one major attack per month to nearly one per day. The Shai Hulud worm, named after the Dune sandworm, originated in the JavaScript ecosystem and demonstrated that large-scale worming propagates effectively, spawning numerous copycats and variants, including a so-called "sandworm mode." Two concrete compromises illustrate the speed of modern attacks: the security scanner Trivy and the Axios library were both compromised in the same year, with the Axios incident live for only two hours yet still achieving 600,000 downloads. These attacks increasingly chain through shared dependencies, such that compromising a single package compromises every downstream consumer of it - a structural property of the supply chain, described in the source material as the situation of "users relying on your infrastructure... then you turn around and you're actually pulling from upstream... any of those things that you pull in could potentially compromise you and your users."

3.3 A Four-Surface Model of Supply Chain Risk

The threat landscape can be organized into four attack surfaces: malware (compromised packages), known vulnerabilities (CVEs), zero-days (undisclosed vulnerabilities, increasingly discovered and chained by frontier models themselves), and soft targets (CI/CD pipelines, developer workstations, and the agentic/AI layer). The latter category is newly significant and underscrutinized relative to production code. One vendor's countermeasures, examined here as a case study rather than an endorsement, map directly onto this model: source-built libraries to foreclose distribution-page tampering, a minimal rebuilt base distribution (Wolfi) to reduce known-vulnerability and zero-day exposure, a zero-day information-sharing consortium (Athena) for early warning, and hardened wrappers for CI/CD actions and third-party agent skills.

3.4 Agent Skills as an Emerging Risk Category

Analysis of upstream agent skills found that roughly 5% are actively malicious, down from approximately 20% earlier in the same year, alongside an additional 30-40% that carry serious unintended security issues even absent malicious intent. This finding positions the agentic layer as a soft target comparable in severity to CI/CD misconfiguration, warranting equivalent scrutiny before adoption.

4. Technical Insights

Several findings carry direct implementation relevance. First, the patch-to-exploit gap (+63 days to −70 days) implies that remediation SLAs calibrated to monthly or 30-day cycles are structurally inadequate; a tiered SLA - for example, 1 day for known exploited vulnerabilities, 7 days for critical severity, and 14 days for all else - is more consistent with observed exploitation speed. Second, the Axios case (2-hour exposure window, 600,000 downloads) demonstrates that detection latency, not just remediation latency, is now a binding constraint; package cooldown periods before adoption mitigate this by delaying exposure to freshly published, unvetted releases. Third, building libraries directly from maintainer source rather than pulling from distribution pages (PyPI, NPM, Maven Central) structurally forecloses an entire class of distribution-tampering attacks, independent of signature verification. Fourth, a minimal, frequently rebuilt base distribution reduces both the standing count of known vulnerabilities and the surface available for zero-day discovery, at the cost of requiring a rolling-release operational model rather than tracking stable upstream versions. Finally, artifact signing via Sigstore and cryptographic provenance via Salsa address integrity and traceability but do not, by themselves, address detection latency or cooldown gaps - they are complementary rather than substitute controls.

5. Discussion

The data points toward a single underlying mechanism: AI lowers the marginal cost of both attack execution and attack sophistication, while defensive processes remain calibrated to a pre-AI threat cadence. The consequence is not an increase in risk magnitude alone but a change in which controls are adequate at all - a 30-day remediation window, reasonable in 2019, is now a liability. This reframing has implications beyond the specific vendor practices discussed: any organization's security program should be evaluated against current exploitation velocity rather than historical baselines.

Open questions remain. The agent-skills malicious-rate figures (5% currently, down from 20%) come from a single vendor's internal analysis and would benefit from independent corroboration and longitudinal tracking as the ecosystem matures. Similarly, it is unclear whether zero-day discovery by frontier models will continue accelerating or whether model providers' own safety mitigations will offset this trend. These findings also connect to broader industry movement toward minimal base images, rolling distributions, and provenance attestation as default rather than optional practice - a trajectory consistent with regulatory and enterprise procurement trends already underway.

6. Conclusion

This synthesis documents a measurable inversion in the patch-to-exploit timeline, driven substantially by AI-assisted threat actors, alongside a near-tenfold increase in supply chain malware incident frequency. It further identifies CI/CD pipelines, developer workstations, and agent skills as underscrutinized soft targets requiring attention comparable to that given to known-vulnerability management. Practically, organizations should prioritize package cooldown periods, tiered and accelerated remediation SLAs, artifact signing and provenance attachment, and completion of foundational modernization (containerization, CI/CD hardening, golden images) as prerequisites for further security investment. The broader takeaway is that security postures calibrated to a 2018-2023 threat model are no longer defensible, and that AI-driven attacker capability should now be treated as a baseline planning assumption rather than an edge case.


Sources


About the Author

Sean Weldon is an AI engineer and systems architect specializing in autonomous systems, agentic workflows, and applied machine learning. He builds production AI systems that automate complex business operations.

LinkedIn | Website | GitHub

Sean Weldon builds apps and custom software at 22Atlas.

Start your build

More about Sean