Illustration for: Open Models Catch Up, Safety Gap Remains

Open Models Catch Up, Safety Gap Remains

Open-weight AI models are approaching frontier-lab capability on many benchmarks, but a widening safety and alignment gap means the two tiers are diverging on risk even as they converge on performance.

TC
By the AI Desk
Edited by Trace Cohen · Early-stage VC & angel · Founder, New York Venture Partners
1 min read
ShareXLinkedInEmail

THE RUNDOWN

1

New reporting finds open-weight models from labs like Alibaba, Moonshot AI and DeepSeek are closing the capability gap with closed frontier labs on many standard benchmarks

2

The safety and alignment gap between open and closed models has not closed at the same pace -- open models generally ship with fewer built-in guardrails and less red-teaming disclosure than frontier closed labs

3

This directly intersects with the White House's new AI framework (also in this issue), which exempts open-weight models from its testing regime entirely

4

For enterprises, the choice between open and closed models is increasingly a capability-per-dollar decision rather than a capability-ceiling decision -- but the safety diligence burden shifts entirely onto the deploying company when using open weights

TC

The VC Read · Trace's Take

Trace Cohen

Capability convergence without safety convergence is the exact combination that should worry enterprise buyers more than either trend alone -- a highly capable model with no disclosed red-teaming is a different risk profile than a slightly-less-capable one that's been through AISI-style testing. Don't let the benchmark headline distract from the diligence question.

Analysis

Open-weight AI models are closing the performance gap with frontier closed-source labs faster than most forecasts expected a year ago, according to new comparative reporting this week -- models from Alibaba, Moonshot AI and DeepSeek now match or approach OpenAI and Anthropic's frontier models on a growing share of standard benchmarks. What hasn't closed at the same pace is the safety and alignment gap: open models generally ship with fewer built-in guardrails, less red-teaming disclosure, and no equivalent to the kind of joint incident reporting AISI extracted from OpenAI and Anthropic this week.

That divergence matters more now that the Trump administration's new AI framework explicitly exempts open-weight models from its testing regime entirely, and China's open-weight releases specifically get the same pass. The practical effect is a growing tier of highly capable models operating with materially less structured safety oversight than their closed-source counterparts, even as their raw capability keeps converging.

For enterprises evaluating which models to deploy, the calculus is shifting: open weights increasingly offer competitive capability per dollar, particularly for cost-sensitive, high-volume workloads, but choosing them also means the safety, red-teaming and monitoring burden shifts entirely onto the deploying company rather than being partially absorbed by a closed lab's internal safety team.

This is a live tension for the open-source AI movement broadly -- the same openness that drives faster iteration, wider community scrutiny of code and weights, and lower deployment costs also removes the single-vendor accountability structure that regulators like AISI have started to lean on for disclosure and mitigation.

What to watch: whether open-model providers start voluntarily adopting AISI-style testing and disclosure practices to differentiate on trust, or whether the capability convergence continues without a parallel safety convergence, leaving enterprises to build their own evaluation infrastructure from scratch.

ShareXLinkedInEmail

Key Sources

2 sources

Reported by TechCrunch · Analysis by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with Trace's take. Free, no spam.