Mistral ships Codestral 3 with a 512k context window aimed at monorepos

Codestral 3 targets whole-repository reasoning with a 512,000 token context, open weights under a modified Apache license, and pricing that undercuts GitHub Copilot's enterprise tier.

Younes Bekrar11 min read
ShareXLinkedInFacebook
Mistral ships Codestral 3 with a 512k context window aimed at monorepos

Mistral released Codestral 3 on Monday morning in Paris with a 512,000 token context window and open weights for the 24 billion parameter variant. A larger 140 billion parameter mixture of experts model is available through the API and to on-premises customers under a commercial agreement. The pitch is repository-scale reasoning: instead of retrieving a handful of relevant files, load the whole service and let the model see the dependency graph directly. Mistral claims 71.4 percent on SWE-bench Verified for the large model, which would place it just behind Anthropic's Claude and ahead of every openly licensed alternative.

The context window claim, examined

Long context numbers have become marketing, so the useful question is whether the model can find things at depth. Mistral published needle-in-haystack results showing above 96 percent retrieval accuracy through 400,000 tokens, degrading to about 88 percent at the full 512,000. Independent testing from the Nous Research community broadly matched that on synthetic tasks. The harder test is multi-hop reasoning across distant files, where retrieval accuracy matters less than whether the model tracks a type definition through three layers of indirection.

example.ts
typescript
export async function handler(request: Request): Promise<Response> {  const started = Date.now();  const upstream = await fetch(request);  const headers = new Headers(upstream.headers);  headers.set("x-skarvonix-ms", String(Date.now() - started));  return new Response(upstream.body, {    status: upstream.status,    headers,  });}

On that test the results are mixed but promising. Running a 310,000 token TypeScript monorepo through the API, the model correctly traced a generic type parameter from a shared package through two consuming services and flagged a variance bug that a smaller-context competitor missed entirely because it never saw both files at once. It also hallucinated a function signature from a file it had been given, which is the failure mode that makes engineers distrust these tools. The pattern held across a dozen trials: strong on structure, occasionally wrong on detail.

What the license actually permits

Mistral released the 24 billion parameter model under what it calls Apache 2.0 with a service restriction, meaning you can use it commercially inside your own products but cannot resell inference as a hosted coding service competing with Mistral. That is more permissive than Meta's Llama community license in some respects and less permissive in others, and it is not an OSI-approved open source license, a distinction the Open Source Initiative pointed out within hours. Mistral's head of open source said the company chose clarity over the label.

For most enterprises the distinction does not bite. A bank running the model on its own hardware to help internal developers is squarely permitted. A startup building a Copilot competitor is not. The middle case, a software vendor embedding code suggestions as a feature of an unrelated product, appears permitted, though two lawyers we asked wanted clarification on what counts as a competing service. Mistral says an FAQ addressing that is coming, which is a sentence that should make procurement teams pause before deployment.

The story is rarely the launch. It is what breaks, what ships, and who owns the mess at 2 a.m.
Younes Bekrar

Pricing pressure on the incumbents

API pricing lands at $0.60 per million input tokens and $2.40 per million output, roughly 60 percent below Anthropic's rate for a comparable coding model. For teams doing repository-scale prompts, where a single request might carry 200,000 tokens of context, that difference compounds quickly. A platform engineering lead at a Dublin fintech estimated the switch would cut his team's monthly bill from about $31,000 to $12,000 for the same request volume, which is real money even before counting the option to self-host.

GitHub has not commented, but Copilot Enterprise at $39 per seat per month now looks expensive against a self-hosted alternative for companies with the infrastructure to run it. The counter, which GitHub will make, is that the model is one component and the integration work is the rest. That has been true historically. It is getting less true as Continue, Cline, Zed, and a growing set of editor extensions handle the plumbing for whatever endpoint you point them at.

Running it yourself

The 24 billion parameter model in 8-bit fits on a single H100 with room for about 180,000 tokens of context. Getting the full window requires either an H200 or a two-card setup with tensor parallelism, and the KV cache is what eats the memory. Mistral shipped a paged attention configuration for vLLM and the vLLM project merged support the same day. Ollama support landed Monday evening, though the default configuration limits context to 32,000 tokens and users have to raise it manually.

Quantized variants are already circulating. The community's 4-bit GGUF builds run on a pair of consumer 5090 cards at usable speed for single-developer workloads, roughly 34 tokens per second on generation with a 100,000 token prompt. Quality loss at 4-bit is noticeable on the harder SWE-bench tasks, dropping perhaps four points, and negligible for routine completion. For a small team, a $6,000 workstation now runs a coding model that would have required a cloud contract eighteen months ago.

The competitive picture heading into autumn

Mistral's position has been awkward for two years: technically credible, commercially squeezed between American labs with more capital and Chinese labs releasing genuinely open weights. Codestral 3 is the clearest case yet that the company found a defensible niche in code, where European enterprises want a supplier that is not subject to US jurisdiction and where the sovereignty argument closes deals that benchmarks alone would not.

Watch three things. First, whether Qwen or DeepSeek answer with a comparable coding model under a fully permissive license, which would erase Mistral's differentiation on openness. Second, whether the 140 billion parameter model's benchmark numbers survive contact with independent evaluation, since SWE-bench contamination remains a live concern. Third, whether Mistral can ship the enterprise tooling, audit logs, and deployment support that turn a good model into a purchase order.


Skarvonix will keep following this beat with reporting grounded in how systems behave outside the launch keynote.

  • LLMs
  • Open Source

Keep reading