All Posts
AI Infrastructure September 27, 2026

MiMo V2.6 Pro vs DeepSeek V4.1 Flash: Open Weight Benchmarks Tested (September 2026)

Xiaomi is not a name most engineering teams have on their shortlist for frontier open weight models, and that should probably change this week. MiMo V2.6 Pro, released September 22, 2026, now tops the Artificial Analysis Intelligence Index among open weight models with a score of 46, and its DeepSWE score jumped from 19.0 to 71.9 over the prior V2.5 Pro generation, the kind of one release gain that usually signals a genuine architecture or training change rather than incremental tuning. DeepSeek V4.1 Flash, which quietly replaced V4 Pro as DeepSeek's default fast tier earlier this month, is the open weight model most teams are actually running in production today. Here is how the two compare on what matters for a real deployment decision.

MiMo V2.6 Pro vs DeepSeek V4.1 Flash: Open Weight Benchmarks Tested (September 2026)

Xiaomi released the MiMo V2.6 series on September 22, 2026, and the headline number is the kind that usually takes a full model generation to produce, not a single point release. MiMo V2.6 Pro now leads the Artificial Analysis Intelligence Index among open weight models with a score of 46. Its DeepSWE score moved from 19.0 in V2.5 Pro to 71.9 in V2.6 Pro. Terminal Bench 4.0 went from 1.5 to 34.9. AutomationBench climbed from 16.0 to 53.1, and the internal MiMo Code Bench moved from 40.4 to 63.2. Those are not tuning gains. Something structural changed between V2.5 and V2.6.

DeepSeek V4.1 Flash is the more relevant comparison for most teams reading this, not because it is the strongest open weight model on paper, but because it is the one teams are actually running. DeepSeek retired V4 Pro in favor of V4.1 Flash as its default fast tier earlier this month, and V4.1 Flash has the production track record, tooling ecosystem, and hosting availability that a two day old release cannot yet match.

What actually changed in MiMo V2.6

MiMo V2.6 Pro is a Mixture of Experts model with 1.02 trillion total parameters and 42 billion active parameters per token, MIT licensed, and natively omnimodal: it takes text, image, speech, and video as input and outputs text, with a 1 million token context window. That is a large active parameter count for an open weight model in this pricing tier, and it is a meaningful part of why the DeepSWE and Terminal Bench jumps are plausible rather than suspicious. A bigger active parameter budget paired with a longer or more targeted training run on agentic tasks is a coherent explanation for gains of this size, consistent with the pattern other labs have described for their own large jumps this year.

MiMo V2.6 Pro MiMo V2.6 Flash DeepSeek V4.1 Flash
Release date September 22, 2026 September 22, 2026 September 2026 (replaced V4 Pro)
License MIT MIT Open weight (DeepSeek license)
Architecture MoE, 1.02T total / 42B active MoE, smaller active parameter budget MoE
Context window 1M tokens 1M tokens Not directly comparable in this release cycle
Artificial Analysis Intelligence Index 46 (leads open weight models) Lower, positioned as the cheaper tier Not the top open weight score, but production proven
Input pricing $0.43 per 1M tokens Lower than Pro Competitive; specific rate varies by host
Output pricing $0.87 per 1M tokens Lower than Pro Competitive; specific rate varies by host
DeepSWE 71.9 (up from 19.0 in V2.5 Pro) Not the headline number for this tier Not the comparison point Xiaomi is targeting

The blended rate Xiaomi quotes for MiMo V2.6 Pro, using a 7 to 2 to 1 cache hit, input, output ratio typical of agentic workloads, comes out to roughly $0.18 per 1M tokens. That is aggressive pricing for a model claiming the top open weight intelligence score, and it puts real pressure on DeepSeek's positioning as the value leader in this category.

Why "top open weight model" needs a caveat this week

Artificial Analysis's Intelligence Index is a composite score, and a model earning the top spot among open weight models two days after release deserves the same caution as any two day old benchmark claim: independent replication takes time, and a single lab's or evaluator's first pass at scoring a brand new release can shift as more evaluators run their own harnesses against it. VentureBeat's framing of MiMo V2.6 Pro as "better than DeepSeek" is accurate as a snapshot of this specific index at this specific moment, not a settled, multi source consensus the way DeepSeek's own standing has become over the past year of sustained production use.

The DeepSWE and Terminal Bench deltas are the more durable signal here, because they are release over release comparisons within Xiaomi's own model line rather than a claim about beating a competitor. A jump from 19.0 to 71.9 on DeepSWE is real regardless of how MiMo V2.6 Pro eventually settles relative to DeepSeek, Kimi, or GLM on independently replicated numbers over the coming weeks.

What this means for a real deployment decision

DeepSeek V4.1 Flash still has the stronger case for a production deployment today, for reasons that have nothing to do with the benchmark gap. It has weeks of real usage data, a mature hosting and quantization ecosystem, and known behavior under the kind of sustained, high volume agentic workloads that a benchmark suite does not fully capture. MiMo V2.6 Pro's numbers are genuinely impressive, but "impressive two day old benchmark" and "proven at your production scale" are different bars, and only one of them has been cleared yet.

Where MiMo V2.6 Pro is worth an immediate evaluation slot rather than a wait and see approach: teams already running expert offloading or distributed MoE inference on Apple Silicon or similar hardware for DeepSeek's large models, since the architecture and active parameter profile are close enough that existing infrastructure work likely transfers with modest changes. Teams with omnimodal requirements, image, speech, or video input alongside text, also have a more direct reason to test MiMo V2.6 Pro now, since that capability is native to the release rather than bolted on, and DeepSeek V4.1 Flash's roadmap does not currently prioritize the same multimodal breadth.

What to actually do this week

Run your own eval set against MiMo V2.6 Pro before making any claims about it internally, the same discipline that applies to any two day old release. Xiaomi's numbers are specific and dated, which is a good sign, but a specific number from a vendor announcement is still one data point.

If you are currently running DeepSeek V4 Pro or evaluating the switch to V4.1 Flash, treat MiMo V2.6 Pro as a second candidate in the same evaluation round rather than a reason to delay the DeepSeek decision you already had scheduled. The pricing and licensing profile of both models make them realistic same round candidates.

When this applies to your stack

If your infrastructure roadmap includes self hosting a large open weight MoE model for cost or data residency reasons, this week added a genuine second option to the DeepSeek line, not just a benchmark headline. The pricing, licensing, and native multimodal support make MiMo V2.6 Pro worth a real evaluation slot, alongside the honest caveat that its benchmark standing is two days old and not yet independently settled.

Contra Collective helps teams evaluate and deploy open weight model infrastructure, from initial benchmarking against real workloads through production hosting decisions. If MiMo V2.6 or a DeepSeek V4.1 Flash migration is on your evaluation list this quarter, that comparison is worth running properly rather than off a single index score.

FAQ

Is MiMo V2.6 Pro actually better than DeepSeek V4.1 Flash? On the Artificial Analysis Intelligence Index as of the September 22, 2026 release, MiMo V2.6 Pro scores higher among open weight models. DeepSeek V4.1 Flash has significantly more production usage history, which matters for a real deployment decision beyond the benchmark number.

What license is MiMo V2.6 released under? MIT license, for both the Pro and Flash tiers.

How large is MiMo V2.6 Pro? 1.02 trillion total parameters with 42 billion active parameters per token, using a Mixture of Experts architecture, with a 1 million token context window.

Can MiMo V2.6 Pro handle images and audio, not just text? Yes. It is natively omnimodal, accepting text, image, speech, and video as input, with text output.

Should I switch from DeepSeek to MiMo V2.6 Pro right now? Not without running your own evaluation first. The benchmark gains are real release over release numbers from Xiaomi, but independent, multi source verification of MiMo V2.6 Pro's standing relative to DeepSeek takes longer than two days to settle.

[ 02 ] — Keep Reading

More from the lab.

Oct 6, 2026 AI Infrastructure

vLLM vs SGLang: Choosing a Production LLM Inference Engine in Late 2026

vLLM and SGLang are both open source, both built to serve LLMs at production scale, and both frequently recommended for the exact same job, which is exactly why teams keep picking the wrong one. The real difference is not a benchmark number. It is which attention and caching architecture matches your actual traffic pattern, and most teams never check that before they commit infrastructure budget to one or the other.

Oct 4, 2026 AI Infrastructure

Ollama's MLX Backend Beats Metal by 93 Percent: Apple Silicon Local Inference Tested (October 2026)

Ollama's 0.19 release notes say it plainly: on Apple Silicon, Ollama is now built on top of Apple's MLX framework to take advantage of its unified memory architecture, rather than the Metal backed llama.cpp path it shipped for years. On an M4 Max running Qwen3.5, that swap took decode speed from 57.8 tokens per second to 111.4, a 93 percent improvement, and prefill from 1,154 to 1,810 tokens per second. The catch is in the fine print: the MLX runner is in preview, it needs 32GB or more of unified memory to activate at all, and as of this release it only accelerates one model family. Here is what actually changed, what it costs to turn on, and where it still falls back silently to the slower path.

Oct 3, 2026 AI Infrastructure

DGX Spark vs Mac Studio M5 Ultra: Local LLM Inference Benchmarked (October 2026)

The M5 Ultra Mac Studio shipping in September 2026 is a quad die chip with 1.2 terabytes per second of memory bandwidth and up to 256GB of unified memory, with a 512GB configuration arriving in late October. Against a single NVIDIA DGX Spark, it is not close: on a 27B dense model, the Mac decodes at roughly four times the speed. Cluster two DGX Spark units together over NVIDIA's GX10 networking instead, and the comparison flips for a different workload entirely, concurrent multi user serving. Neither machine is the right answer for every workload, and the decision comes down to whether you are serving one user or several at once.

Ready when you are

Want to discuss this topic?

Start a Conversation