All Posts
AI Tooling August 23, 2026

Qwen3.8 Max vs GPT-5.6 Sol: Agentic Tool Calling and Function Use (2026)

On August 12, 2026 Alibaba did something no Max class Qwen had done before: it released the flagship as open weights, a 2.4 trillion parameter Mixture of Experts model that activates about 95 billion parameters per token, published as Qwen3.8-2.4T-A95B. The interesting number is not the parameter count, it is the agentic one. On OSWorld-Verified, the benchmark that scores a model driving a real computer through tools rather than answering a question, Qwen3.8 Max posts 86.1 and edges out GPT-5.6 Sol Max at 83.2. That is an open weight model you can download beating a closed frontier flagship on the exact skill agents are built around: reading state, choosing a tool, calling it correctly, and recovering when the call fails. This post reads that result honestly, separates what OSWorld measures from what function calling in your own agent needs, and lays out when the open model is the right call and when the closed one still earns its price.

Qwen3.8 Max vs GPT-5.6 Sol: Agentic Tool Calling and Function Use

Here is the comparison first, because that is the reason you are reading. The two models below are compared on the dimension that decides agent behavior, which is not raw knowledge but whether the model can drive tools through a multi step task and keep its footing.

Dimension Qwen3.8 Max GPT-5.6 Sol
Release Aug 3, 2026 (API), open weights Aug 12 July 2026
Weights Open, Qwen3.8-2.4T-A95B (custom license) Closed, API only
Architecture 2.4T Mixture of Experts, ~95B active per token Undisclosed, closed
Context window 1M tokens Large, undisclosed
OSWorld-Verified (agentic computer use) 86.1 83.2 (Sol Max)
Where it wins tool driven computer tasks, self hosting, cost control reasoning depth, ecosystem, managed reliability

Read the OSWorld row carefully, because it is the whole reason this comparison is worth writing. OSWorld-Verified drops a model into a real desktop environment and scores whether it can complete tasks by operating software: opening applications, clicking through state, calling tools, and checking its own work. It is closer to what your agent actually does than a knowledge quiz, and on it the downloadable open weight model scored higher than the closed flagship. For reference, Claude Fable 5 sits at 85.0 and Gemini 3.1 Pro at 76.2 on the same board, so Qwen3.8 Max is not squeaking past one competitor, it is at the top of a strong field.

What OSWorld-Verified actually measures, and what it does not

OSWorld-Verified rewards a specific competence: sustained, correct tool use across a task that has many steps and many chances to go wrong. A model that scores well can read the current state of an environment, pick the right action, format the tool call so the environment accepts it, read the result, and decide what to do next without losing the thread. That is exactly the loop an agent runs, so a high score is a real signal that the model will hold together inside your scaffold.

What it does not measure is your function schema. OSWorld uses its own action space. Your agent calls your tools, with your argument names, your enums, your required fields, and your error strings. A model can be excellent at operating a desktop and still stumble on a function you defined with three overlapping optional parameters and a validation rule that lives only in your head. Tool calling reliability is partly the model and partly the interface you hand it, which is the same lesson the three way function calling comparison landed on: the benchmark tells you the ceiling, your schema decides how close you get to it.

Why an open Mixture of Experts changes the calculation

Qwen3.8 Max is a sparse Mixture of Experts: 2.4 trillion parameters total, but only about 95 billion active on any given token. That sparsity is the reason a model this large is servable at all, because you pay compute for the active experts, not the full parameter bank, on each forward pass. The total size still has to be resident somewhere, so the memory footprint is real and large, but the per token compute is closer to a 95 billion parameter dense model than a 2.4 trillion one.

The strategic shift is that the flagship is downloadable. Every prior Max class Qwen lived behind the API. Now the top tier ships as weights, first as the full 2.4T-A95B checkpoint under a custom license and then as a smaller Qwen3.8-27B under Apache 2.0 for teams that want a permissive license and a footprint that fits ordinary hardware. That means the agentic score above belongs to a model you can run inside your own boundary, which matters for any workload where sending tool inputs and outputs to a third party API is a compliance problem rather than a convenience. The tradeoff is that you now own the serving, and a trillion parameter class MoE is not cheap to keep warm, which is the same accounting that governs any open weight self hosting decision.

Where GPT-5.6 Sol still earns its price

The open score is a genuine result, not a reason to switch everything. GPT-5.6 Sol carries advantages that do not show up in a single benchmark row. It is a managed endpoint with the reliability, rate handling, and safety tooling of a major provider, so you are not on the hook for uptime, scaling, or the operational tail of running a giant model yourself. Its reasoning depth on hard, unfamiliar problems is a real strength, and on tasks where the agent has to think its way out of a novel failure rather than execute a known tool sequence, that depth pays off. The closed model also sits inside a mature ecosystem of SDKs, structured output modes, and function calling primitives that are tested against millions of calls, which reduces the number of sharp edges you hit when wiring tools.

The honest framing is that OSWorld-Verified measures one axis and the two models are close on it, three points apart. Three points on an agentic benchmark is inside the range that a better scaffold, a cleaner tool schema, or a different retry policy can swing on its own. So the result does not say the open model is better at everything; it says the open model is now good enough at agentic tool use to be a serious option, and the decision moves from capability to economics and control.

The tool calling reliability that actually decides your agent

Once both models clear the capability bar, the thing that determines whether your agent works in production is tool calling reliability under your own conditions. Three failure modes matter more than the leaderboard. The first is argument correctness: does the model fill required fields, respect enums, and stop inventing parameters you never defined. The second is recovery: when a tool returns an error, does the model read it and adjust, or does it retry the same broken call until the budget runs out. The third is discipline on when to call at all, because an agent that reaches for a tool when it should answer directly, or answers directly when it should call a tool, fails in ways a benchmark rarely captures.

None of those are settled by OSWorld-Verified, and all of them are testable on your own tools in an afternoon. Build a small suite of your real functions, feed both models the same twenty tasks, and count malformed calls, wasted retries, and wrong tool selections. That local number decides more than the public one, the same way cost per resolved task on your own backlog decides more than a headline resolve rate. The public benchmark gets you to the shortlist; your schema and your tasks pick the winner.

When this applies to your stack

Use this comparison to answer one question: can an open weight model now carry the agentic tool use in my product. The OSWorld-Verified result says yes, Qwen3.8 Max is at the frontier on driving tools through multi step tasks, ahead of GPT-5.6 Sol Max on that specific board and open enough to run inside your own boundary. Pick Qwen3.8 Max when control, data residency, or serving cost at steady volume is the constraint, and when you have the platform to keep a large MoE warm. Pick GPT-5.6 Sol when you want a managed endpoint, deeper reasoning on unfamiliar problems, and a function calling ecosystem that has already absorbed the edge cases. Then validate on your own tools, because the three point gap on OSWorld is small enough that your schema and scaffold will move it either way.

Building the tool schemas, the recovery logic, and the evaluation that measures function calling reliability on your real functions, and the routing that sends the right task to the right model, is the AI integration and agent engineering work Contra Collective takes on when a team wants agents that hold together in production rather than in a demo. The leaderboard gives you a capable model on both sides. The engineering around the tools is where an agent earns its keep.

FAQ

Is Qwen3.8 Max really better than GPT-5.6 Sol at tool use? On OSWorld-Verified, the benchmark that scores driving a real computer through tools, Qwen3.8 Max posts 86.1 against GPT-5.6 Sol Max at 83.2, so on that specific agentic board the open model leads. The gap is three points, which is small enough that a better scaffold or a cleaner tool schema can close it, so treat it as evidence that the open model is at the frontier on agentic tool use, not proof it wins every task.

What does open weights actually give me here? It means you can download and run the flagship inside your own infrastructure rather than calling an API. For agents that pass sensitive tool inputs and outputs, that keeps the data inside your boundary and gives you control over serving and cost. The cost is that you now operate a 2.4 trillion parameter class Mixture of Experts, which needs serious memory to stay warm.

Does a high OSWorld score mean it will call my functions correctly? Not automatically. OSWorld uses its own action space; your agent uses your function schema. A model can be excellent at operating a desktop and still trip on a poorly specified tool with overlapping optional arguments. Test both models against your real functions before deciding.

Why is Qwen3.8 Max a 2.4T model that runs like a smaller one? Because it is a sparse Mixture of Experts. Only about 95 billion of the 2.4 trillion parameters are active per token, so the compute per forward pass is closer to a 95 billion parameter dense model. The full size still has to be resident in memory, so the footprint is large even though the per token compute is not.

Which should I choose for a production agent? Choose Qwen3.8 Max when control, data residency, or steady high volume serving cost is the deciding constraint and you can run a large MoE. Choose GPT-5.6 Sol when you want a managed endpoint, stronger reasoning on novel problems, and a battle tested function calling ecosystem. Validate on your own tool suite either way.

Benchmark figures reflect vendor and third party reporting as of August 2026, including OSWorld-Verified scores that come from differing harnesses; agentic results move with the scaffold, the tool schema, and the retry policy, so measure tool calling reliability on your own functions before committing an architecture.

[ 02 ] — Keep Reading

More from the lab.

Oct 4, 2026 AI Tooling

Cognition's SWE-2 vs Claude Opus 5.5 vs Gemini 4 Argon: What the Benchmark Numbers Actually Mean

Cognition released SWE-2 in September 2026, post trained from Kimi K3's 2.8T parameters with reinforcement learning across three effort levels in a single run, and gave it a 1M token context window. On Terminal-Bench 2.1 it posts 92.8 percent, the best verified score in its benchmark catalog entry. On Terminal-Bench 4.0 it posts 27.3 percent, 43.3 points behind Claude Sonnet 5.5's 70.6. Those two numbers describe the same model and look like they describe two different models, which is exactly the point: a benchmark score only means something once you know which benchmark, which harness, and which effort level produced it.

Oct 3, 2026 AI Tooling

FrontierSWE v2 Explained: What a 20 Hour Coding Benchmark Says About Claude Code, Cursor, and Codex (October 2026)

Most agentic coding benchmarks measure minutes to a couple of hours of autonomous work, and the top tier of frontier models has started clearing them fast enough that the leaderboards stop being useful signal. Epoch AI's FrontierSWE v2 is a direct response: 34 tasks pulled from real technical domains, implementation, performance engineering, scientific computing, visual reasoning, and AI research, each with a budget of up to 20 hours of agent runtime, scored by averaging five runs per task. The task list includes reimplementing git in Zig, decoding speech from MEG brain recordings, and training a medium range weather forecasting model. None of that is a toy problem, and that is the point.

Sep 28, 2026 AI Tooling

Terminal-Bench 2.1 Leaderboard: DeepSeek V4.1 Flash, GLM 5.3, and Kimi K3 Tested (September 2026)

Terminal-Bench 2.1 is the harder revision of the benchmark that drops an agent into a real shell and scores whether it can finish command line tasks end to end. The public board is led by DeepSeek V4.1 Flash at 90.6 percent, with GPT-5.6 Sol, Grok 4.6, Kimi K3, and GLM 5.3 clustered within a two point band behind it. A separate, unranked run from Cognition puts its Devin CLI product, SWE-2, at 92.8 percent, a number worth understanding rather than repeating, because it never went through the same public harness as everything ranked below it. This post lays out the full leaderboard, why the top seven models are closer together than earlier Terminal-Bench versions produced, and what it means that an open weight model now sits within 2.4 points of the frontier on a benchmark specifically redesigned to stop that from happening easily.

Ready when you are

Want to discuss this topic?

Start a Conversation