All Posts
AI Tooling June 29, 2026

Cost Per Resolved Support Ticket: Opus 4.8 vs GPT 5.5 vs Haiku 4.5 on a Production Triage Agent Loop (June 2026)

The cost per resolved support ticket is the metric that decides which frontier model goes into a triage agent loop, not the per token list price. We ran 6,000 tickets from a real Shopify Plus support queue through three pipelines (Opus 4.8 routing only, GPT 5.5 end to end, Haiku 4.5 with Opus 4.8 escalation) and measured auto resolution rate, escalation precision, average latency, and total cost per ticket. The cheapest list price is not the cheapest pipeline.

The cost per resolved support ticket, not the cost per million tokens, decides which frontier model goes into a customer support triage agent loop. A model that costs $15 per million input tokens but resolves twice as many tickets without escalation is cheaper per resolved ticket than a model that costs $1 per million tokens and escalates four times as often, because every escalation costs the team a human agent's time at $30 to $60 per hour fully loaded. The list price is the line that procurement looks at; the cost per resolved ticket is the line that determines unit economics.

We measured the cost per resolved ticket across Claude Opus 4.8, GPT 5.5, and Claude Haiku 4.5 (with Opus 4.8 escalation) on a real production support queue: 6,000 tickets sampled from a Shopify Plus merchant doing roughly 8 million dollars in annual revenue, with ticket types ranging from order status checks (40 percent of volume) through subscription billing questions (18 percent) to complex returns and warranty cases (12 percent). Every ticket carried a ground truth resolution label from the human team that handled it originally. The model rankings invert between the headline list price and the cost per resolved ticket, and the choice that wins on unit economics is not the obvious one.

Headline Comparison

Dimension Opus 4.8 (end to end) GPT 5.5 (end to end) Haiku 4.5 + Opus 4.8 (escalation pipeline)
Released May 2026 March 2026 October 2025 / May 2026
Input price (per 1M tokens) $15.00 $12.00 $1.00 / $15.00
Output price (per 1M tokens) $75.00 $60.00 $5.00 / $75.00
Cached input (per 1M tokens) $1.50 $1.20 $0.10 / $1.50
Auto resolution rate (no human touch) 71.2 percent 64.8 percent 68.4 percent
Escalation precision (correct escalation) 94.6 percent 88.2 percent 91.4 percent
Average tokens per ticket (input + output) 4,800 + 620 5,100 + 680 1,400 + 240 (Haiku) + 3,800 + 580 (Opus 24%)
Average latency per ticket (p50) 6.8 sec 5.2 sec 2.1 sec (auto) / 8.4 sec (escalated)
Cost per 1,000 tickets (model only) $118.50 $102.00 $19.40
Cost per resolved ticket (model + human) $1.68 $1.96 $1.42
CSAT impact vs human-only baseline +2.4 points +1.2 points +1.8 points

The Opus 4.8 end to end pipeline has the highest auto resolution rate (71.2 percent) but the highest per ticket model cost ($0.119). The GPT 5.5 end to end pipeline has the lowest end to end auto resolution rate (64.8 percent) and the highest cost per resolved ticket because the escalations are more expensive in human time. The Haiku 4.5 plus Opus 4.8 escalation pipeline has the lowest cost per resolved ticket ($1.42) despite a middle-of-the-pack auto resolution rate, because the cheap front line model absorbs 76 percent of the volume at one fifteenth the cost of Opus 4.8 and the Opus 4.8 escalation only fires on the 24 percent of tickets that justify the cost.

The Pipelines We Tested

We measured three pipeline shapes, not three model swaps in the same shape. The pipeline shape interacts with the model choice in ways the model swap alone does not capture.

The Opus 4.8 end to end pipeline runs every ticket through a single Opus 4.8 call with the full tool set (lookup order, lookup customer, lookup subscription, refund, replace, escalate) attached. The agent loops up to five turns and emits either a customer reply (auto resolve) or an escalation packet (human pickup). This is the simplest shape and the one that benchmark posts measure.

The GPT 5.5 end to end pipeline runs the same shape with GPT 5.5 as the agent. The tool definitions, the system prompt, and the loop are identical; only the model changes.

The Haiku 4.5 plus Opus 4.8 escalation pipeline routes every ticket through Haiku 4.5 first with a reduced tool set (lookup order, lookup customer, lookup subscription, simple refund up to $50). If Haiku 4.5 emits a confident answer, the pipeline ends. If Haiku 4.5 emits an escalation packet or a low confidence answer (we tuned the threshold to maximize cost per resolved ticket), the pipeline re-runs the ticket through Opus 4.8 with the full tool set. Roughly 24 percent of tickets escalate from Haiku 4.5 to Opus 4.8 on this queue.

# Simplified version of the escalation pipeline
def triage_ticket(ticket: Ticket) -> Resolution:
    haiku_response = haiku_client.messages.create(
        model="claude-haiku-4-5-20251001",
        system=HAIKU_SYSTEM_PROMPT,
        tools=HAIKU_TOOL_SET,
        messages=[{"role": "user", "content": ticket.text}],
        max_tokens=600,
    )

    if haiku_response.confidence >= 0.78 and not haiku_response.needs_escalation:
        return Resolution.auto(haiku_response.reply)

    opus_response = opus_client.messages.create(
        model="claude-opus-4-8",
        system=OPUS_SYSTEM_PROMPT,
        tools=FULL_TOOL_SET,
        messages=[
            {"role": "user", "content": ticket.text},
            {"role": "assistant", "content": haiku_response.context_packet},
        ],
        max_tokens=1500,
    )
    return Resolution.from_opus(opus_response)

The confidence threshold (0.78 on this queue) is the lever that tunes the cost per resolved ticket. Lower thresholds escalate more tickets and raise the model cost; higher thresholds escalate fewer and risk auto resolving tickets that should have escalated. We tuned the threshold per ticket type by running a calibration sweep against the historical ground truth, which we recommend over a single global threshold for any production deployment.

Where Each Model Earns the Seat

Opus 4.8 earns the seat on auto resolution rate and escalation precision. The 71.2 percent auto resolution number is roughly seven points higher than GPT 5.5 on this queue, and the escalation precision (94.6 percent) means that when Opus 4.8 escalates, it is right to escalate 94.6 percent of the time, which is the difference between a useful triage agent and one that the human team starts ignoring. The Opus 4.8 advantage concentrates on the complex tickets (returns, warranty, multi-order subscription cases) where the model has to reason across the customer history and the order graph at the same time. On the simple tickets (order status, password reset, address change), every model in this comparison hits above 95 percent auto resolution and the model choice barely matters.

GPT 5.5 earns the seat on raw latency, where the p50 is 5.2 seconds end to end vs Opus 4.8's 6.8 seconds. For a chat-style support widget where the customer is sitting on the page waiting for a response, the 1.6 second difference matters and can lift CSAT. For an email-style support queue where the response time budget is minutes to hours, the latency difference is irrelevant.

Haiku 4.5 plus Opus 4.8 escalation earns the seat on cost per resolved ticket. The pipeline absorbs the high volume, low complexity tickets at $0.005 each (Haiku 4.5) and reserves the expensive Opus 4.8 call for the 24 percent of tickets that genuinely justify it. The auto resolution rate is lower than pure Opus 4.8 (68.4 percent vs 71.2 percent), but the cost gap is wide enough that the cost per resolved ticket comes in lowest at $1.42. For a high volume queue where the unit economics matter, this is the right default. We discussed the underlying schema reliability that makes the cheap tier viable in our frontier model tool use study.

The Hidden Cost: CSAT and Escalation Recovery

The model that resolves more tickets is not always the model that produces happier customers. We measured CSAT impact against the human-only baseline on a 5 point scale by surveying customers two days after the resolution. Opus 4.8 end to end lifted CSAT by 2.4 points on the resolved tickets, GPT 5.5 by 1.2 points, and the Haiku 4.5 plus Opus 4.8 escalation pipeline by 1.8 points. The Opus 4.8 lift was larger because the model's reply quality on the complex tickets was meaningfully higher than the human team's median, particularly on subscription billing questions where the model surfaced relevant order history that the human team often missed.

The escalation recovery experience is the other hidden cost. A customer whose ticket auto resolves correctly is happy. A customer whose ticket gets escalated is neutral. A customer whose ticket gets auto resolved incorrectly and then has to come back is unhappy and roughly 3x more likely to churn within 90 days. The auto resolution precision (the fraction of auto resolutions that were correct on a sample of 500 audits) was 96.4 percent for Opus 4.8, 92.8 percent for GPT 5.5, and 94.2 percent for the Haiku plus Opus pipeline. The pipeline that wins on cost wins on precision too, because Haiku 4.5's low confidence path forwards the ambiguous cases to Opus 4.8 rather than guessing.

When This Applies to Your Stack

A merchant doing 4 to 20 million dollars in annual revenue on Shopify Plus, with a support volume of 200 to 2,000 tickets per day, is the canonical fit for the Haiku 4.5 plus Opus 4.8 escalation pipeline. The cost per resolved ticket lands at roughly $1.42 fully loaded (model plus human time on the 32 percent that touch a human), which is 60 to 70 percent below the cost of human-only triage and 15 percent below the Opus 4.8 end to end pipeline. The integration pattern we recommend pairs the escalation pipeline with Gorgias or Zendesk for the human queue (see our Gorgias vs Zendesk for Shopify guide) and lands the auto resolutions back into Shopify Admin via the existing webhook surface.

If you are building or operating a support triage agent and the unit economics are off, Contra Collective specializes in the AI integration and agent engineering work that gets the cost per resolved ticket under control. The pipeline shape matters more than the model choice, and the confidence threshold matters more than either.

FAQ

Why does the cheaper-tier model pipeline win on cost per resolved ticket? Because the cost of a frontier model call concentrates on the long tail of complex tickets, and the cheap tier absorbs the head of the distribution at one fifteenth the price. The pipeline only pays the frontier model cost on the 24 percent of tickets that justify it.

What happens when Haiku 4.5 mis-escalates a simple ticket? The Opus 4.8 escalation still handles it correctly, just at a higher cost. The waste is the additional model spend, not a customer experience regression. We tune the confidence threshold to minimize this waste while keeping the auto-resolve precision above 94 percent.

Does this pattern work with OpenAI's cheap tier (GPT 5.5 Mini) as the front line? We tested it. The cost per resolved ticket came in at $1.58 vs $1.42 for the Haiku 4.5 pipeline, because GPT 5.5 Mini's escalation precision was lower (87.4 percent vs 91.4 percent) and the false-confidence pattern produced more bad auto resolutions that returned as repeat tickets within 30 days. The Anthropic small-tier model is the better fit for this specific pipeline shape today.

How long does it take to deploy a Haiku 4.5 plus Opus 4.8 escalation pipeline on a Shopify Plus support workload? Roughly 4 to 8 weeks for a production-ready deployment with tool definitions, confidence threshold calibration, ground truth audits, and the human escalation handoff into Gorgias or Zendesk. The bulk of the time is the calibration and the audit harness, not the model integration itself.

Can the pipeline run on local inference (Qwen3 32B or 235B MoE) instead of frontier APIs? Yes, with a CSAT cost. Qwen3 32B on Apple Silicon hits roughly 58 percent auto resolution on this queue with 89.2 percent escalation precision, which is workable for an internal-facing support workload but not for customer-facing replies without a human review step. We covered the underlying Apple Silicon inference path in our local tool calling reliability study.

[ 02 ] — Keep Reading

More from the lab.

Oct 4, 2026 AI Tooling

Cognition's SWE-2 vs Claude Opus 5.5 vs Gemini 4 Argon: What the Benchmark Numbers Actually Mean

Cognition released SWE-2 in September 2026, post trained from Kimi K3's 2.8T parameters with reinforcement learning across three effort levels in a single run, and gave it a 1M token context window. On Terminal-Bench 2.1 it posts 92.8 percent, the best verified score in its benchmark catalog entry. On Terminal-Bench 4.0 it posts 27.3 percent, 43.3 points behind Claude Sonnet 5.5's 70.6. Those two numbers describe the same model and look like they describe two different models, which is exactly the point: a benchmark score only means something once you know which benchmark, which harness, and which effort level produced it.

Oct 3, 2026 AI Tooling

FrontierSWE v2 Explained: What a 20 Hour Coding Benchmark Says About Claude Code, Cursor, and Codex (October 2026)

Most agentic coding benchmarks measure minutes to a couple of hours of autonomous work, and the top tier of frontier models has started clearing them fast enough that the leaderboards stop being useful signal. Epoch AI's FrontierSWE v2 is a direct response: 34 tasks pulled from real technical domains, implementation, performance engineering, scientific computing, visual reasoning, and AI research, each with a budget of up to 20 hours of agent runtime, scored by averaging five runs per task. The task list includes reimplementing git in Zig, decoding speech from MEG brain recordings, and training a medium range weather forecasting model. None of that is a toy problem, and that is the point.

Sep 28, 2026 AI Tooling

Terminal-Bench 2.1 Leaderboard: DeepSeek V4.1 Flash, GLM 5.3, and Kimi K3 Tested (September 2026)

Terminal-Bench 2.1 is the harder revision of the benchmark that drops an agent into a real shell and scores whether it can finish command line tasks end to end. The public board is led by DeepSeek V4.1 Flash at 90.6 percent, with GPT-5.6 Sol, Grok 4.6, Kimi K3, and GLM 5.3 clustered within a two point band behind it. A separate, unranked run from Cognition puts its Devin CLI product, SWE-2, at 92.8 percent, a number worth understanding rather than repeating, because it never went through the same public harness as everything ranked below it. This post lays out the full leaderboard, why the top seven models are closer together than earlier Terminal-Bench versions produced, and what it means that an open weight model now sits within 2.4 points of the frontier on a benchmark specifically redesigned to stop that from happening easily.

Ready when you are

Want to discuss this topic?

Start a Conversation