From the Lab Page 30 / 46

Insights, engineered.

Technical deep-dives, AI strategy, and engineering perspectives from the team building autonomous systems.

Jun 16, 2026 AI Models

Claude Haiku 4.5 vs Gemini 3.1 Flash vs GPT-5.5 Mini: Cheap Tier Tested (2026)

The cheap tier matters more than the frontier for most production AI workloads. Most tokens shipped are classification, extraction, and tool routing tasks that frontier models overpay for. Here is a three way head to head on Haiku 4.5, Gemini 3.1 Flash, and GPT-5.5 Mini for the workloads they actually run.

Jun 16, 2026 AI Infrastructure

mlx-lm vs llama.cpp on M5 Max: Prefill, Decode, and Batch Scaling for 70B (2026)

Most Apple Silicon benchmarks publish a single decode number on an 8B model and stop. The interesting question for a real backend is what prefill, decode, and batch scaling look like on a 70B model under the runtimes you would actually ship: mlx-lm and llama.cpp. We tested both on M5 Max.

Jun 16, 2026 Headless Commerce

PostHog vs Amplitude for Shopify Hydrogen: Headless Analytics Compared (2026)

Most Shopify Hydrogen storefronts ship analytics late and ship it wrong. Pixel based tracking breaks under server side rendering, GA4 misses half the conversion events, and the team ends up rebuilding the funnel after launch. PostHog and Amplitude are the two product analytics platforms most enterprise headless teams pick between in 2026.

Jun 15, 2026 AI Infrastructure

Apple Silicon Sustained LLM Throughput: M4 Pro vs M5 Pro vs M5 Max Thermal Tested (2026)

Every Apple Silicon local inference benchmark you have read runs for 30 seconds and quotes a peak number. Real backends serve requests for hours. We ran MLX and llama.cpp on M4 Pro, M5 Pro, and M5 Max for four hour continuous load tests and measured what the sustained token rate actually is once the SoC settles into its thermal envelope.

Jun 15, 2026 AI Models

Claude Code vs Cursor vs Windsurf: Agentic IDE Tested on Real PRs (2026)

Claude Code, Cursor, and Windsurf each represent a different bet on how an AI coding tool should work. We tested all three on 40 real pull requests across a TypeScript monorepo, a Python service, and a Flutter app. Here is which one finished the work, which one stalled, and what the per task cost actually was.

Jun 15, 2026 Headless Commerce

Cloudinary vs Imgix vs Shopify CDN: Image Infrastructure for Headless Commerce (2026)

Image performance is the single biggest lever for Core Web Vitals on a headless commerce storefront. The CDN you pick determines whether you ship a 2 second LCP or a 4 second one, and the cost difference between Cloudinary, Imgix, and Shopify's built in CDN is bigger than most architecture teams realize.

Jun 14, 2026 AI Models

Claude Opus 4.8 vs GPT-5.5 vs Gemini 3.1 Pro: Agentic Coding Benchmarks Tested (2026)

The three frontier models that actually ship code in production agentic loops are Claude Opus 4.8, GPT-5.5, and Gemini 3.1 Pro. Pairwise comparisons get traffic but lie about how engineering teams pick. Here is a three-way head to head on benchmarks that matter, plus the latency and cost numbers that move the decision.