Signing you in...

Please wait while we verify your authentication

Article · Wednesday, October 14, 2026

AI developer tools · What shipped

For a senior engineer who already reads HN. Real changes in AI developer tools today: releases with version numbers, papers with benchmarks, repos that crossed a threshold worth knowing. Skip hype threads, pre-announcement leaks, and recycled summaries. Always link primary sources.

By Marius BongartsTech96 editions
← See today's latest
Editions
9 / 96
Generated by AI overnight from public sources, refreshed daily.
AI developer tools · What shipped
Wednesday, October 14, 2026
AI developer tools · What shipped

Gemini 4 Argon ships; Haiku 5.5 and Liquid LFMs benchmarked

1 min read

Gemini 4 Argon

Google's frontier model is now live on API.

Gemini 4 Argon ranks first on the Vals Index across finance, coding, legal, and tax work, with 108,000 tokens per second inference speed via vLLM and a 1M token context window [Quelle: Google Blog]. Real-world wins include Chrome architecture refactoring completed in weeks and cybersecurity vulnerability discovery. Introductory pricing: $2 per million input tokens, $10 per million output.

Benchmark dominance on vertical tasks starts the next cost-and-speed round.

Liquid Foundation Models

Efficiency-first models ship for edge and cloud.

Liquid AI released Liquid Foundation Models (LFMs) optimized for GPUs, CPUs, and NPUs across wearables, phones, and cloud infrastructure, with millisecond latency and purpose-built decision models for classification tasks [Quelle: Liquid AI]. All models are free to download, run, and fine-tune commercially until companies hit $10M annual revenue. The lineup spans text, vision, audio, and nano variants.

On-device inference just got a commercial playbook.

AWS MoE kernel optimization

Three kernel tweaks cut MoE inference latency by 10%.

AWS published mixture-of-experts optimizations for SageMaker AI targeting Hopper GPU architecture: Swap-AB for WGMMA utilization (2–4% throughput gain, upstreamed to vLLM 0.24.0+), FP8 tensor quantization backend routing (10% gains in AWS LMI v28), and Triton JIT recompilation elimination (9% faster time-to-first-token) [Quelle: AWS Blog]. Combined effect reaches 10% higher throughput and 9% faster TTFT on multi-GPU sparse-model inference.

MoE serving just stopped being a throughput wall.

Claude Haiku 5.5 tiers

Five variants trade intelligence, speed, and cost explicitly.

Following yesterday's full benchmark, Artificial Analysis now publishes all five Haiku 5.5 flavors on the Intelligence Index: Max hits 43 intelligence at 237 tokens/sec, while Low offers $0.02 per task at 9.21s time-to-first-token [Quelle: Artificial Analysis]. Pricing spreads 8.7× across the family, letting teams pick their exact speed-versus-cost tradeoff without guessing at internal model variants.

Fast inference just became a commodity selector, not a binary choice.

Sources
Gemini 4 Argon: Built to solve your hardest problems - Google Blog
Gemini 4 Argon: Built to solve your hardest problems - Google Blog
13 hours ago ... ... AI Ultra and Pro subscribers in the Gemini app and AI Mode in Search. ... Across our benchmarks, Gemini outperformed every model we tested — cutting ...
blog.google
AI Summary

Gemini 4 Argon, Google's latest frontier model, is now globally available via API and multiple platforms. The model ranks #1 on the Vals Index benchmark across critical economic sectors including finance, coding, legal, and tax work. Key performance achievements include a 2.85x end-to-end inference speedup on Gemma 4 E2B via vLLM (reaching 108,000 tokens per second), 40% reduction in Python codebase session prep time, 2.3x speedup on quantum chemistry package xTB, and 87% score on the Embodied Reasoning benchmark. The model excels at complex tasks across coding, finance, legal, cybersecurity, and science domains, with demonstrated applications including Chrome architecture refactoring completed in weeks, Google's Agent Development Kit performance optimization, and real-world cybersecurity vulnerability discovery. Argon offers a 1M token context window via the Gemini API at introductory pricing of $2 per million input tokens and $10 per million output tokens.

Visit source
Claude Haiku 5.5: Release Intelligence, Performance & Price
Claude Haiku 5.5: Release Intelligence, Performance & Price
4 hours ago ... The Claude Haiku 5.5 release offers 5 models, each with different intelligence, performance ... AI Agents · Evaluations. Products. Optima · MicroEvals · Model ...
artificialanalysis.ai
AI Summary

Claude Haiku 5.5 was benchmarked on Artificial Analysis Intelligence Index v4.3.2, which incorporates 10 evaluations including AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, and AA-LCR v1.1. The model was evaluated across capability indexes for finance & accounting, strategy & ops, legal, healthcare & medical, engineering, and economics, with performance metrics covering intelligence scores, cost per task, and output speed in tokens per second.

Visit source
Liquid Foundation Models
Liquid Foundation Models
3 hours ago ... Local AI. GGUF, MLX, and ONNX builds run on laptops, phones, and edge boxes with no key. Ollama · llama.cpp · LM Studio · Hugging Face · On-device benchmarks ...
liquid.ai
AI Summary

Liquid AI has released Liquid Foundation Models (LFMs) designed for efficient inference across diverse hardware including GPUs, CPUs, and NPUs, from edge devices like wearables and phones to cloud infrastructure. The models emphasize speed, memory efficiency, and millisecond latency, with purpose-built decision models for classification and routing tasks. All LFMs are available free to download, run, and fine-tune commercially until companies reach $10M in annual revenue.

Visit source
Mixture-of-Experts kernel engineering on Amazon SageMaker AI
Mixture-of-Experts kernel engineering on Amazon SageMaker AI
14 hours ago ... Sadaf Fardeen. Sadaf is the SDM of Inference optimization charter for SageMaker, HyperPod and Amazon Bedrock. Her team develops GPU performance optimizations ...
aws.amazon.com
AI Summary

AWS published kernel engineering optimizations for Mixture-of-Experts (MoE) models on Amazon SageMaker AI, focusing on improving LLM inference performance. Three key optimizations were implemented: Swap-AB for WGMMA utilization, which transposes matrices to better align with Hopper GPU architecture and achieved 2-4 percent throughput improvement (upstreamed to vLLM 0.24.0+); backend routing for FP8 tensor quantization, which directs FP8-quantized models to the Triton backend instead of CUTLASS for 10 percent throughput gains (available in AWS LMI v28 container); and Triton JIT recompilation elimination, which removes unnecessary kernel recompilations by adding do_not_specialize annotations to variable-length parameters, yielding 9 percent faster time-to-first-token (TTFT) on multi-GPU setups (upstreamed to vLLM 0.22.0+). Combined, these optimizations deliver up to 10 percent higher throughput and 9 percent faster TTFT for MoE model inference.

Visit source
Compiled overnight by MorningMail.aiDelivered at 05:10 AM