AI developer tools · What shipped
For a senior engineer who already reads HN. Real changes in AI developer tools today: releases with version numbers, papers with benchmarks, repos that crossed a threshold worth knowing. Skip hype threads, pre-announcement leaks, and recycled summaries. Always link primary sources.
llama.cpp gets Kimi K3, oMLX hits 28 tok/s dual-Mac, benchmarks settle
1 min read
llama.cpp: Kimi K3 support
Kimi K3's hybrid attention now runs in llama.cpp.
The inference engine added full support for K3's linear+full dual attention architecture, cross-layer residual connections, and latent mixture-of-experts, including lossless repacking of MXFP4-quantized expert tensors [Quelle: GitHub]. Chat formatting with reasoning tags and typed tool calls landed verified end-to-end on the full 2.8T model. This means K3 inference now works locally without hitting external APIs.
Watch for edge-deployment benchmarks this week.
oMLX: dual-Mac throughput
oMLX 0.6.0 distributes inference across your Mac network.
The local inference server now supports experimental tensor and pipeline parallelism, hitting 28.6 tok/s across two Macs versus 16.1 tok/s solo [Quelle: GitHub]. Prefill got 23–28% faster with optimized kernels; concurrent decode now delivers 1.6x to 43x throughput gains. New model support spans Ling 3.0 Flash, Meta Muse Glimmer 30B with speculative decoding, and Jina Reranker v3.5.
The admin chat now includes web search and speech-to-text natively.
OpenViking: agent memory at scale
OpenViking 0.3.22 cuts agent memory latency by two-thirds.
The open-source context database achieved 80–83% accuracy on long-conversation memory tasks across Claude, Cursor, and other frameworks while reducing input tokens by 34–91% and query latency by 58–66% [Quelle: GitHub]. On multi-turn agent benchmarks, memory integration lifted retail task success by 6.87 points and airline scenarios by 11.87 points. Linear storage replaced quadratic lookups; the pip install ships today.
This solves the per-turn token tax agents have been bleeding.
SWE Multilingual: Claude Opus 5 leads
The multilingual coding benchmark settled August 15 with 33 models ranked.
Claude Opus 5 tops the leaderboard at 89.5% across real-world code issue resolution in multiple languages, followed by Claude Opus 4.8 (84.4%) and Composer 2.5 (79.8%) [Quelle: BenchLM]. The benchmark carries 20% weight in BenchLM's overall scoring system but runs as reference only for now. This is the first full snapshot since launch.
Expect this to stabilize the coding leaderboard for the next two weeks.
Releases · ggml-org/llama.cpp - GitHub16 hours ago ... Enterprise platformAI-powered developer platform. AVAILABLE ADD-ONS. GitHub ... parsing of the tools/call/argument tag structure with argument typesgithub.com
llama.cpp added support for the Kimi-K3 text model with hybrid KDA (linear) + MLA (full) attention architecture, including cross-layer residual attention, latent mixture-of-experts, and other advanced features. The implementation includes specialized handling for MXFP4-pack-quantized expert tensors with lossless repacking, verified against reference implementations with 6.7e-05 relative error on final-position logits. Support also includes K3-specific chat formatting with reasoning tags, typed tool calls, and message delimiters, tested end-to-end on the full 2.8T model.
SWE Multilingual Leaderboard & Scores — August 2026 | BenchLM.ai22 hours ago ... A multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages. Which model scores highest on SWE ...benchlm.ai
SWE Multilingual, a multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages, was updated August 15, 2026 with evaluations of 33 AI models. Claude Opus 5 leads the public snapshot at 89.5%, followed by Claude Opus 4.8 (84.4%) and Composer 2.5 (79.8%). The benchmark falls in the Coding category with a 20% weight in BenchLM.ai's overall scoring system but is currently displayed as reference only and excluded from the scoring formula.
Releases · jundot/omlx - GitHub10 hours ago ... Community Intelligence Benchmarks. Intelligence benchmark results can now be published to omlx.ai. Eligible local runs upload a score summary and compressed ...github.com
oMLX 0.6.0 released with experimental distributed serving across Macs using tensor or pipeline parallelism, reaching 28.6 tok/s across two Macs versus 16.1 tok/s on one. The release adds community intelligence benchmark publishing, expanded Qwen3.8 and Gemma 4 support, improved long-context memory management with linear instead of quadratic CacheList storage, and concurrent prefill responsiveness with 1.6x to 43x decode throughput improvements. New model support includes Ling 3.0 Flash, Meta Muse Glimmer 30B VLM with DFlash speculative decoding, and Jina Reranker v3.5. DeepSeek V4 prefill is 23-28% faster across context lengths with optimized kernels. The release also adds built-in web search and speech-to-text capabilities to admin chat, improved reasoning controls, and serves as an open-source ML framework update with significant performance and feature enhancements.
volcengine/OpenViking - The Context Database for AI Agents - GitHub11 hours ago ... OpenViking in this repo is fully open source under AGPLv3: no feature gates, no account required, no activation key. Follow Deploy in production above and run ...github.com
OpenViking 0.3.22, an open-source context database for AI agents, has released benchmark results on long-conversation user memory (LoCoMo) and multi-turn agent tasks (tau2-bench). The system achieved 80–83% accuracy on user memory tasks across three agent integrations, up from 24–57% with native memory systems, while reducing input tokens by 34.3–91.0% and query latency by 58.45–66.10%. On agent experience benchmarks, memory integration lifted task success by +6.87 percentage points in retail and +11.87 percentage points in airline scenarios. The project is available for installation via pip and includes integrations with Claude Code, Cursor, Codex, LangChain, and other AI developer tools.