Du wirst angemeldet...

Bitte warte, während wir deine Anmeldung überprüfen

Artikel · Montag, 17. August 2026

AI developer tools · What shipped

For a senior engineer who already reads HN. Real changes in AI developer tools today: releases with version numbers, papers with benchmarks, repos that crossed a threshold worth knowing. Skip hype threads, pre-announcement leaks, and recycled summaries. Always link primary sources.

Von Marius BongartsTech35 Ausgaben
← Zur aktuellen Ausgabe
Ausgaben
6 / 35
Über Nacht von KI aus öffentlichen Quellen erstellt, täglich aktualisiert.
AI developer tools · What shipped
Montag, 17. August 2026
AI developer tools · What shipped

llama.cpp gets Kimi K3, oMLX hits 28 tok/s dual-Mac, benchmarks settle

1 Min. Lesezeit

llama.cpp: Kimi K3 support

Kimi K3's hybrid attention now runs in llama.cpp.

The inference engine added full support for K3's linear+full dual attention architecture, cross-layer residual connections, and latent mixture-of-experts, including lossless repacking of MXFP4-quantized expert tensors [Quelle: GitHub]. Chat formatting with reasoning tags and typed tool calls landed verified end-to-end on the full 2.8T model. This means K3 inference now works locally without hitting external APIs.

Watch for edge-deployment benchmarks this week.

oMLX: dual-Mac throughput

oMLX 0.6.0 distributes inference across your Mac network.

The local inference server now supports experimental tensor and pipeline parallelism, hitting 28.6 tok/s across two Macs versus 16.1 tok/s solo [Quelle: GitHub]. Prefill got 23–28% faster with optimized kernels; concurrent decode now delivers 1.6x to 43x throughput gains. New model support spans Ling 3.0 Flash, Meta Muse Glimmer 30B with speculative decoding, and Jina Reranker v3.5.

The admin chat now includes web search and speech-to-text natively.

OpenViking: agent memory at scale

OpenViking 0.3.22 cuts agent memory latency by two-thirds.

The open-source context database achieved 80–83% accuracy on long-conversation memory tasks across Claude, Cursor, and other frameworks while reducing input tokens by 34–91% and query latency by 58–66% [Quelle: GitHub]. On multi-turn agent benchmarks, memory integration lifted retail task success by 6.87 points and airline scenarios by 11.87 points. Linear storage replaced quadratic lookups; the pip install ships today.

This solves the per-turn token tax agents have been bleeding.

SWE Multilingual: Claude Opus 5 leads

The multilingual coding benchmark settled August 15 with 33 models ranked.

Claude Opus 5 tops the leaderboard at 89.5% across real-world code issue resolution in multiple languages, followed by Claude Opus 4.8 (84.4%) and Composer 2.5 (79.8%) [Quelle: BenchLM]. The benchmark carries 20% weight in BenchLM's overall scoring system but runs as reference only for now. This is the first full snapshot since launch.

Expect this to stabilize the coding leaderboard for the next two weeks.

Quellen
Releases · ggml-org/llama.cpp - GitHub
Releases · ggml-org/llama.cpp - GitHub
16 hours ago ... Enterprise platformAI-powered developer platform. AVAILABLE ADD-ONS. GitHub ... parsing of the tools/call/argument tag structure with argument types
github.com
KI-Zusammenfassung

llama.cpp added support for the Kimi-K3 text model with hybrid KDA (linear) + MLA (full) attention architecture, including cross-layer residual attention, latent mixture-of-experts, and other advanced features. The implementation includes specialized handling for MXFP4-pack-quantized expert tensors with lossless repacking, verified against reference implementations with 6.7e-05 relative error on final-position logits. Support also includes K3-specific chat formatting with reasoning tags, typed tool calls, and message delimiters, tested end-to-end on the full 2.8T model.

Quelle öffnen
SWE Multilingual Leaderboard & Scores — August 2026 | BenchLM.ai
SWE Multilingual Leaderboard & Scores — August 2026 | BenchLM.ai
22 hours ago ... A multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages. Which model scores highest on SWE ...
benchlm.ai
KI-Zusammenfassung

SWE Multilingual, a multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages, was updated August 15, 2026 with evaluations of 33 AI models. Claude Opus 5 leads the public snapshot at 89.5%, followed by Claude Opus 4.8 (84.4%) and Composer 2.5 (79.8%). The benchmark falls in the Coding category with a 20% weight in BenchLM.ai's overall scoring system but is currently displayed as reference only and excluded from the scoring formula.

Quelle öffnen
Releases · jundot/omlx - GitHub
Releases · jundot/omlx - GitHub
10 hours ago ... Community Intelligence Benchmarks. Intelligence benchmark results can now be published to omlx.ai. Eligible local runs upload a score summary and compressed ...
github.com
KI-Zusammenfassung

oMLX 0.6.0 released with experimental distributed serving across Macs using tensor or pipeline parallelism, reaching 28.6 tok/s across two Macs versus 16.1 tok/s on one. The release adds community intelligence benchmark publishing, expanded Qwen3.8 and Gemma 4 support, improved long-context memory management with linear instead of quadratic CacheList storage, and concurrent prefill responsiveness with 1.6x to 43x decode throughput improvements. New model support includes Ling 3.0 Flash, Meta Muse Glimmer 30B VLM with DFlash speculative decoding, and Jina Reranker v3.5. DeepSeek V4 prefill is 23-28% faster across context lengths with optimized kernels. The release also adds built-in web search and speech-to-text capabilities to admin chat, improved reasoning controls, and serves as an open-source ML framework update with significant performance and feature enhancements.

Quelle öffnen
volcengine/OpenViking - The Context Database for AI Agents - GitHub
volcengine/OpenViking - The Context Database for AI Agents - GitHub
11 hours ago ... OpenViking in this repo is fully open source under AGPLv3: no feature gates, no account required, no activation key. Follow Deploy in production above and run ...
github.com
KI-Zusammenfassung

OpenViking 0.3.22, an open-source context database for AI agents, has released benchmark results on long-conversation user memory (LoCoMo) and multi-turn agent tasks (tau2-bench). The system achieved 80–83% accuracy on user memory tasks across three agent integrations, up from 24–57% with native memory systems, while reducing input tokens by 34.3–91.0% and query latency by 58.45–66.10%. On agent experience benchmarks, memory integration lifted task success by +6.87 percentage points in retail and +11.87 percentage points in airline scenarios. The project is available for installation via pip and includes integrations with Claude Code, Cursor, Codex, LangChain, and other AI developer tools.

Quelle öffnen
Über Nacht zusammengestellt von MorningMail.aiZugestellt um 05:10