AI developer tools · What shipped
For a senior engineer who already reads HN. Real changes in AI developer tools today: releases with version numbers, papers with benchmarks, repos that crossed a threshold worth knowing. Skip hype threads, pre-announcement leaks, and recycled summaries. Always link primary sources.
Claude Fable 5 leads again, coding agents shift to iterative eval
1 Min. Lesezeit
Fable 5 benchmark dominance
Anthropic's lead just got harder to shake.
Claude Fable 5 now scores 161 on Epoch's Capabilities Index, a single point ahead of GPT-5.5 Pro—and the margin matters less than the pattern [Quelle: Epoch AI]. Epoch expanded the index to include seven new evaluations drawn from 13 fresh benchmarks added this month, covering agentic work, cybersecurity, algorithm engineering, forecasting, and research-level physics. The evaluation surface keeps widening, and Fable 5 leads across the refresh.
Watch whether this reflects actual production preference or benchmark gaming.
EvoPolicyGym: iterative agent testing
Code agents are now measured by their learning speed, not one-shot output.
Researchers released EvoPolicyGym, a benchmark that scores agents on autonomous policy refinement over 16 environments with strict feedback budgets and held-out validation cases [Quelle: LetsDataScience]. GPT-5.5 ranked strongest across the Core-16 suite. The GitHub repository includes adapters for Claude Code and other agent CLIs, making it portable across stacks and emphasizing exploration-exploitation tradeoffs over raw generation speed.
This pattern—feedback loops over snapshots—signals how real agent deployment is measured.
Transformers v5.13.0 ships 8 new models
Hugging Face released a wave of specialized coding and multimodal models.
Transformers v5.13.0 added Kimi 2.5-2.7 (multimodal agentic with Rust, Go, Python), MiMo-V2-Flash (27T-token MoE with 256K context), Nemotron 3.5 ASR (600M multilingual speech), Qwen3 ASR, ZAYA1 (760M/8.4B MoE), VideoPrism (31/33 benchmark wins), RADIO (NVIDIA distilled vision), and MiniCPM3 (4B beating 7B-9B models) [Quelle: GitHub]. Breaking changes standardize layer declarations for ONNX and torch.export compatibility. The release signals consolidation: agentic capabilities, long-context MoE, and cross-modal perception in library-ready form.
DeepSeek V4 Flash now leads real-world coding usage on OpenRouter at 5.46T tokens.
Data on AI Capabilities and Benchmarking - Epoch AI9 hours ago ... Our database of benchmark results, featuring the performance of leading AI models on challenging tasks. It includes results from benchmarks evaluated ...epoch.ai
Claude Fable 5 achieved a new high score of 161 on the Epoch Capabilities Index, surpassing GPT-5.5 Pro by 1 point and marking the first time Anthropic has led the index in over a year. Epoch AI recently expanded its benchmarking hub by tracking 13 new evaluations, with 7 incorporated into the Capabilities Index, while also adding nine external benchmarks covering agentic work, cybersecurity, algorithm engineering, forecasting, and research-level physics as of late June 2026.
Releases · huggingface/transformers - GitHub20 hours ago ... AI CODE CREATION. GitHub CopilotWrite better code with ... feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @shadeMe in #46112 ...github.com
Transformers library v5.13.0 released with major model additions including Kimi 2.5-2.7 (multimodal agentic model with advanced coding capabilities across Rust, Go, Python), MiMo-V2-Flash (27T token MoE model supporting 256K context), Nemotron 3.5 ASR (600M multilingual speech model with configurable latency tradeoffs via 80-1120ms chunks), Qwen3 ASR (Whisper-style encoder with Qwen3 decoder supporting automatic language detection), ZAYA1 (760M active / 8.4B total MoE model with compressed convolutional attention), VideoPrism (video encoder achieving state-of-the-art on 31/33 benchmarks across question answering and vision tasks), RADIO (NVIDIA vision foundation models via multi-teacher distillation), and MiniCPM3 (4B dense model outperforming 7B-9B models using Multi-head Latent Attention). Breaking changes include standardized layer declarations for ONNX/torch.export/ExecuTorch exportability and fixed attention masking for Gemma 3/4 models.
Researchers Release EvoPolicyGym For Autonomous Policy ...22 hours ago ... ... code generation. Agent evaluation is moving toward the part of automation that static benchmarks miss: how a system uses feedback after its first attempt ...letsdatascience.com
EvoPolicyGym, introduced in an arXiv paper on July 2, presents a new benchmark for evaluating autonomous coding agents through iterative policy evolution. The framework separates visible training feedback from hidden validation and held-out test cases, enabling agents to learn from failed attempts in a controlled environment with server-mediated rollouts and strict budgets. GPT-5.5 achieved top performance across the Core-16 benchmark suite, and the GitHub repository provides infrastructure, protocol documentation, and adapters for multiple agent implementations including Claude Code and Codex CLI, offering a pattern for long-running agent evaluation that emphasizes exploration-exploitation tradeoffs and reproducible feedback loops.