Mira Murati's Thinking Machines Lab ships Inkling, a 975B open-weight MoE model with vLLM support.
​​​​​​​​​​

$ ai-news --date 2026-07-16 | mail

AI News โ€” Thursday, July 16, 2026

// the most viral AI topics of the last 24 hours, curated for your stack

$ cat top-story.md

Thinking Machines Lab Ships Inkling, Its First Open-Weight Frontier Model

Mira Murati's Thinking Machines Lab, 18 months in stealth, released its debut model: a 975B-parameter (41B active) mixture-of-experts model trained on 45T multimodal tokens with native text/image/audio/video reasoning and a 1M-token context window. It scores 77.6% on SWE-bench Verified and 97.1% on AIME 2026, weights are open on Hugging Face, and it already has day-one support in vLLM, SGLang and llama.cpp plus hosting from TogetherAI, Fireworks, Modal, Databricks and Baseten. A smaller Inkling-Small (276B/12B active) preview shipped alongside it.

Why it matters: a genuinely frontier-scale, freely downloadable open-weight model with native multimodal reasoning and immediate vLLM support โ€” directly droppable into a self-hosted stack, and per Hacker News commentary the first competitive non-Chinese open-weight release since Llama 3.

// source: Hacker News (803 pts) / Thinking Machines Lab / TechCrunch

## ๐Ÿ› ๏ธ Tools & Repos

โ–ธ Herdr โ€” a Terminal Multiplexer Built for Juggling AI Coding Agents

A Rust, tmux-like multiplexer purpose-built for running many coding-agent sessions (Claude Code, Codex, Copilot CLI, Cursor Agent and 15+ others) side by side, organizing them into workspaces/panes with live blocked/working/done/idle status and SSH-friendly detach/reattach. Why it matters: solves the real daily pain of tracking multiple parallel Claude Code sessions in one terminal, with persistent remote-attachable state and an API to build on top. // GitHub Trending (+2,636 stars this week) / Hacker News (166 pts)

โ–ธ Forall โ€” a Coding Agent That Ships Machine-Checked Proofs Alongside Its Code

A spec-driven agent (TypeScript/Java/Rust) that generates mathematically verifiable proofs of correctness for the code it writes, via a local authoring MCP server plus hosted verification. Why it matters: a distinct, formal-verification angle on agentic coding for anyone wary of trusting vibes-only agent output. // Show HN

โ–ธ Capn-Hook Gives Claude Code and Codex Persistent Cross-Session Memory

A session-start hook plus a capn ask/capn chart workflow that makes agents check previously saved code-pattern discoveries before re-grepping a codebase from scratch, auto-invalidating entries when the backing files change. Why it matters: directly attacks the daily annoyance of agents re-exploring the same codebase every session, claiming 77% fewer tokens on repeat questions. // Show HN

## ๐Ÿค– Agents & MCP

โ–ธ Matt Pocock Open-Sources His Personal Claude Code Skills Library

The Total TypeScript educator published his own .claude skills directory: grilling sessions to catch misalignment before coding starts, CONTEXT.md conventions to cut token waste, TDD loops and anti-decay architecture practices. Why it matters: a battle-tested, drop-in set of engineering skills from a well-known practitioner โ€” one of the most-starred Claude Code skills repos yet. // GitHub Trending (172k stars)

โ–ธ Claude Code v2.1.211 Closes a Permission-Prompt Spoofing Trick

Fixes permission-preview strings that could be spoofed with bidirectional Unicode overrides, zero-width characters and look-alike quotes to make a dangerous command look benign in the approval dialog; also adds a --forward-subagent-text flag and fixes subagents reverting to the parent's model on resume. Why it matters: closes a real attack class against the approval prompt Claude Code users rely on to catch dangerous commands before they run. // Claude Code changelog

โ–ธ xAI Open-Sources Grok Build's Entire Codebase After Its Privacy Scandal

After Grok Build was caught silently uploading entire local directories โ€” including SSH keys and password-manager files โ€” to Google Cloud, xAI released the full ~844,530-line Rust codebase under Apache 2.0, disabled data retention by default, and reset everyone's rate limits; Simon Willison independently reviewed the code and confirmed the old upload logic is now visibly disabled. Why it matters: a concrete, auditable resolution to a serious AI-coding-tool privacy scandal โ€” useful evidence when deciding whether to trust a local coding agent's data handling. // Simon Willison / xai-org/grok-build (GitHub)

โ–ธ Visual Studio's Copilot Now Fingerprints MCP Servers to Catch Silent Tampering

Visual Studio now validates configured MCP servers against a trusted baseline fingerprint at startup, prompting for re-approval if a server's config or assets changed since you approved it. Why it matters: a shipping mitigation against the "MCP server silently swapped after approval" attack class โ€” worth watching for other MCP clients to adopt. // GitHub Changelog

## ๐Ÿ  Self-Hosting & RAG

โ–ธ EAGLE-3 Speculative Decoding Recipe Ships for vLLM

An official vLLM blog walkthrough trains an EAGLE-3 draft model on target hidden states, quantizes it with AMD Quark, and serves it via vLLM โ€” reporting 1.4xโ€“2x throughput gains and 2.77 average accepted draft tokens at 32K context. Why it matters: a concrete, general (not AMD-only) recipe for speeding up your own vLLM+Gemma serving with speculative decoding. // vLLM official blog

โ–ธ New Paper: Query-Aware Vector Index Partitioning Beats One-Size-Fits-All Clustering

Meta FAISS researchers propose jointly optimizing database partitioning (via an auction algorithm) and a learned query router instead of clustering once and hoping queries match, reporting up to 4.7x throughput at equal recall when query and database distributions diverge. Why it matters: directly relevant to the ANN indexing under Qdrant โ€” a query-distribution-aware approach could improve recall/throughput as real RAG traffic drifts from ingestion-time data. // arXiv (cs.IR)

โ–ธ New Paper: Distilling Retrieval Models Down to 0.6B Params Using Only Ranking Scores

A memory-efficient distillation method (PairMSE) trains compact embedding models using only a teacher's ranking scores, not hidden states; a 0.6B student recovers up to half the teacher's performance gap while encoding documents 9.7x faster. Why it matters: a practical recipe for a smaller, faster, self-hostable embedding model to speed up your RAG ingestion/query pipeline without giving up much retrieval quality. // arXiv (cs.IR)

## ๐ŸŽฌ Worth Watching

โ–ธ Claude's Brain Has a Secret... And Scientists Found It

Breaks down Anthropic's new "Jacobian lens" interpretability tool, which found a privileged internal "J-space" in Claude that functions like a global workspace for holding and reasoning about concepts โ€” including flagging when it thinks it's being tested. Why it matters: an accessible look at a major interpretability finding with real safety implications for detecting hidden goals or fabrication. // Two Minute Papers

โ–ธ OpenAI vs Anthropic

Argues OpenAI and Anthropic represent two different philosophies โ€” OpenAI treating AI as an iteratively-deployed tool, Anthropic treating advanced AI as potentially something more โ€” and critiques Anthropic's opacity around usage limits and access policy. Why it matters: a sharp, opinionated framing of the industry's biggest rivalry and its practical effects on access and pricing for users. // Matthew Berman

## ๐Ÿ“ฐ Worth Reading

โ–ธ The Real AI Race May No Longer Be at the Frontier

Argues competitive focus is shifting from frontier labs to open-weight models โ€” Chinese open models now account for 41% of Hugging Face downloads โ€” with Hugging Face's CEO predicting frontier models become a niche while open/private models power most production workloads. Why it matters: a well-sourced case for a structural shift toward exactly the kind of open-weight, self-hosted approach this stack already takes. // TechCrunch

โ–ธ The Next Challenge for Coding Agents

Argues that since agents have made code-writing largely trivial, the next differentiator is production problem-solving โ€” using agents' large context and patience to diagnose complex system/log issues that outpace human review. Why it matters: a forward-looking take on where developer value shifts next as coding agents mature. // InfoWorld

$ echo "automatically researched on 2026-07-16"
> ai-news ยท news.reichenberg.ruhr

[ unsubscribe ] [ view in browser ]