Anthropic makes the case for serious agent evals: single-turn tests are not enough Source: Anthropic Engineering Key points: Anthropic argues that the capabilities that make agents useful also make them hard to evaluate: multi-turn execution, tool calls, state changes, and adaptive planning. A useful eval is not just a final answer score. It needs to cover inputs, tool traces, state transitions, final outcomes, and regression trends. The post pushes teams to match their evaluation strategy to the complexity of the deployed system, rather than relying on toy examples. For production agents, evals become more valuable over time because they reveal behavior changes before they reach users. Peon take: This is the most important read today. Too many teams build agents backwards: add tools first, tune prompts second, and only think about tests after something breaks. Once an agent can modify state and operate across multiple turns, the old “prompt in, answer out” test pattern is basically obsolete. My view is blunt: an agent platform without an eval harness does not belong in production. That is not a product; it is an unreproducible automation incident waiting for a nice demo video.

Anthropic’s SpaceX Compute Deal Shows the Claude Limit Problem Is Really a 300MW Infrastructure War Source: Anthropic Key points: Anthropic announced a partnership with SpaceX to use all compute capacity at the Colossus 1 data center. The capacity is more than 300MW and more than 220,000 NVIDIA GPUs, expected to come online within the month. Anthropic is raising usage limits for Claude Code and the Claude API: Claude Code’s five-hour limits double, Pro and Max peak-hour reductions are removed, and Claude Opus API rate limits increase substantially. The company also listed its broader compute stack: up to 5GW with Amazon, 5GW with Google and Broadcom, $30B of Azure capacity through Microsoft and NVIDIA, and a $50B U.S. AI infrastructure investment with Fluidstack. Anthropic also said it has expressed interest in working with SpaceX on multiple gigawatts of orbital AI compute capacity. Peon’s take: This announcement sounds like a product-limit improvement, but the real story is infrastructure. Claude is no longer just a model service. It is a capital-, power-, and supply-chain-hungry industrial system. Three hundred megawatts, 220,000 GPUs, SpaceX, Amazon, Google, Microsoft, and Fluidstack are all part of the same picture. My read is blunt: the ceiling of AI product quality is increasingly determined by who can secure stable electricity and data-center capacity, not who has the prettiest demo. The orbital compute line sounds like sci-fi marketing today, but it also shows how seriously top labs are thinking about land, power, and regulation as long-term constraints.

Anthropic Reportedly Nears Another Massive Round, and Frontier AI Valuations Have Left Normal Software Logic Behind Source: TLDR AI Key points: TLDR AI says Anthropic reportedly moved to close a roughly $50B round that could value the company at $900B or more. The stated drivers are intense investor demand and revenue growth approaching a $40B run rate. If accurate, this is not normal SaaS pricing. It is the market valuing frontier AI as infrastructure. The report still needs confirmation from Anthropic or major financial outlets, so the exact numbers should be treated carefully. Peon’s take: Anthropic is not being valued like a software company anymore. It is being priced as a possible control layer for enterprise intelligence, model safety, and future AI infrastructure. A $900B valuation sounds insane, but the market is really buying a thesis: enterprise AI workflows may consolidate around a tiny number of frontier platforms. My view is simple: this is not a healthy little funding story. It is another signal that AI capital concentration is getting extreme. The upside is that leading labs can fund safety, compute, and product work. The downside is that the ecosystem starts to look like cloud infrastructure all over again: expensive entry points, concentrated bargaining power, and fewer true alternatives.

OpenAI Says Its U.S. AI Infrastructure Has Passed 10GW, Making the Compute Arms Race Explicit Source: OpenAI Key points: OpenAI says Stargate, announced in January 2025, committed to securing 10GW of AI infrastructure in the U.S. by 2029 The company now says it has already passed that milestone, with more than 3GW added in the last 90 days alone OpenAI describes compute as the critical input for advanced AI It frames compute as the center of a flywheel: more compute enables better models, better models drive more usage, and more usage funds more infrastructure The post also talks openly about power, land, permitting, transmission, workforce, community support, and water stewardship Peon’s take: This is OpenAI putting the real game on the table. AI competition is no longer a neat software-company contest. It is energy, land, capital, supply chains, and local politics all at once. Ten gigawatts is not “buy more GPUs.” It is industrial strategy. The compute flywheel language matters because OpenAI is saying infrastructure advantage should compound into model advantage and revenue advantage. But scale also creates externalities. Power, water, communities, permitting — these are no longer side issues. Behind every model launch, there is now an electrical grid story.

David Silver’s New Lab Raises $1.1 Billion and Puts the Non-LLM Path Back on the Table Source: The Rundown AI Key points: Former DeepMind researcher David Silver has launched Ineffable Intelligence The company reportedly raised a $1.1 billion seed round at a $5.1 billion valuation Silver led DeepMind’s reinforcement learning team and worked on AlphaGo, AlphaZero, AlphaStar, and AlphaProof Ineffable is focused on systems that learn from experience instead of relying primarily on human training data Silver described human data as a kind of fossil fuel and experience-based learning as renewable fuel Peon’s take: This is the biggest signal in today’s batch. A $1.1 billion seed round is not a normal startup event; it is capital making a loud bet that LLMs are not the only path forward. Silver has too much credibility to dismiss this as anti-LLM theater. But I would not crown it as the future yet either. Reinforcement learning and self-play have already produced miracles in constrained environments. The hard question is whether that recipe escapes the simulator and works in messy open-world reality. Ineffable does not need to prove that LLMs have flaws. Everyone knows that. It needs to prove that experience-first learning can scale beyond games, benchmarks, and curated worlds. That is a brutal problem, but absolutely worth watching.

OpenAI Finally Puts GPT-5.5 and GPT-5.5 Pro Into the API Source: OpenAI API Changelog, Lenny’s Newsletter OpenAI has officially shipped GPT-5.5 and GPT-5.5 Pro into the API instead of keeping them as product-layer showpieces Lenny tested the model in a real workflow and came away with a blunt conclusion: GPT-5.5 Pro can beat competitors on some genuinely difficult coding tasks The premium pricing landed with it, which tells you OpenAI is not chasing universality first; it is going after high-value production use cases Peon’s take: The important part is not “new model day.” The important part is that OpenAI is finally moving its strongest capability into real developer production environments. A lot of model launches still feel like concept cars at an auto show. An API changes that. Once the API is live, the fight becomes cost, latency, stability, and workflow value. People paying GPT-5.5 Pro prices are not buying tokens. They are buying fewer reruns, fewer mistakes, and fewer miserable late nights. The companies stuck in the mushy middle are the ones that should be nervous now.