PM Intelligence Feed

The Thin Orchestrator: Making AI Agents More Reliable with Less Router Work

Sometimes, giving an AI agent all of the knowledge it needs is the wrong approach. At Meta, we’ve seen notable improvements in efficiency and accuracy by keeping the orchestration layer of our data pipeline agents deliberately thin: It routes work and enforces reliability checks, while specialized agents do the domain reasoning. We’re sharing our o…

Oct 19, 2026

Inside Hyperdrive: Solving a Rare MySQL Caching Bug

While adding MySQL support to Hyperdrive, we found a subtle protocol bug when caching query results. Here is how we tracked down a 0.001% rate error and made Hyperdrive MySQL generally available.

Oct 14, 2026

Turning AI Inference into Better Ad Recommendations

At Meta, we’ve built a system that enhances ads recommendations by leveraging idle inference capacity in our fleet. Two elasticity levers in the system allow ads recommendation work to expand across opportunistic capacity, without compromising baseline performance. This post describes how we designed and now operate the system at Meta’s scale and h…

Oct 12, 2026

Part 5: Operating an LLM System: Observability, Cost, Routing, Platform Underneath

Your service can be 100% up and still quietly approving the wrong things, burning its budget, or failing over into untested quality. Level 5 is the infrastructure that lets you see your decisions, bound your spend, route and fail over between models, kill bad behavior in seconds — and the platform that makes all of it possible.

Oct 08, 2026

Agents Refactor 300K Lines in Three Weeks, Practitioners Ask What It Proves

CodeScene has published a case study in which coding agents refactored 300,000 lines of C over three weeks for roughly $4,000 in tokens, verified by a frame-by-frame replay harness. The agents built a playbook of codebase-specific recipes along the way. Practitioners have questioned the scope, the metric, and how much of the result depends on the h…

Sep 30, 2026

Is Your Human-in-the-Loop Actually Slowing You Down?

Sep 28, 2026

Four months of VoidZero at Cloudflare: Making the open-source JavaScript toolchain faster for all

Since joining Cloudflare, VoidZero has delivered more than 80 releases that drastically speed up JavaScript compilation, linting, and testing. From a 10x faster React compiler to Vite+ 1.0, here’s how we are building faster tools for developers and AI agents.

Sep 28, 2026

Presentation: Context Engineering at LinkedIn: Building an Organizational Context Layer for AI_agents_with_MCP

Ajay Prakash discusses how LinkedIn overcomes AI agent limitations in large codebases. He explains Contextual Agent Playbooks and Tools - built on Model Context Protocol (MCP) - which serves procedural memory, code search, and runbooks directly to coding agents. Prakash shares architectural details and operational guardrails that deliver a 20% prod…

Sep 19, 2026

Implementing Chaos Engineering in Financial Payment Systems: Lessons from Enterprise Deployments

Standard chaos engineering assumes experiments stop cleanly, blast radius is knowable in advance, and production is fair game. Payment systems violate all three. Salim Adedeji describes ECS-specific failure modes from enterprise deployments: a 60-second DNS TTL that produced 93-second failover, retry logic amplifying database load 2.4x, and AZ reba…

Sep 08, 2026

How we saved 100 terabytes of memory by optimizing 1.1.1.1's DNS cache

Five Rust-level memory optimizations to the DNS cache layout of Big Pineapple cut per-entry memory by 56%, freeing approximately 100 TB of memory across Cloudflare's fleet.

Aug 27, 2026

Alt text passes automated checks but isn’t necessarily good

We built a plugin for the GitHub Accessibility Scanner to make sure your alt text is actually accessible. Here's how it works. The post Your alt text passes automated checks. That doesn’t mean it’s any good. appeared first on The GitHub Blog .

Aug 24, 2026

Rightsizing Platform Engineering: Building the Platform Your Organization Needs

Shift-left and DevOps have impacted how we flow changes from inception to production, but at the cost of increased cognitive load and duplication of effort across testing, security, and maintenance. This article explores the real-world challenges of rightsizing developer platforms and finding a cultural match for engineering teams who use them to r…

Aug 24, 2026

How We Raised Mobile End-to-End Test Stability to 98%

We rebuilt our mobile end-to-end testing framework with a strict API and computer vision, raising test stability drastically.

Aug 12, 2026

Sidekick's continual learning loop

How we compress production failures into model weights every day, beat frontier-model quality, and cut serving costs 96%.

Aug 05, 2026

How we're rethinking work at Cloudflare with Cloudflare OS

We built Cloudflare OS to equip our teams to safely rethink how they get work done with AI. The platform brings together the best of our technologies, from our Compute primitives to our Zero Trust suite. This post walks through our journey to give our users the best AI tools available.

Aug 05, 2026

Explorers, exploiters, and the myth of the 100x engineer

The “find the special ones and promote their traits” approach isn’t the best or only way to drive AI adoption and productivity on an engineering team. ​​​​‌‍​‍​‍‌‍‌​‍‌‍‍‌‌‍‌‌‍‍‌‌‍‍​‍​‍​‍‍​‍​‍‌​‌‍​‌‌‍‍‌‍‍‌‌‌​‌‍‌​‍‍‌‍‍‌‌‍​‍​‍​‍​​‍​‍‌‍‍​‌​‍‌‍‌‌‌‍‌‍​‍​‍​‍‍​‍​‍‌‍‍​‌‌​‌‌​‌​​‌​​‍‍​‍​‍‌‍​‌‍‌‌​​‍‍‌​‌‌​‌‍​‌‌‍​‌‍‍‌‍‌‌…

Aug 05, 2026

GEM Training: How Meta Doubled Ads Foundation Model Efficiency

Meta’s Generative Ads Recommendation Model (GEM), the foundation model behind ads recommendations across Instagram and Facebook, now trains at LLM scale on several thousand of the latest-generation GPUs. This post goes into the details on how we achieved: doubling end-to-end (E2E) training efficiency to 20–25% Model FLOPs Utilization (MFU) while sc…

Aug 03, 2026

BGP Origin Attribute Manipulation and Its Impact on the Internet

When BGP attributes are manipulated, PMs typically focus on immediate performance metrics — but this shows the long-term implications of trust and reliability in routing decisions can be overlooked. Understanding how subtle changes in network attributes can influence traffic behavior is crucial for making informed trade-offs between flexibility and stability in product design.

Jul 24, 2026

Agent platform (Part 1): How we help Grab build and run AI agents at scale

When product teams prioritize immediate feature development, PMs typically overlook the foundational infrastructure needed for scalability — but this shows that investing in a robust framework from the start can lead to exponential growth and adaptability in the long run. By focusing on solving recurring problems through a flexible architecture, teams can avoid the pitfalls of short-term fixes that hinder future innovation.

Jul 24, 2026

GitHub Increased Instant Navigation from 4% to 22% by Rethinking Client-Side Architecture

When prioritizing immediate responsiveness, PMs typically focus solely on backend performance — but this shows that client-side architecture and caching strategies can significantly enhance user experience without compromising data integrity. This highlights the importance of considering how data retrieval methods impact perceived performance, particularly in applications with frequent user interactions.

Jul 22, 2026

From weeks to a day: speeding up LLM evaluation

When engineering teams focus solely on individual components, PMs typically assume that a well-functioning part means the whole system is robust — but this shows that the integration layer is often the most critical and overlooked aspect of product performance. Prioritizing end-to-end validation over isolated metrics can lead to more meaningful insights and ultimately a more reliable product, challenging the common belief that component-level success guarantees overall effectiveness.

Jul 14, 2026

Better tools made Copilot code review worse; how we improved it

When PMs prioritize tool upgrades for efficiency, they typically underestimate the importance of contextual alignment in workflows — but this shows that even the best tools can falter if they don't match the user's actual processes. The real challenge lies not in the tools themselves, but in ensuring that the instructions and workflows are tailored to how users engage with those tools, highlighting the need for a holistic approach to product design.

Jul 10, 2026

The Data Canary: How Netflix Validates Catalog Metadata

When data integrity is compromised, PMs typically focus on code-level issues — but this shows that product resilience must encompass data validation as rigorously as it does for code deployments. Ignoring the complexities of high-velocity data pipelines can lead to significant user experience failures, emphasizing the need for PMs to integrate data quality checks into their overall product strategy.

Jun 19, 2026

AlloyDB Ships Proxy Models for Local Database Inference

When optimizing for performance, PMs typically prioritize throughput and cost reduction — but this shows the importance of rethinking the architecture of interactions between systems. By leveraging local proxy models, teams can significantly enhance efficiency while minimizing dependency on external resources, a tradeoff that often goes overlooked in favor of immediate performance metrics.

Jul 09, 2026

Adopting AV1 for Real-Time Communication at Scale

When PMs prioritize bandwidth efficiency, they typically overlook the nuanced impact of codec choice on user experience — but this shows that selecting the right codec can significantly enhance video quality, especially in low-bandwidth scenarios. Additionally, the focus on advanced encoding techniques reveals that optimizing for specific content types, like screen sharing, is often neglected in favor of broader performance metrics.

Jun 22, 2026

Coding Is No Longer the Constraint: Scaling Developer Experience at Spotify

When coding ceases to be the primary bottleneck, PMs typically focus on scaling team size and resources — but this shows that investing in developer experience and automation can yield exponential productivity gains without simply adding more engineers. This shift highlights a common oversight where PMs underestimate the transformative impact of tools and processes that enhance efficiency, often favoring traditional scaling methods instead.

Jun 03, 2026

When history fails you, borrow from geography

When faced with unprecedented market shocks, PMs typically rely on historical data to inform their strategies — but this shows that leveraging geographic insights can provide critical, timely forecasts when traditional models fail. This highlights the importance of being adaptable and seeking alternative data sources, as rigid adherence to past patterns can lead to significant miscalculations in rapidly changing environments.

Jun 02, 2026

Background Coding Agents: Supercharging Downstream Consumer Dataset Migrations Part 4

When automation tools are introduced to streamline complex processes, PMs typically focus on immediate efficiency gains — but this shows that understanding the underlying context and dependencies is crucial for successful implementation. Neglecting to consider how different systems interact can lead to oversights that undermine the benefits of automation, resulting in more work in the long run.

Apr 22, 2026

Lessons Learned Running Presto at Meta Scale

When scaling a product rapidly, PMs typically prioritize feature delivery — but this shows that operational reliability and deployment automation are equally critical to maintaining user satisfaction. Overlooking the balance between feature rollout and infrastructure stability can lead to degraded performance and frustrated users, ultimately undermining the product's success.

Jul 16, 2023

The Theory 2026 AI Survey Results

Theory's second annual AI in Practice Survey finds four results that surprised us : 43% rate security a top pain against the 10% who say its tooling delivers value, 45% of teams route queries across models, Cloudflare hosts 62% of agent sandboxes, & 48% now read production logs with coding agents.

Oct 13, 2026

CEO Interview: Clair

Nico Simko, Chief Executive Officer (CEO) of Clair, tells CB Insights how they view the market, customer needs, and their company. How do you define your market and where does your company fit into that space? 60% of Americans … The post CEO Interview: Clair appeared first on CB Insights Research .

Oct 09, 2026

Executive Interview: Gotomarket

Denis Bogdanovich, Chief Operating Officer (COO) of Gotomarket, tells CB Insights how they view the market, customer needs, and their company. How do you define your market and where does your company fit into that space? We built B2B Go-To-Market … The post Executive Interview: Gotomarket appeared first on CB Insights Research .

Sep 18, 2026

The failure of entrepreneurs is our greatest strength

Brian de Haaff considers what we risk losing when we stop valuing entrepreneurship — from new ideas and economic opportunity to individual agency.

Sep 17, 2026

Harness Margin Opportunity

A UC Berkeley study finds the harness sets the price of an answer : GPT-5.6 Sol costs 71% less on Pi than on Claude Code, the same model returning the same result, & none of the 42 harness comparisons shows a statistically significant quality difference. Two startups bidding on the same $250k contract earn 38% & 75% gross margins depending on what …

Sep 17, 2026

Is AI Actually Going to Kill Us All

This week on “Uncanny Valley,” we dig into a former Anthropic researcher’s AI doomsday warning, the latest upgrades from Apple’s event, and the census report that claimed Trump won the 2020 election.

Sep 10, 2026

CEO Interview: 12x AI

Greg Fields, CEO of 12x AI, tells CB Insights how they view the market, customer needs, and their company. How do you define your market and where does your company fit into that space? We’re tackling the global mental health … The post CEO Interview: 12x AI appeared first on CB Insights Research .

Aug 28, 2026

Groq’s $350M mega-round and ITC Vegas 2026

Below, we break down some of tech’s biggest stories, with analyst perspective on the moves that matter the most. Here’s what we’re watching this week: ITC Vegas 2026 Virtue AI gets acquired by Fortinet Groq raises $350M This brief is … The post Groq’s $350M mega-round and ITC Vegas 2026 appeared first on CB Insights Research .

Aug 20, 2026

Who Buys SOTA?

State of the art models are two-thirds smarter than last November & labs ship two new models every three days. But 84% of tokens on OpenRouter are not state of the art. The six models carrying the supermajority deliver about 77% of frontier performance at 2.5% of Claude Fable 5's price. Ramp's data shows price elasticity in the market. Frontier mod…

Aug 14, 2026

Executive Interview: OutcomesAI

David Plummer, CCO at OutcomesAI, tells CB Insights how they view the market, customer needs, and their company. How do you define your market and where does your company fit into that space? OutcomesAI has built what we call GLIA, … The post Executive Interview: OutcomesAI appeared first on CB Insights Research .

Aug 05, 2026

How We Built a Realtime System for Responsive Voice AI in Six Months

GPT-Live enables continuous voice interaction with AI, using a turnless speech model and low-latency architecture for faster, more natural conversations.

Aug 03, 2026

Avatarin builds 24/7 retail agent with GPT-Realtime

Investing in AI-native customer service solutions like avatarin's can drastically improve user engagement and satisfaction, but neglecting to adapt to evolving customer expectations for personalized, context-aware interactions risks losing market relevance. PMs must prioritize integrating advanced AI capabilities to meet these demands or face potential declines in customer loyalty and sales.

Jul 30, 2026

Aftermarket Harnesses

Focus on optimizing the tools and frameworks around your core product, as they can significantly enhance performance and cost-effectiveness. Prioritize co-designing systems that leverage existing resources intelligently, as this will drive better outcomes than relying solely on the inherent capabilities of the product itself.

Jul 28, 2026

Path to artificial superintelligence

Investing in a semantic layer for AI products is crucial to enable effective collaboration among agents, which can significantly enhance problem-solving capabilities. Ignoring this need risks creating isolated systems that fail to leverage collective intelligence, ultimately leading to suboptimal performance and missed opportunities in innovation.

Jul 27, 2026

Google's Cloud Revenue Matches NVIDIA's Growth Rate

Monitor convergence trends between competitors to identify emerging market dynamics and adjust your strategy accordingly. When growth rates align, it often signals a shift in demand or competitive positioning that requires proactive decision-making.

Jul 22, 2026

How tech workers feel about AI in 2026 | Annual AI sentiment survey

Recognize that half of your team may be struggling with burnout and uncertainty, necessitating a shift towards more empathetic management practices. Prioritize regular check-ins and support systems to foster a healthier work environment and retain talent.

Jul 12, 2026

Import AI 463: Self-improving robots; a 10k Chinese GPU cluster; an essay for the human era

Investing in self-improving robotics could drastically reduce the need for human oversight in AI product development, enabling faster iterations and more complex task handling. Ignoring this trend may lead to falling behind competitors who leverage automation to enhance efficiency and innovation in their AI-native offerings.

Jun 29, 2026

Talos: Scaling Rare Disease Diagnosis with Automated Genomic Reanalysis

Prioritizing automated genomic reanalysis tools like Talos is essential for PMs to enhance diagnostic yield in rare diseases, as neglecting this can lead to missed diagnoses and prolonged suffering for patients. Investing in such technology not only improves patient outcomes but also positions your product at the forefront of evolving medical practices, ultimately driving competitive advantage.

Jun 24, 2026

Inside the black box of AI: How AI models actually think

Listen now (72 mins) | Emmanuel Ameisen of Anthropic explains what looking inside language models reveals about planning, consciousness, and AI safety

Oct 18, 2026

Predictability vs Outcomes

I was first taught about the importance of outcome over output way back when I was an engineer getting coached to become a tech lead, and I was explicitly told that it was no longer enough to just build and ship, I had to make sure the solution actually solves the underlying problem. I have... The post Predictability vs Outcomes appeared first on S…

Oct 12, 2026

How Meta Designed Muse: An AI Agent People Want to Talk To

Listen now | 🎙️Alex Cornell explains how Muse serves your mom and an engineer with the same interface, and demos a SkyMall-style catalog, golf recaps, and a blog turned podcast

Oct 12, 2026

OpenAI’s Head of ChatGPT: We’re Entering a New Era of AI

Listen now (37 mins) | Tibo Sottiaux on why Dots is OpenAI’s biggest bet, why agents will dominate internet traffic, and what builders are still getting wrong

Oct 04, 2026

OpenAI Dev Day 2026: Key Releases

Watch now (24 mins) | 🎙️ Claire tests OpenAI’s DevDay releases, from Dots, Spaces, and Sites to AI-picked thumbnails and a $97 game, and shares what’s worth trying first

Sep 30, 2026

Jev for beginners: How to use it and what to build

Watch now (26 mins) | 🎙️ Jev returns type-safe structured values instead of text, which makes it the fastest, cheapest classification layer I’ve ever put in a pipeline—and this week I shipped three real projects with it

Sep 28, 2026

TBM 440 The Problem With Putting People in Boxes

Personality and “strength” tests at work have never sat right with me.

Sep 19, 2026

How We Built Grok Bot in a Month | Roman Ugarte (SpaceXAI)

Listen now | Roman Ugarte of SpaceXAI on going from first line of code to the world’s hottest AI product in seven weeks, and what it really takes to win in the most competitive market ever

Sep 08, 2026

Why companies are becoming a series of loops | Anish Acharya

Anish Acharya on why the permanent-underclass fear is wrong, how every job function becomes a loop, and where consumer AI is headed

Sep 06, 2026

AI, tools and transformation

It’s very tempting to imagine that AI turns everyone into a tool-builder - now everyone can just ask the model to make the software they need, and apps as we know them are dead. I think that misunderstands how most people think and where software actually comes from, and more importantly, it isn’t a path to change how companies actually work.

Sep 03, 2026

Ads Model for Prompt Integration in AI

Meta's Muse Spark 1.3 prices inference at two levels : $1.25/$4.25 per million tokens for private data, & $0.10/$0.20 for training consent : a 92% price spread. Michael Mauboussin taught that market prices contain information about underlying expectations. This spread establishes a liquid clearing price of $1.24/m tokens for user & agent prompt dat…

Sep 03, 2026

AI Productivity Doesn't Mean What I Think It Means

Over three years of testing AI writing systems, one-shot prompt templates failed. The working architecture is a closed-loop taste flywheel where draft versions collapse from 47 to 3, yet line-level edits remain flat at 130 per post. AI does not just save time; it raises the ceiling of what the same effort produces. The real question is whether we a…

Sep 01, 2026