SDSignal Desk

Intelligent Delivery: Making Every Unit of Compute Serve Better Ads

· Signal Desk newsroom

Analysis of reporting by Meta Engineering. How we work

Image: Meta Engineering

Meta's quiet confession here is that ad models are outgrowing its hardware, so it now uses machine learning and agents to ration compute request by request.

Why it matters

Meta's engineering team detailed Intelligent Delivery, a system that decides where each unit of compute goes across its ad-serving stack: which region handles a request, which chip it lands on, and how much of a machine it gets. Meta says the system has added about 10% to ads ranking performance on top of other model and system gains from 2017 through the first half of 2026.

The headline for the broader AI world is the agent work. Meta says agents contributed to about 20% of Intelligent Delivery optimizations in the first half of 2026, and on its most automated mechanism about 80% of the engineering effort, with engineers approving every change.

From the desk

We read this as a snapshot of where large-scale AI operations are heading. Meta says plainly that its ads ranking models are growing toward LLM scale faster than hardware can keep up. When compute is the constraint, the winners are the companies that squeeze the most useful work out of each chip, and Meta is describing a mature system for doing that.

The agent section is the part we'd flag for every engineering leader. An agent reads source code, design documents and a decade of experiment logs, proposes a few changes worth testing, and runs the experiments. Meta says this cuts the optimization loop from months to weeks while keeping people in control. That's a credible, useful pattern for agents: narrow domain, rich history, human sign-off.

Now the eyes-open part. What's being optimized is ad delivery. Better ranking for Meta means more effective targeting of the people using its apps, and the post measures success in ranking performance, not in anything users would choose for themselves. Efficiency gains in this system flow toward the advertising business first.

There is also a slower risk. When agents do most of the tuning on a system this complex, fewer humans fully understand why it behaves as it does. Approval of each change is a good guardrail, but reviewing a proposed change is not the same as having designed it. I'm watching how Meta keeps that expertise in house as the agent share climbs.

Context

Meta's fleet spans CPUs from Intel, AMD and Arm and accelerators from NVIDIA, AMD and its own MTIA chips. The company says its large ranking models, such as its Generative Ads Model, increasingly run on GPUs, which requires new allocation methods.

Who feels it

Infrastructure engineers
A detailed blueprint for per-request compute allocation across heterogeneous hardware.
Advertisers
More efficient ranking may improve ad performance on Meta's platforms.
Meta users
Gains go into ad targeting, a reminder that much AI efficiency work serves the business model.
Engineering teams adopting agents
Meta's human-approved agent loop is a practical model for automating optimization work.

What to watch

  1. Growth in the share of optimizations driven by agents in future Meta disclosures
  2. Meta's progress on fusing request understanding and serving into a single real-time model
  3. How GPU-based ranking changes Meta's capacity needs and spending

Read the original

Continue at the source.

Meta Engineering

Companies: Meta

More on Meta

All Meta coverage →