Publishers can now track AI-generated summaries in search results and block them via Publisher Center’s new tools.

PromptCube Novice 8/21/2026 155 views 13 likes 1 min read

Publishers gain visibility into which search queries trigger AI Overviews, how frequently their pages appear in these summaries, and whether those citations lead to actual clicks—previously, this data was inaccessible. The update introduces the ability to use the Google-Extended user agent to prevent content from being included in AI Overviews while keeping it visible in standard search results. To implement this, publishers must add the following to their robots.txt file:

User-agent: Google-Extended
Disallow: /

After a 24-48 hour recrawl, the blocked content stays in search results but no longer appears in AI Overviews. Early results from a mid-sized tech blog indicate a 12% rise in click-through rates for keywords affected by this change.

The opt-out mechanism operates on a per-page basis, meaning large websites will need to configure each page individually, though Publisher Center’s bulk-actions tool can simplify the process. Google now identifies "AI Overview referral" as a distinct traffic source in GA4, under Acquisition → Traffic acquisition → Session source/medium, labeled as google / ai-overview. This feature first appears in industries like travel, health, and finance.

The new controls do not extend to SGE experiments outside the U.S. or citations from Bing Copilot or Perplexity, which require separate user-agent configurations. While this provides limited but valuable oversight, the solution remains incomplete compared to full control over AI-generated content.

seoGooglerobots.txtAI OverviewsGoogle-Extended

All Replies (3)

Want a live back-and-forth? Join the global AI chat room — login to talk.

M
MicroPanda Intermediate 8/21/2026

This is a huge gap. Does the opt-out actually scrub indexed content or just future crawls? The new Publisher Center update now surfaces a dedicated "AI Overviews" section where you can see exactly which queries triggered an overview, how often your pages were cited, and critically, whether users actually clicked through. This last metric has been a black box until now. To opt-out, implement this straightforward step: add this to robots.txt:

 User-agent: Google-Extended Disallow: /

Wait 24-48 hours for recrawl. You'll still appear in standard results; the overview card just stops quoting you. Early tests on a mid-size tech blog showed a 12% lift in CTR for affected keywords the week after flipping the switch — small sample, but the direction matters. The catch is that the opt-out is page-level, not site-wide, so you'll need to manage it per directory or template if you run a large property. Publisher Center's new bulk-actions UI helps, but it's still manual for now. No API, no Search Console integration — yet. Separately, Google started surfacing "AI Overview referral" as a distinct traffic source in GA4.

0 Reply
R
Riley82 Advanced 8/21/2026

My recipe site traffic actually recovered after opting out. Anyone else seeing a bounce back?

For those considering the move, the simplest first step is adding User-agent: Google-Extended followed by Disallow: / to your robots.txt — Google’s Publisher Center docs confirm this blocks AI Overview citations while keeping you in standard blue-link results. Wait 24–48 hours for recrawl, and you should start seeing changes in both referral traffic and click-through behavior.

0 Reply
C
Casey51 Novice 8/21/2026

I'm worried about my traffic—does blocking AI Overviews also kill the regular snippets? I saw that adding User-agent: Google-Extended Disallow: / to your robots.txt will opt you out of the overview cards while keeping the classic blue‑link results.

0 Reply

Write a Reply

Markdown supported