Overview of Big Technology Podcast with Matthew Prince
Cloudflare CEO Matthew Prince argues that the web is entering a major inflection point: AI bots now outnumber human visitors, and the economics of publishing, search, and online commerce are being rewritten. In his view, the internet is not “dead” but becoming more AI-mediated, with a new challenge: how to preserve incentives for creators, publishers, and small businesses while supporting explosive automated traffic.
Key Takeaways
-
AI traffic has overtaken human traffic on the web.
- Cloudflare says automated traffic passed human traffic for the first time.
- Prince believes the trend is accelerating fast enough that automated traffic could be 1,000x human traffic within five years.
-
The web may become healthier for creation, but very different to consume.
- Prince argues AI tools are enabling more people to build websites, apps, and online businesses without technical skills.
- He sees this as a net positive for creation, even though the user interface will increasingly be mediated by AI agents.
-
The real problem is the internet’s business model.
- Publishers, app developers, and sites need a new way to get paid when AI systems ingest their content and answer users directly.
- Prince says the next 30 years of the web depend on getting this right.
-
Google is becoming a central flashpoint.
- Cloudflare plans to block Google by default for ad-supported and subscription-supported sites starting in mid-September unless publishers opt out.
- Prince argues Google should be treated like every other AI company and pay for content access.
-
Small businesses could be disadvantaged by agentic commerce.
- As AI agents do more shopping and research, they may favor established brands with more data and reputation signals.
- Prince worries this could intensify consolidation unless the industry builds tools that help new entrants compete.
The AI Traffic Surge and Infrastructure Strain
Prince says Cloudflare’s data showed the rate of automated traffic growth accelerating faster than expected:
- In late 2025, Cloudflare initially estimated automation would exceed human traffic in 2027.
- By May 2026, that had already happened.
- He warns that if current trends continue, the internet will face enormous infrastructure pressure.
He compares the coming wave to the COVID-era traffic spike, when even a 2x increase in internet traffic nearly overwhelmed Europe’s network capacity. A 1,000x increase in bot activity would require fundamentally different infrastructure.
Why this matters technically
Prince says the current stack is too heavy for the future:
- Traditional servers, VMs, and even containers are too costly for the scale of agent traffic coming.
- Cloudflare is investing in lighter-weight compute models like Workers and isolates to support this next phase.
He also highlights the scale of a payments challenge if the web moves toward micropayments:
- Visa handles about 20,000 financial transactions per second at peak.
- Cloudflare processes about 500 million internet transactions per second.
- A future agentic micropayment web could require infrastructure for 10 million to 100 million financial transactions per second.
Publishers, Crawlers, and the New Economics of Content
Prince splits websites into two broad categories:
1. Sites that want AI distribution
Most businesses, knowledge bases, and content creators want their material surfaced inside AI systems. For these, Cloudflare is focused on:
- Making content easier for AI to ingest
- Reducing serving costs
- Delivering lighter formats like markdown instead of heavy HTML
- Using caching and other efficiency tools
His goal: make serving a page 1,000x cheaper than before.
2. Ad-supported or subscription-supported publishers
These publishers are more likely to see AI as extractive because:
- AI systems can summarize their content without sending users to the original site
- Fewer clicks means less ad revenue and weaker subscription economics
Prince says those publishers need:
- The ability to block AI crawlers
- The ability to charge for access
- Tools that make compensation easy for agents to execute
Crawls vs. Clicks: Why Publishers Are Alarmed
Prince says the gap between crawling and referral traffic has worsened sharply:
- A year ago, publishers saw high crawl-to-click ratios already.
- Now, he says, those ratios have roughly doubled again from the publisher’s perspective.
His argument:
- AI systems are getting better at giving users answers directly
- As a result, users click through to source pages less often
- The old search model of “10 blue links” is fading
He believes the old web business model—ads plus subscriptions—will not support the next era of the internet on its own.
Google, SEO, and the End of “10 Blue Links”
Prince says the era of SEO as it has traditionally been understood is ending.
- Search behavior is shifting toward longer, more natural-language queries.
- Users spend more time inside AI interfaces and often never leave them.
- He believes Google’s old search model is under systemic threat because it depends on linking content chains that may no longer be visible if publishers block access.
He sees Google as a special case because of its scale:
- Google crawls far more of the web than OpenAI, Anthropic, or Microsoft.
- If Google uses the same crawler for search and AI, it gains a major advantage unless it is held to the same rules as everyone else.
Cloudflare’s stance on Google
By mid-September, Cloudflare plans to:
- Block Google by default for ad-supported and subscription-supported sites
- Leave publishers free to opt out
- Encourage publishers to treat Google like any other AI company
Prince says many large publishers will likely follow.
Micropayments as a Possible Future Business Model
Prince’s long-term vision is an internet where AI agents can pay for content in tiny increments:
- A fraction of a cent for an article, dataset, or page
- Enough to cover infrastructure costs
- In some cases, enough to support journalism, research, or other high-value content creation
He believes this could eventually replace the broken economics of the current web—but only if the industry solves the technical challenge of supporting massive transaction volume.
Small Businesses and the Risk of Consolidation
The conversation shifts from publishers to small businesses, and Prince says this is the next major concern.
Why small businesses are vulnerable
In an agentic web:
- Consumers may rely on AI agents to compare products, services, and vendors
- Agents can do deeper research than humans and have “infinite patience”
- That may favor companies with the most data, reviews, fulfillment history, and online reputation
Prince worries that:
- New brands will have a harder time getting discovered
- Commerce will tilt toward incumbents
- The web could become more consolidated rather than more open
His concern in one sentence
If AI agents become the main interface for commerce, then the richest information sources—not necessarily the best products—may win.
What Small Businesses Will Need
Prince doesn’t claim to have the solution yet, but he thinks the industry needs to build tools that help small businesses establish trust and get discovered by AI systems.
Possible ingredients include:
- Verified merchant profiles
- Structured reputation signals
- Shipping and fulfillment data
- Return rates and chargeback metrics
- Better integration with platforms like:
- Shopify
- PayPal
- Visa
- Mastercard
- American Express
- Intuit
He thinks the industry needs to define what “brand” means in an agentic world:
- Not just visuals or recognition
- But a verifiable, machine-readable proof of quality and reliability
Bigger Societal Concerns
Prince ends on a broader warning: AI could widen inequality.
- Wealthier users may afford better agents
- Better agents will be more capable, more informed, and more helpful
- That could create a bigger gap between rich and poor
He says the next challenge after fixing media economics and small business discovery is making sure AI does not become a force that deepens class divides.
Bottom Line
Matthew Prince’s core message is that the web is undergoing a structural reset:
- AI traffic is exploding
- Publishers need payment or control
- Google should not get special treatment
- Small businesses need new discovery tools
- The internet’s next business model is still being invented
He is optimistic about the creativity AI can unlock, but warns that without new rules and infrastructure, the coming agent-driven web could concentrate power instead of democratizing it.