Podlipodcast player Webplayer

The Stack Overflow Podcast

The Stack Overflow Podcast

Search engine bots crawled so AI bots could run

The Stack Overflow Podcast · Jan 6, 2026 · 23:27

0:0023:27

Listen in the Podli app 🎧

Follow your favourite podcasts, listen offline and in the car with CarPlay and Android Auto, and always pick up where you left off. Free to try.

Ryan hosts Akamai data scientist Robert Lester on the show to discuss how the growth of AI bots affects internet traffic, the ways these AI bots differ from the original search engine optimization ones, and why you might not want to mitigate AI bots on your websites.

Episode notes:

Akamai is a CDN, full-stack cloud computing, and cybersecurity company that keeps experiences closer to users and threats further away using the world’s most distributed compute platform. 

Connect with Robert on LinkedIn and check out his AI Pulse blogs.

Today’s shoutout goes to user Evan Phoenix for winning a Populist badge for their answer to llvm ir back to human-readable source language?.

TRANSCRIPT

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Episodes: The Stack Overflow Podcast

PodliGet the free Podli app
↓ App