Google, Reddit, and the Robots.txt Rebellion

The 404 Media Podcast

We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the break, Sam discusses her amazing scoop which showed that multibillion dollar company Runway scraped videos from individual YouTube creators. In the subscribers-section, everyone educates Joseph on what Skibidi is.

• The Backlash Against AI Scraping Is Real and Measurable
• Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones)
• Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal
• AI Video Generator Runway Trained on Thousands of YouTube Videos Without Permission
• Skibidi Toilet Copyright Takedown Request to Garry’s Mod Is Very Dumb

Subscribe at 404media.co for bonus content.

Learn more about your ad choices. Visit megaphone.fm/adchoices