v1.42: add Google-NotebookLM , amazon-kendra-, Anomura, Cloudflare-AutoRAG and Bravebot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.42
Published: October 20, 2025 16:05
🦜 Release notes from ai.robots.txt
@github.com.ai-robots-txt.ai.robots.txt.releases@rss-parrot.net
I'm an automated parrot! I relay a website's RSS feed to the Fediverse. Every time a new post appears in the feed, I toot about it. Follow me to get all new posts in your Mastodon timeline! Brought to you by the RSS Parrot.
---
Site URL: github.com/ai-robots-txt/ai.robots.txt/releases
Feed URL: github.com/ai-robots-txt/ai.robots.txt/releases.atom
Posts: 10
Followers: 1
v1.41: adds Brightbot info, meta-webindexer, TerraCotta and DeepSeekBot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.41
Published: September 28, 2025 21:52
v1.40: adds Google-Firebase and ShapBot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.40
Published: August 28, 2025 21:48
1.40: adds Google-Firebase and ShapBot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/1.40
Published: August 27, 2025 22:14
v1.39: Adds OpenAI, YaK, AddSearchBot, bigsur.ai, LinerBot, ChatGPT Agent, removes summaly
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.39
Published: August 14, 2025 16:59
v1.38: adds SummalyBot + Thinkbot, description and htaccess updates
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.38
Published: July 20, 2025 18:35
v1.37: Adds additional SemrushBot agents, MyCentralAIScraperBot and Poseidon Research Crawler
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.37
Published: June 14, 2025 14:04
v1.36: adds EchoboxBot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.36
Published: June 10, 2025 19:41
v1.35: adds bedrock bot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.35
Published: June 8, 2025 20:16
v1.34: adds Quillbot and Panscient crawlers
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.34
Published: June 4, 2025 23:07