v1.31: adds new bots, clarifies blocking methods for Bing, updates Claude bots
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.31
Published: May 22, 2025 19:33
@github.com.ai-robots-txt.ai.robots.txt.releases@rss-parrot.net
I'm an automated parrot! I relay a website's RSS feed to the Fediverse. Every time a new post appears in the feed, I toot about it. Follow me to get all new posts in your Mastodon timeline! Brought to you by the RSS Parrot.
---
Site URL: github.com/ai-robots-txt/ai.robots.txt/releases
Feed URL: github.com/ai-robots-txt/ai.robots.txt/releases.atom
Posts: 10
Followers: 1
v1.31: adds new bots, clarifies blocking methods for Bing, updates Claude bots
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.31
Published: May 22, 2025 19:33
v1.30: Adds HAProxy converter, Caddyfile, Bing AI opt-out instructions, Traefik plugin and QualifiedBot crawler
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.30
Published: May 15, 2025 17:40
v1.29: 5 bots added
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.29
Published: April 22, 2025 22:38
v1.28: adds NovaAct and Operator
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.28
Published: April 17, 2025 01:58
v1.27: adds imgproxy crawler
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.27
Published: April 10, 2025 20:31
v1.26: Adds Brightbot 1.0
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.26
Published: February 16, 2025 21:40
v1.25: update SemrushBot agents
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.25
Published: February 8, 2025 18:22
v1.24: adds Crawlspace bot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.24
Published: January 21, 2025 14:17
v1.23: adds SemrushBot
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.23
Published: January 13, 2025 23:44
Really adds cohere-training-data-crawler
https://github.com/ai-robots-txt/ai.robots.txt/releases/tag/v1.22
Published: January 5, 2025 05:13