MCP

Robots Txt Ai Crawler Audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

Claim this listing

Connect your GitHub to prove you own or maintain this listing. We verify repo access automatically — most publishers are confirmed in seconds.

1Connect GitHub

2Submit your claim

3Auto-verified, or reviewed within 48h