The Web Robots Pages

Rare The Forge

Place in the album: No. 28,018 of 97,350
Address: robotstxt.org

What the site says

The Web Robots Pages is a reference on robots.txt and the robots exclusion standard, for webmasters.

Play to get it

Free, in your browser. A booster every 10 minutes.

Web TCG is a collectible card game where every card is a real website: 97,350 sites, six worlds, boosters to open.

Is this your website?

Show your visitors: paste this badge on your site. It links back to this page.

Code to paste into your page

<a href="https://web-tcg.com/carte/robotstxt-org"><img src="https://web-tcg.com/badge/robotstxt-org.en.svg" width="320" height="84" alt="My website is a Rare card in Web TCG"></a>

Web TCG is not affiliated with robotstxt.org. Each card presents a public website: its name, its logo and what it says about itself.

You represent this website and would rather it had no card? Ask for its removal.