Our Bot

Name of our bot: DomainStatsBot
Bot Type: Good (Identifies itself, has an official moniker)
User Agent: DomainStatsBot/1.0 (
Obeys Robots.txt: Yes
Category: Marketing

Our bot is built to crawl very little of each domain.
If you see any issue please contact us so that we can fix it before deciding to block our bot.

Please note that we cache the contents of the robots.txt file and it might be requested by our bot some time before our bot request other pages.

What DomainStatsBot crawl

  • The home page of a domain and a maximum of 80 internal pages no more than once a month.

Validating our bot

  • Check the reverse DNS lookup of the IP and it will resolve to otherwise it is fake.

How to block our bot

  • Option 1: Check for the word DomainStatsBot in the user agent string and block if it appears.
  • Option 2: Use your /robots.txt file and block DomainStatsBot.

Contact Us: