robots-txt-validator v0.4.2

robots-txt-validator

Validator to verify robots.txt and sitemaps listed in it

How to use

Install globaly

yarn global add robots-txt-validator

Execute command

robots-validator <sitename.com>

• No need to add robots.txt while specifying domain name
• Example of proper sitename
  • http://www.example.com
  • http://example.com
  • https://www.example.com
  • https://example.com