1.0.0 • Published 6 years ago
robotxt v1.0.0
Robotxt
A declarative multi-environment robots.txt generator
Known Issues
- [] Order matters in the rulesets you provide.
userAgent
should be first (for now). - [] Test the content of the robots.txt file
Install
Global: npm i -g robotxt
Development: npm i -D robotxt
How To Use
See tests.
How To Configure
See Options.
1.0.0
6 years ago