Mr-roboto NPM | npm.io

Mr-Roboto

Mr-Roboto is aimed at handling and parsing a website's robots.txt file, providing a easy interface to validate if a specific path is allowed or not.

Mr-Roboto is NOT production ready, and as such should not be used in any mission critical codebase.

camelcase normalize-url request request-promise-native

@infinitebrahmanuniverse/nolb-mr @everything-registry/sub-chunk-2210 @zalastax/nolb-mr

0.1.0-alpha.0

8 years ago