Robotstxt | npm.io

Awesome generator robots.txt

8.0.3 • Published 4 years ago

A webpack plugin to output a robots.txt file

8.0.0 • Published 2 years ago

Parser for robots.txt

0.10.1 • Published 7 years ago

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

2.0.3 • Published 2 years ago

Basic robots.txt generator plugin for Hexo

0.2.0 • Published 9 years ago

Promise based parser for robots.txt files.

3.2.0 • Published 4 years ago

Basic robots.txt generator plugin for Hexo with Host options

0.2.1 • Published 7 years ago

RFC 5234 spec compliant robots.txt builder and parser. 🦾

3.0.0 • Published 3 months ago

A simple, RFC-compliant robots.txt parser

0.2.0 • Published 7 months ago

Generate a robots.txt for Astro

1.0.0 • Published 8 months ago

React Robots.txt file Generator

1.0.7 • Published 3 years ago

Robotstxt Packages