vite-plugin-robots
Vite plugin for generating robots.txt for production and development builds
Vite plugin for generating robots.txt for production and development builds
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Generate Robots.txt file with your custom configs
A TypeScript-based project for easy serving of static files with support for live reloading, compression, and typed requests.
Web Builder Module - Create robots.txt file
Parser for robots.txt
robots.txt text generator
Generate a robots.txt file for your Astro site
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers. (Extended version by mastixmc)
Site mapper utilizing puppeteer to generate a xml sitemap
Kerouac robots exclusion components for Bixby.js.
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
The presidential package of robots.txt generators. A joint task force of elite directives securing the perimeter against unauthorized bots.
A package to generate sitemaps for Next.js applications
## About
A CLI tool to generate robots.txt and sitemap.xml for React projects by scanning for routes