1.1.3 • Published 8 years ago
fetch-giles v1.1.3
A request library that checks for robots.txt and has a blacklist feature.
Very much in alpha. Use at own risk.
A request library that checks for robots.txt and has a blacklist feature.
Very much in alpha. Use at own risk.