webwalker-x v1.2.0

WebWalker

A Web Scraping library.

Features

• Integrated proxy rotation (if a proxy list is provided)
• Rate limit
• Configurable routing
• Automatic retries on fail
• Integrated fast HTML parser. Cheerio
• Integrated support for parsing XML
• Integrated powerful and configurable HTTP Client. axios

Sample usage