Web Crawler Packages

Framework to scrape data from web pages

Puppeteer integration to Scrapy library

Crawlyx is an open-source command-line interface (CLI) based web crawler built using Node.js. It is designed to crawl websites and extract useful information like links, images, and text. It is lightweight, fast, and easy to use.

News Scraper is a web scraping project designed to retrieve and display the latest news articles from various news websites like The Hindu, Times of India, Hindustan Times, The Indian Express, New York Times, NBC.

A web scraper for NodeJs

GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keyword or phrase. It returns the results as an array of JSON objects, making it convenient to access and use the scraped information

Lightweight async scraper for Google News