Web crawler Packages

Lightweight async scraper for Google News

A Scraper for Project Gutenberg allowing you to use it for scraping data into datasets, very customizable and friendly

멜론 음원 서비스의 여러 데이터를 JSON으로 변환하는 크롤러

A CLI web crawler written in TypeScript

Framework to scrape data from web pages

Puppeteer integration to Scrapy library

Crawlyx is an open-source command-line interface (CLI) based web crawler built using Node.js. It is designed to crawl websites and extract useful information like links, images, and text. It is lightweight, fast, and easy to use.