research-tool
An easy way to map websites
1.0.0 • Published 3 years ago
Web-scraping Packages
rebrowser-patches
Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.
rebrowser-patches-fadi-patch
Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.
rebrowser-playwright
A drop-in replacement for playwright patched with rebrowser-patches. It allows to pass modern automation detection tests.
rebrowser-playwright-core
A drop-in replacement for playwright-core patched with rebrowser-patches. It allows to pass modern automation detection tests.
rebrowser-puppeteer
A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.
rebrowser-puppeteer-core
A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.
socials_regex
🪡 Social account detection and extraction in js, e.g. for crawling/scraping.
social-profile-scraping
A lightweight library for scraping public social media profiles, providing profile information such as usernames, pictures, and more.
google-search-ts
A TypeScript library for performing Google searches with support for proxy, pagination, and customization
google-reviews-scraping
A nodejs tool for scraping Google Reviews using Puppeteer.
google-lens-image-sources-api
A Node.js API for retrieving image sources using Google Lens.
hyperbrowser-mcp
Hyperbrowser Model Context Protocol Server
hyperbrowser-test-mcp
Hyperbrowser Model Context Protocol Server
googlethis-augmented
A fork of googlethis to get specific data for different needs.
lexico-dictionary
A module that scrapes the Lexico dictionary to get meaning of words, examples etc.
linktree-parser
linktree-parser is a TypeScript library for scraping and extracting account, links, banners, and metadata from Linktree profiles.
link-view
A Node.js package to generate link previews from URLs
manga-web-scripting-fabio
A package to scrape images of manga chapters from mangaonline.biz
markdown-crawler
A powerful web crawler that extracts content from web pages and converts them to clean Markdown format, with support for code blocks and GitHub Flavored Markdown