1.0.0 • Published 4 years ago

x-scrape v1.0.0

Weekly downloads
-
License
ISC
Repository
-
Last release
4 years ago

x-scrape

Simple proxy scraper by NeutronX (yaxeldragon)

How it Works

Once you input the URLs you want to look in, It will send a request, check if each proxy is an actual proxy using regex. Then It will give you access to all proxies in an array from an async funcion.

Features

  • Custom URL Scrape.
  • Filter from an HTML document.
  • Check proxies with Regex.
  • Remove all Duplicates.
  • Easily access to all Proxies.
AreaQuick Description
Get StartedHow to start using simple-scrape
How to ScrapeHow to get the Proxies.

Get Started

To install simple-scrape in your project you need to input the following in your console:

npm install simple-scrape

Once simple-scrape is installed you can import it in your project by using the following methods:

const proxy = require('simple-scrape');
const proxies = new proxy([
    '(input URL here)',
    '(another URL here...)'
]);

You can do as many objects as you want with the URLs you want.

How to Scrape

your project by using the following methods:

const proxy = require('simple-scrape');
const proxies = new proxy([
    'http://www.live-socks.net/2020/05/28-05-20-socks-5-servers.html',
    // ^^^^^^^ This Is HTML (It will get filtered)
    'https://api.proxyscrape.com/?request=getproxies&proxytype=socks5'
    // ^^^^^^^ This Is a normal API (RAW text)
]);
proxies.scrape().then(proxies => {
    // Here you can access the Proxies
});

Happy Coding!