3.0.0 • Published 5 years ago
lightscrape v3.0.0
lightscrape
Simple Node.js module for scraping various sites
Installing
npm i lightscrape
const lightscrape = require('lightscrape');
Available functions
Every function returns a promise that resolves to an array of results
- free_proxy_list(): http
- live_socks(): socks5
- pastebin(language): id<=49 invalid or empty language results in no filter
- duckduckgo(query): url<=29 only the first page of results
- google(query): url risk for getting temporarily blocked if you search too much
Scraping 49 javascript pastes
lightscrape.pastebin('javascript').then(ids => {
console.log(ids.length + ' JavaScript pastes:', ids);
});
More samples can be found in test.js