0.0.3-alpha.3 • Published 6 years ago

scraperkit v0.0.3-alpha.3

Weekly downloads
-
License
ISC
Repository
-
Last release
6 years ago

Scraperkit

Common utility functions that regularly need in web scrapper apps.

getHTML

const { getHTML } = require('scraperkit');
const res = await getHTML('https://example.com', {
  prerender: true,
  puppeteerLaunchConfig: {
    executablePath: `/Applications/Google Chrome.app/Contents/MacOS/Google Chrome`
  }
});
console.log(res);

getSelectors

const htmlContent = `<html>...</html>`;
const selectors = getSelectors(htmlContent, ['meta', 'h1']);

TODO

  • Add proxy support for getHTML
  • Make it easy to debug issues

Resources

@sindresorhus/isaxioscheerioowpuppeteer-core
@infinitebrahmanuniverse/nolb-scra@everything-registry/sub-chunk-2718
0.0.3-alpha.3

6 years ago

0.0.3-alpha.1

6 years ago

0.0.3-alpha.0

6 years ago

0.0.2-alpha.19

6 years ago

0.0.2-alpha.18

6 years ago

0.0.2-alpha.17

6 years ago

0.0.2-alpha.16

6 years ago

0.0.2-alpha.15

6 years ago

0.0.2-alpha.14

6 years ago

0.0.2-alpha.13

6 years ago

0.0.2-alpha.11

6 years ago

0.0.2-alpha.10

6 years ago

0.0.2-alpha.9

6 years ago

0.0.2-alpha.8

6 years ago

0.0.2-alpha.7

6 years ago

0.0.2-alpha.6

6 years ago

0.0.2-alpha.5

6 years ago

0.0.2-alpha.4

6 years ago

0.0.2-alpha.3

7 years ago

0.0.2-alpha.2

7 years ago

0.0.2-alpha.1

7 years ago

0.0.2-alpha.0

7 years ago

0.0.1

7 years ago

0.0.0

7 years ago