1.2.0 • Published 2 years ago

body-snatchers v1.2.0

Weekly downloads
3
License
MIT
Repository
github
Last release
2 years ago

Get the HTML text bodies from web pages

Get a single body

const { getBody } = require('body-snatchers')

const bodyString = await getBody('https://news.ycombinator.com/', false)

Multiple bodies

const { getBodies } = require('body-snatchers')

const bodyStrings = await getBodies([
  { url: 'https://news.ycombinator.com/' },
  { url: 'https://google.com/', js: true } // page that requires JavaScript
])

Motivation

  • Ease burden on CPU (requests pages one at a time)
  • Work on Raspberry Pi (tested on 2, 3, 4*)