# recrawler

> Remote web content crawler done right.

Latest version **2.0.0** (published 2017-02-11) · MIT license · 0 weekly downloads

## Install

```sh
npm install recrawler
pnpm add recrawler
yarn add recrawler
bun add recrawler
```

## Health

**Score 15/100 (F)** — status: abandoned.

Positive: no vulnerabilities.

Warnings: low downloads; no types; no esm support.

Negative: abandoned; low maintenance score.

## Facts

| | |
|---|---|
| Version | 2.0.0 |
| Published | 2017-02-11 |
| First published | 2017-02-11 |
| Weekly downloads | 0 |
| License | MIT |
| TypeScript types | none |
| Module format | CommonJS |
| Node | >=4.0.0 |
| Dependencies | 2 |
| Known vulnerabilities | 0 (+1 in 1 direct dependencies) |
| Install scripts | no |
| Author | EGOIST |
| Maintainers | rem |
| Keywords | crawler, scraper |

## Links

- npm: https://www.npmjs.com/package/recrawler
- Repository: https://github.com/egoist/recrawler
- Homepage: https://github.com/egoist/recrawler#readme
- Issues: https://github.com/egoist/recrawler/issues
- npm.io page: https://npm.io/package/recrawler

## Dependencies (2)

- [cheerio](https://npm.io/package/cheerio.md) ^0.20.0
- [node-fetch](https://npm.io/package/node-fetch.md) ^1.5.1

## Recent versions

- 2.0.0 (latest) — 2017-02-11

## README

# recrawler [![NPM version](https://img.shields.io/npm/v/recrawler.svg)](https://npmjs.com/package/recrawler) [![NPM downloads](https://img.shields.io/npm/dm/recrawler.svg)](https://npmjs.com/package/recrawler) [![Circle CI](https://circleci.com/gh/egoist/recrawler/tree/master.svg?style=svg)](https://circleci.com/gh/egoist/recrawler/tree/master)

> Remote web content crawler done right.

## Motivation

Sometimes I want to grab some nice images from a url like http://bbs.005.tv/thread-492392-1-1.html, so I made this little program to combine `node-fetch` and `cheerio` to make my attempt fulfilled. 

## Install

```bash
$ npm install --save recrawler
```

For Single Page Apps please head to [recrawler-nightmare](https://github.com/egoist/recrawler-nightmare)

## Usage

```js
const recrawler = require('recrawler')

recrawler('http://some-url.com/a/b/c')
	.then($ => {
		$('img.nice-images').each(function () {
			const url = $(this).attr('src')
			console.log(url)
		})
	})
```

## API

### recrawler(url, opts)

#### opts

##### cheerio

[cheerio](https://github.com/cheeriojs/cheerio) options. Except `decodeEntities` is `false` by default here.

## License

MIT © [EGOIST](https://github.com/egoist)

---
_Source: https://npm.io/package/recrawler · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._
