# easycrawler

> Simple and Easy Crawler library for Node.js

Latest version **1.0.1** (published 2016-12-24) · MIT license · 0 weekly downloads

## Install

```sh
npm install easycrawler
pnpm add easycrawler
yarn add easycrawler
bun add easycrawler
```

## Health

**Score 15/100 (F)** — status: abandoned.

Positive: no vulnerabilities.

Warnings: low downloads; no types; no esm support.

Negative: abandoned; low maintenance score.

## Facts

| | |
|---|---|
| Version | 1.0.1 |
| Published | 2016-12-24 |
| First published | 2015-06-02 |
| Weekly downloads | 0 |
| License | MIT |
| TypeScript types | none |
| Module format | CommonJS |
| Dependencies | 3 |
| Known vulnerabilities | 0 (+4 in 2 direct dependencies) |
| Install scripts | no |
| GitHub stars | 3 |
| Author | Adil Lach |
| Maintainers | dante62 |
| Keywords | spider, crawler, search, scraper, website, web-crawler, node-crawler, js-crawler, spider, web-search, links, url |

## Links

- npm: https://www.npmjs.com/package/easycrawler
- Repository: https://github.com/SamirL/easycrawler
- Issues: https://github.com/SamirL/easycrawler/issues
- npm.io page: https://npm.io/package/easycrawler

## Dependencies (3)

- [url](https://npm.io/package/url.md) 0.10.3
- [request](https://npm.io/package/request.md) 2.42.0
- [underscore](https://npm.io/package/underscore.md) 1.8.3

## Alternatives

- [base64url](https://npm.io/package/base64url.md) — 6.1M weekly downloads
- [get-installed-path](https://npm.io/package/get-installed-path.md) — 502.9K weekly downloads
- [@uppy/url](https://npm.io/package/@uppy/url.md) — 185.8K weekly downloads
- [@d3fc/d3fc-shape](https://npm.io/package/@d3fc/d3fc-shape.md) — 16.2K weekly downloads
- [localizer](https://npm.io/package/localizer.md) — 226 weekly downloads

## Recent versions

- 1.0.1 (latest) — 2016-12-24
- 1.0.0 — 2016-12-24
- 0.2.2 — 2016-09-16
- 0.2.1 — 2015-10-18
- 0.2.0 — 2015-10-18
- 0.1.2 — 2015-06-04
- 0.1.1 — 2015-06-04
- 0.1.0 — 2015-06-02

## README

Easy Crawler
========

A simple webcrawler for Node.js supporting Concurrent Connections and Queues.

## Installation

	npm install easycrawler

## Usage
```javascript
var Crawler = require('easycrawler');

var crawler = new Crawler({
	thread: 5,
	logs: true,
	depth: 2,
	headers : {'user-agent' : 'foobar'},
	onlyCrawl : ['reddit', 'reddit.com'], //will only crawl urls containing these strings
	reject : ['rutube'], //will reject links containing rutube
	onSuccess : function(data){
		//console.log(data.url);
		//console.log(data.body);
	},
	onError : function(data){
		//console.log(data.url);
		//console.log(data.status);
	},
	onFinished : function(urls){
		//console.log(urls.crawled);//urls.crawled for visited urls;
		//console.log(urls.discovered);//urls.discovered for discovered urls
	}
});


crawler.crawl('http://www.reddit.com/');
```

---
_Source: https://npm.io/package/easycrawler · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._