# ccrawler

> configurable web crawler library and cli tool

Latest version **1.2.2** (published 2017-09-05) · ISC license · 0 weekly downloads

## Install

```sh
npm install ccrawler
pnpm add ccrawler
yarn add ccrawler
bun add ccrawler
```

Provides the command `ccrawler`.

## Health

**Score 15/100 (F)** — status: abandoned.

Positive: no vulnerabilities.

Warnings: low downloads; no types; no esm support.

Negative: abandoned; low maintenance score.

## Facts

| | |
|---|---|
| Version | 1.2.2 |
| Published | 2017-09-05 |
| First published | 2017-05-30 |
| Weekly downloads | 0 |
| License | ISC |
| TypeScript types | none |
| Module format | CommonJS |
| Dependencies | 4 |
| Known vulnerabilities | 0 (+1 in 1 direct dependencies) |
| Install scripts | no |
| Author | jsanchesleao |
| Maintainers | jsanchesleao |

## Links

- npm: https://www.npmjs.com/package/ccrawler
- npm.io page: https://npm.io/package/ccrawler

## Dependencies (4)

- [cheerio](https://npm.io/package/cheerio.md) ^1.0.0-rc.1
- [request](https://npm.io/package/request.md) ^2.81.0
- [minimist](https://npm.io/package/minimist.md) ^1.2.0
- [request-promise](https://npm.io/package/request-promise.md) ^4.2.1

## Recent versions

- 1.2.2 (latest) — 2017-09-05
- 1.2.1 — 2017-06-30
- 1.2.0 — 2017-06-30
- 1.1.0 — 2017-06-22
- 1.0.3 — 2017-06-07
- 1.0.2 — 2017-05-30
- 1.0.1 — 2017-05-30
- 1.0.0 — 2017-05-30

## README

# CCrawler

A configurable web crawler

Installation:

`npm install ccrawler`

Or, alternatively

`npm install -g ccrawler`

Simple write a script file and ccrawler will crawl through it. For example:

```
open "http://www.globo.com"
find ".hui-premium__title"
inner-html
```

You can run this file with `ccrawler -f crawlfile`.

## Variables

At any point you can use variables, like `open "http://mysite/${page}"`, and you can pass the variable to the cli with `ccrawler --page foo`

## As a library

```javascript
const ccrawler = require('ccrawler')

ccrawler.execFile('./myfile', {page: 'foo'})
  .then(result => console.log(result))
  .catch(err => console.log(err))
```

---
_Source: https://npm.io/package/ccrawler · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._
