# scraper-framework

> scraper framework

Latest version **2.0.0** (published 2015-05-23) · GPL license · 0 weekly downloads

## Install

```sh
npm install scraper-framework
pnpm add scraper-framework
yarn add scraper-framework
bun add scraper-framework
```

## Health

**Score 15/100 (F)** — status: abandoned.

Positive: no vulnerabilities.

Warnings: low downloads; no types; no esm support.

Negative: abandoned; low maintenance score.

## Facts

| | |
|---|---|
| Version | 2.0.0 |
| Published | 2015-05-23 |
| First published | 2015-05-23 |
| Weekly downloads | 0 |
| License | GPL |
| TypeScript types | none |
| Module format | CommonJS |
| Dependencies | 4 |
| Known vulnerabilities | 0 (+3 in 2 direct dependencies) |
| Install scripts | no |
| Author | lukluk |
| Maintainers | lukluk |

## Links

- npm: https://www.npmjs.com/package/scraper-framework
- npm.io page: https://npm.io/package/scraper-framework

## Dependencies (4)

- [string](https://npm.io/package/string.md) ^1.8.1
- [cheerio](https://npm.io/package/cheerio.md) 0.15.0
- [express](https://npm.io/package/express.md)
- [request](https://npm.io/package/request.md) 2.34.0

## Recent versions

- 2.0.0 (latest) — 2015-05-23

## README

#Scraper engine
>complate solutions for build scraper API service, easy to use 

#How to use

```
npm install scraper-engine
```
create app.js and write
```
var port=4000;
require('scraper-engine').start(__dirname,port);
```

```
$ node app.js
Scraper Engine Started (port 4000)...
```
and open your browser

http://localhost:4000/output.json?site=**controller**

## example controller

http://localhost:4000/output.json?site=4shared&key=bruno

##How it work


Example: Olx Controller
```
var S = require('string');
exports.scraper = {
    name: 'OLX',
    url: function () {
        return "http://olx.co.id/all-results/q-batu-bacan/"
    },
    rows: function ($) {
        return $('.offer');
    },
    fields: {
        title: function ($) {
            return S($.find('.link.linkWithHash').text()).trim().s;
        },
        price: function ($) {
            return S($.find('.price').text()).trim().s;
        },
        image: function ($) {
            return $.find('.linkWithHash img').attr('src');
        }


    }

}
```

#Author
##luklukaha@gmail.com

---
_Source: https://npm.io/package/scraper-framework · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._