# redis-web-crawler

> Web Crawler to create directed graph of links among connected sites. Runs with Node.js and stores data with Redis

Latest version **1.0.0** (published 2021-08-15) · MIT license · 0 weekly downloads

> **Deprecated.** This package is deprecated.

## Install

```sh
npm install redis-web-crawler
pnpm add redis-web-crawler
yarn add redis-web-crawler
bun add redis-web-crawler
```

## Health

**Score 10/100 (F)** — status: deprecated.

Negative: deprecated.

## Facts

| | |
|---|---|
| Version | 1.0.0 |
| Published | 2021-08-15 |
| First published | 2021-08-15 |
| Weekly downloads | 0 |
| License | MIT |
| TypeScript types | none |
| Module format | ESM + CommonJS |
| Node | >= 6.0.0 |
| Dependencies | 3 |
| Unpacked size | 9.5 KB |
| Known vulnerabilities | 0 |
| Install scripts | no |
| Author | Spencer Lepine |
| Maintainers | spencerlepine |
| Keywords | node, redis, webcrawler, javascript, crawler, scraper, web-crawler |

## Links

- npm: https://www.npmjs.com/package/redis-web-crawler
- Repository: https://github.com/spencerlepine/web-crawler
- Homepage: https://github.com/spencerlepine/web-crawler#readme
- Issues: https://github.com/spencerlepine/web-crawler/issues
- npm.io page: https://npm.io/package/redis-web-crawler

## Dependencies (3)

- [jsdom](https://npm.io/package/jsdom.md) ^16.7.0
- [redis](https://npm.io/package/redis.md) ^3.1.2
- [node-fetch](https://npm.io/package/node-fetch.md) ^2.6.1

## Alternatives

- [memory-cache](https://npm.io/package/memory-cache.md) — 795.0K weekly downloads
- [@httptoolkit/proxy-agent](https://npm.io/package/@httptoolkit/proxy-agent.md) — 11.2K weekly downloads
- [express-cache-controller](https://npm.io/package/express-cache-controller.md) — 5.3K weekly downloads
- [http-cache-middleware](https://npm.io/package/http-cache-middleware.md) — 4.5K weekly downloads
- [cache2](https://npm.io/package/cache2.md) — 1.5K weekly downloads

## Recent versions

- 1.0.0 (latest) — 2021-08-15

---
_Source: https://npm.io/package/redis-web-crawler · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._