# scapegpt

> Use GPT-4 to scrape any remote website based on a URL. This is a simple wrapper around the [OpenAI API](https://beta.openai.com/docs/api-reference/introduction) that allows you to scrape any website using GPT-4.

Latest version **1.0.0** (published 2023-04-23) · ISC license · 0 weekly downloads

## Install

```sh
npm install scapegpt
pnpm add scapegpt
yarn add scapegpt
bun add scapegpt
```

## Health

**Score 5/100 (F)** — status: abandoned.

Positive: no vulnerabilities.

Warnings: low downloads; no types; no esm support.

Negative: insecure dependencies; abandoned; low maintenance score.

## Facts

| | |
|---|---|
| Version | 1.0.0 |
| Published | 2023-04-23 |
| First published | 2023-04-23 |
| Weekly downloads | 0 |
| License | ISC |
| TypeScript types | none |
| Module format | CommonJS |
| Dependencies | 8 |
| Unpacked size | 9.2 KB |
| Known vulnerabilities | 0 |
| Install scripts | no |
| Maintainers | koolamusic |

## Links

- npm: https://www.npmjs.com/package/scapegpt
- npm.io page: https://npm.io/package/scapegpt

## Dependencies (8)

- [jsdom](https://npm.io/package/jsdom.md) ^21.1.1
- [openai](https://npm.io/package/openai.md) ^3.2.1
- [parse5](https://npm.io/package/parse5.md) ^7.1.2
- [cheerio](https://npm.io/package/cheerio.md) ^1.0.0-rc.12
- [winston](https://npm.io/package/winston.md) ^3.8.2
- [tiktoken](https://npm.io/package/tiktoken.md) github:dqbd/tiktoken
- [structlog](https://npm.io/package/structlog.md) ^1.0.5
- [css-select](https://npm.io/package/css-select.md) ^5.1.0

## Recent versions

- 1.0.0 (latest) — 2023-04-23

## README

# Scrape GPT

Use GPT-4 to scrape any remote website based on a URL. This is a simple wrapper around the [OpenAI API](https://beta.openai.com/docs/api-reference/introduction) that allows you to scrape any website using GPT-4.

## Installation

```bash
npm i scrapegpt
```

## Usage

```js
const scrape = require('scrapegpt');

const url = 'https://www.bbc.com/news/world-us-canada-57982050';

scrape(url).then((result) => {
  console.log(result);
});
```

## Resources

- [OpenAI API](https://beta.openai.com/docs/api-reference/introduction)
- [Nodejs Scraping](https://gabrieleromanato.name/nodejs-parsing-a-remote-html-page)
- [Scrape HTML](https://www.npmjs.com/package/scrape-html)
- [Scrapeghost.PY](https://github.com/jamesturk/scrapeghost/)
- [Scrape It](https://www.npmjs.com/package/scrape-it-core)

---
_Source: https://npm.io/package/scapegpt · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._