# @textlint-rule/tokenize-english

> Tokenizer for english sentences

Latest version **2.0.2** (published 2022-09-10) · Apache-2.0 license · 0 weekly downloads

## Install

```sh
npm install @textlint-rule/tokenize-english
pnpm add @textlint-rule/tokenize-english
yarn add @textlint-rule/tokenize-english
bun add @textlint-rule/tokenize-english
```

## Health

**Score 15/100 (F)** — status: abandoned.

Positive: no vulnerabilities.

Warnings: low downloads; no types; no esm support.

Negative: abandoned; low maintenance score.

## Facts

| | |
|---|---|
| Version | 2.0.2 |
| Published | 2022-09-10 |
| First published | 2022-09-10 |
| Weekly downloads | 0 |
| License | Apache-2.0 |
| TypeScript types | none |
| Module format | CommonJS |
| Dependencies | 1 |
| Unpacked size | 27.6 KB |
| Known vulnerabilities | 0 |
| Install scripts | no |
| Author | GitBook |
| Maintainers | azu, nodaguti, 0x6b, hata6502, textlint-user |

## Links

- npm: https://www.npmjs.com/package/@textlint-rule/tokenize-english
- Repository: https://github.com/textlint-rule/tokenize-english
- Issues: https://github.com/textlint-rule/tokenize-english/issues
- npm.io page: https://npm.io/package/@textlint-rule/tokenize-english

## Dependencies (1)

- [lodash](https://npm.io/package/lodash.md) ^4.17.21

## Recent versions

- 2.0.2 (latest) — 2022-09-10
- 2.0.1 — 2022-09-10
- 2.0.0 — 2022-09-10

## README

# @textlint-rule/tokenize-english

Javascript tokenizer for english sentences.

### Installation

```
$ npm install @textlint-rule/tokenize-english
```

### Usage

```js
var tokenize = require('@textlint-rule/tokenize-text')();
var tokenizeEnglish = require('@textlint-rule/tokenize-english')(tokenize);

var tokens = tokenizeEnglish.sentences("On Jan. 20, former Sen. Barack Obama became the 44th President of the U.S. Millions attended the Inauguration.")

/*
[ { index: 0,
    value: 'On Jan. 20, former Sen. Barack Obama became the 44th President of the U.S.',
    offset: 74 },
  { index: 74,
    value: ' Millions attended the Inauguration.',
    offset: 36 } ]
*/
```

---
_Source: https://npm.io/package/@textlint-rule/tokenize-english · Machine-readable twin of the npm.io package page. Health data is recomputed on every publish._