Extract-lemmatized-nonstop-words NPM

Extract lemmatized nonstop words

Extracts a pure list of lemmatized words of a text filtered by stop words.

Features

Removing stopwords.
Removing proper noun.
Regular past tense verb and past participle verb to present form: created to create
Present form (3rd person) to present form: creates to create
Plural noun to singular: cats to cat
Gerund form verb to present form: creating to create

Install

install using Yarn:

yarn add extract-lemmatized-nonstop-words

install using NPM:

npm i --save extract-lemmatized-nonstop-words

Usage

const extract = require('extract-lemmatized-nonstop-words');

const words = extract('He created these categories and they are better.');

returns:

Array (3 items)
    0: Object
        lemma: "create"
        normal: "created"
        pos: "VBD"
        tag: "word"
        value: "created"
        vocabulary: "create"
    1: Object
        lemma: "category"
        normal: "categories"
        pos: "NNS"
        tag: "word"
        value: "categories"
        vocabulary: "category"
    2: Object
        lemma: "good"
        normal: "better"
        pos: "JJR"
        tag: "word"
        value: "better"
        vocabulary: "better"

API

extract(text, filter) ⇒ Array.<Object>

Extracts a pure list of lemmatized words of a text filtered by stop words. it will remove non-word tokens, ones which their length is less than 3 and contains non-alphabetic charachters.

Param	Type	Description
text	String	input text
filter	Array.<String>	list of custom stopword which will replace with defaults, in case of passing `false` filtering results by stopwords will ignore.

Annotation Specification

Annotation	Name	Example
`NN`	Noun	`dog` `man`
`NNS`	Plural noun	`dogs` `men`
`NNP`	Proper noun	`London` `Alex`
`NNPS`	Plural proper noun	`Smiths`
`VB`	Base form verb	`be`
`VBP`	Present form verb	`throw`
`VBZ`	Present form (3rd person)	`throws`
`VBG`	Gerund form verb	`throwing`
`VBD`	Past tense verb	`threw`
`VBN`	Past participle verb	`thrown`
`MD`	Modal verb	`can` `shall` `will` `may` `must` `ought`
`JJ`	Adjective	`big` `fast`
`JJR`	Comparative adjective	`bigger`
`JJS`	Superlative adjective	`biggest`
`RB`	Adverb	`not` `quickly` `closely`
`RBR`	Comparative adverb	`less-closely` `faster`
`RBS`	Superlative adverb	`fastest`
`DT`	Determiner	`the` `a` `some` `both`
`PDT`	Predeterminer	`all` `quite`
`PRP`	Personal Pronoun	`I` `you` `he` `she`
`PRP$`	Possessive Pronoun	`I` `you` `he` `she`
`POS`	Possessive ending	`'s`
`IN`	Preposition	`of` `by` `in`
`PR`	Particle	`up` `off`
`TO`	to	`to`
`WDT`	Wh-determiner	`which` `that` `whatever` `whichever`
`WP`	Wh-pronoun	`who` `whoever` `whom` `what`
`WP$`	Wh-possessive	`whose`
`WRB`	Wh-adverb	`how` `where`
`EX`	Expletive there	`there`
`CC`	Coordinating conjugation	`&` `and` `nor` `or`
`CD`	Cardinal Numbers	`1` `7` `77` `one`
`LS`	List item marker	`1` `B` `C` `One`
`UH`	Interjection	`ah` `oh` `oops`
`FW`	Foreign Words	`viva` `mon` `toujours`
`,`	Comma	`,`
`:`	Mid-sent punct	`:` `;` `...`
`.`	Sent-final punct.	`.` `!` `?`
`(`	Left parenthesis	`)` `}` `]`
`)`	Right parenthesis	`(` `{` `[`
`#`	Pound sign	`#`
`$`	Currency symbols	`$` `€` `£` `¥`
`SYM`	Other symbols	`+` `*` `/` `<` `>`
`EM`	Emojis & emoticons	`:)` `❤`