tdm-skeeft v0.0.1

tdm-skeeft

tdm-skeeft is a tdm module for terme exctraction of structured text. It can be used to get keywords (or summary) of document.

Installation

Using npm :

$ npm i -g tdm-skeeft
$ npm i --save tdm-skeeft

Using Node :

/* require of Skeeft module */
const Skeeft = require('tdm-skeeft');

/* Build new Instance of Matrix */
let matrix = new Skeeft.Matrix();

/* Build new Instance of Indexator */
let indexator = new Skeeft.Indexator();

Launch tests

$ npm run test

Build documentation

$ npm run docs

API Documentation

Classes

Functions

Indexator

Kind: global class

• Indexator
  • new Indexator([options])
  • .summarize(xmlString, selectors, indexation, delimiter) ⇒ Array
  • .index(xmlString, selectors, criterion) ⇒ Array

new Indexator(options)

Returns: Indexator - - An instance of Indexator

Example (Example usage of 'contructor' (with paramters))

let options = {
    'filters': {
      'title' : customTitleFilter, // According customTitleFilter contain your custom settings
      'fulltext' : customFulltextFilter, // According customFulltextFilter contain your custom settings
    },
    'dictionary': myDictionary, // According myDictionary contain your custom settings
    'stopwords': myStopwords // According myStopwords contain your custom settings
  },
  indexator = new Indexator(options);
// returns an instance of Indexator with custom options

Example (Example usage of 'contructor' (with default values))

let indexator = new Indexator();
// returns an instance of Indexator with default options

indexator.summarize(xmlString, selectors, indexation, delimiter) ⇒ Array

Summarize a fulltext

Kind: instance method of Indexator
Returns: Array - List of extracted sentences (representative summary)

Example (Example usage of 'summarize' function)

let indexator = new Indexator();
indexator.summarize(xmlString, {'title' :'title', 'segments': ['paragraph1', 'paragraph2']}, indexator.index(xmlString)); // return an ordered Array of Object [{...}, {...}]

indexator.index(xmlString, selectors, criterion) ⇒ Array

Index a fulltext

Kind: instance method of Indexator
Returns: Array - List of extracted keywords

Example (Example usage of 'index' function)

let indexator = new Indexator();
indexator.index(xmlString, {'title' :'title', 'segments': ['paragraph1', 'paragraph2']}); // return an ordered Array of Object [{...}, {...}]

Matrix(options)

Constructor

Kind: global function
Returnsthis:

Example (Example usage of 'contructor' (with paramters))

let options = {
    'boost': 20
  },
  matrix = new Matrix(options);
// returns an instance of Matrix with custom options

Example (Example usage of 'contructor' (with default values))

let matrix = new Matrix();
// returns an instance of Matrix with default options

• Matrix(options)
  • instance
    • .init(indexations, selectors)
    • .fill(criterion)
    • .stats(m)
    • .select(stats, boost, criterion)
  • static
    • .sort(terms, compare)
    • .compare(a, b)

matrix.init(indexations, selectors)

Init each values of this object

Kind: instance method of Matrix
Returns{object}: Return 'this' reference

matrix.fill(criterion)

Fill a matrix with values of choosen criterion

Kind: instance method of Matrix
Returns{matrix}: Return a mathsjs matrix filled with values (and )

matrix.stats(m)

Calcul some statistics

Kind: instance method of Matrix
Returns{object}: Return an object with some statistcs :

• FR (rappel d’étiquetage),
• FP (précision d’étiquetage),
• FF (F-mesure d’étiquetage),
• rowsFF (nb of terms for each rows of FF matrix),
• colsFF (nb of terms for each columns of FF matrix),
• mFF (mean of FF)

matrix.select(stats, boost, criterion)

Select terms

Kind: instance method of Matrix
Returns{object}: Return an object with selected terms

Matrix.sort(terms, compare)

Sort all terms with the 'compare' function

Kind: static method of Matrix
Returns{array}: Return the array of sorted terms

Matrix.compare(a, b)

Compare two elements depending of its factor

Kind: static method of Matrix
Returns{integer}: return 1, -1 or 0