scrappepper v0.0.9

Installation

Bash

  $ npm install scrappepper

Features

• Friendly text, array manipulation (still under-developing)
• Simplified file exporting : CSV file
• Scalable for applying on the webscrapping application development

How to use

For JS,

  var pepper = require('scrappepper');

generateCsv( json, exportFileConfig )

• Function(s): export to the CSV file

• fields: if valued as [], function will grap the json data structure by ownself. • nested: defaulted as true.

  // [ Simply use ]
  var exportFileConfig = { exportFullPath: 'exports/bigdata.csv' };
  pepper.generateCsv(results, exportFileConfig);

  // [ Advanced use ]
  var exportFileConfig = {
    exportFullPath: 'exports/bigdata.csv',
    fields: [], // OR [ANY fieldnames u liked, but should matched with the key(s) in JSON!!]
    nested: true
  }
  pepper.generateCsv(results, exportFileConfig);

arrayChunk( array, counter )

• Function(s): Chunk 1D-array by counter, and returns 2D-array

• array: 1D-array • counter: number of values your want to group with and put them on the 2nd level array.

arrayDividend( array, partitionString )

• Function(s): Also return 2D-array, but the 1D-array chunked by the indication of "partitionString".

  // [ Simply use ]
  var array = ['abc', 'def', 'partition', 'asdfaf', 'partition', 'akdslkasnm', 'mkljtor']
  console.log( pepper.arrayDividend( array, 'partition' ) );

  // RESULT >>
  // [ ['abc', 'def'], ['asdfaf'], ['akdslkasnm', 'mkljtor'] ]

arrayMode( array )

• Function(s): Return the most frequent / mode value (string)

  // [ Simply use ]
  var array = ['abc', 'def', 'partition', 'asdfaf', 'partition', 'akdslkasnm', 'mkljtor']
  console.log( pepper.arrayMode(array) );

  // RESULT >>
  // 'partition'

arrayRemoveByValue( array, value )

• Function(s): Remain all array, except the value.

  // [ Simply use ]
  var arr = ['a', 'b', 'c', 'd', 'a'];
  console.log( pepper.arrayRemoveByValue(arr , 'a') );

  // RESULT >>
  // [ 'b', 'c', 'd' ]

strConvert( string )

• Function(s): Convert all sequence of characters

  // [ Simply use ]
  console.log( pepper.strConvert('abc') );

  // RESULT >>
  // 'cba'

strContain( fullString, comparingString )

• Function(s): Return ture or false

  // [ Simply use ]
  console.log( pepper.strContain('abc', 'a') );
  console.log( pepper.strContain('abc', 'd') );

  // RESULT >>
  // true
  // false

strSanitized( str )

• Function(s): Remove HTML DOM entitles and decode the HTML names.

  // [ Simply use ]
  console.log( pepper.strSanitized('<strong>abc &amp; laksj</strong>') );

  // RESULT >>
  // 'abc & laksj'

strClassify2Arr( targetedString, regexType, spliter )

• Function(s): Get the string, return the array after the regexType classification.

• regexType: 'email' / 'url' / 'website' • spliter: default as ' '

  // [ Simply use ]
  var str = 'abc ald@gmail.com akjs13 ask@gmail.com 123123';
  console.log( pepper.strClassify2Arr(str, 'email', ' ') );

  // RESULT >>
  // ['ald@gmail.com', 'ask@gmail.com']

Release History

• v0.0.9 23 Mar 2016
  • Update the Readme.md & 'stringHelper.strSanitized'
• v0.0.7, v0.0.8 12 Oct 2015
  • Update the Readme.md & github ref
• v0.0.4 ~ v0.0.6 11 Oct 2015
  • Update the Readme.md
• v0.0.2, v0.0.3 09 Oct 2015
  • Update the Readme.md
• v0.0.1, 09 Oct 2015
  • For "jsonExportHelper", added the function as below 'generateCsv'
  • For "arrayHelper", added the functions as below 'arrayChunk', 'arrayDividend', 'arrayMode', 'arrayRemoveByValue'
  • For "stringHelper", added the functions as below 'strConvert ', 'strContain', 'strSanitized', 'strClassify2Arr'