uniqcp v1.1.0

uniqcp (.bash_history cleaner)

remove duplicated lines in file

Background

To avoid duplicated lines in .bash_history, you can add the below line in .bashrc

export HISTCONTROL=ignoredups

However, when you're working on multiple account/machine (e.g. desktop, notebook), you might want to merge the history file.

In the past I use this way

cat ~/.bash_history > /tmp/a
cat "another .bash_history from other account/machine" > /tmp/a
cat /tmp/a | sort | uniq > ~/.bash_history
rm /tmp/a

But the order is lost.

This program aim to solve this program in a better way.

Installation

Installing npm package (recommended)

npm i -g uniqcp

Installing Go package (slower, deprecated)

go get github.com/beenotung/uniqcp

Usage

Usage: uniqcp [options] <outfile> <infile_1> [...<infile_n>]

Early terminating options:
  -h | --help    : show this help message
  -v | --version : show the software name and version

Optional options:
  -a | --append  : append mode (by default will erase the existing content in the outfile)
  -v | --verbose : verbose mode, show file in process and total number of unique lines

Remark:
  When -v is used with outfile and infile(s), it will be treated as verbose flag. Otherwise, it will be treated as version flag.

Example

for single input file

uniqcp outfile infile1

for multiple input files

uniqcp outfile infile1
uniqcp outfile infile1 infile2 infile3

Features

• read from 1..n file
• skip duplicated line(s)

Todo

• trim leading & tailing space
• only show message with "-v" flag
• show line reduced with optional flag

Further work

As there is no timestamp for each line, how to merge two files keeping the 'real order' is not so direct. welcome to have any suggestion :)

License

BSD-2-Clause Licensed