Deduplication Packages

util for yarn.lock

command line lead deduplication in js

Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.

A standalone in-memory tracker for deduplication, deferral, and change detection of events.

A package that provides helper methods for common and not-so-common use cases

Checks the similarity of 2 marc records using neural network.

command line lead deduplication in js

Merges two arrays into one and removes duplicates

Deduplicates items in an array

Find and manage duplicate files

A file management system for node.js application making managements of files easier, all in one code, you can delete, move, etc, files all in one code, making ability to manage a system eg a application requiring transfering of files in folders easier

Astrohelm file system watcher

Variable sized rolling chunks. Good for deduplication.

Use array methods to process tree-structured data

<h1 align="center">ngx-dedup</h1>

[](https://www.npmjs.com/package/nestjs-request-deduplication) [](https://gith

Rapid Asymmetric Maximum (RAM) is a high throughput, hash-less, byte shift-resistant content-defined chunking algorithm for data deduplication.

A package to detect similar Gmail addresses based on Gmail's unique addressing rules.

Create an iterator which removes consecutive duplicated values.

Create an iterator which removes consecutive values that resolve to the same value according to a provided function.