Deduplication Packages

Create an iterator which removes consecutive duplicated values.

Create an iterator which removes consecutive values that resolve to the same value according to a provided function.

A powerful file deduplication tool that quickly identifies and manages duplicate files. Features both CLI and web interfaces, detailed visual reporting, automatic cleanup options, and smart space-saving statistics. Reclaim your storage space with ease.

Find and manage duplicate files

A file management system for node.js application making managements of files easier, all in one code, you can delete, move, etc, files all in one code, making ability to manage a system eg a application requiring transfering of files in folders easier

Astrohelm file system watcher

A TypeScript library for enhancing array manipulation with asynchronous operations such as mapping, filtering, and deduplication.

Redis-based message deduplication store for message-queue-toolkit

Variable sized rolling chunks. Good for deduplication.

Automatic matching of Blue Button JSON data (detection of new, duplicate and partial match entries).

[](https://www.npmjs.com/package/@trieb.work/nextjs-turbo-redis-cache) ![Turbo redis cache image](https://github.com/user-attachments/assets/98e0dfd9-f38a-42ad-a355-98437