1.2.0 β€’ Published 5 months ago

scanner-duplicate-files v1.2.0

Weekly downloads
-
License
MIT
Repository
github
Last release
5 months ago

πŸ“ Scanner Duplicate Files

npm license

A simple duplicate file scanner for Node.js.

πŸ‡§πŸ‡· Leia em PortuguΓͺs | us Read in English

πŸš€ Installation

Install globally via npm or yarn:

npm install -g scanner-duplicate-files

or

yarn global add scanner-duplicate-files

πŸ“Œ Usage

After installation, you can run the scanner directly in the terminal or add it to your scripts in package.json:

In package.json:

"scripts": {
  "scan-duplicates": "find-duplicates <directory>"
}

Run it directly using npx:

npx scanner-duplicate-files <directory>

Or use it directly from the terminal:

find-duplicates <directory-path>

Example:

find-duplicates ./my-files

Options

  • -d, --delete β†’ Automatically removes detected duplicate files.

Example:

find-duplicates ./my-files --delete

You may want to change the default options. To do this, create an sdfconfig.json file in the root of your project.

{
  "directory": "./", // default: './' - directory to scan for duplicate files
  "ignoreNodeModules": true, // default: true - ignores the node_modules folder
  "includeTypescript": true, // default: true - whether to check TypeScript files
  "includeJavascript": true, // default: true - whether to check JavaScript files
  "ignoreFolders": [ // default: dist and .git - ignores file scanning
    "**/dist/**",    // for duplicates in designated folders
    "**/.git/**"
  ]
}

πŸ”§ How does it work?

  1. Scans the specified directory.
  2. Computes file hashes.
  3. Compares hashes to detect duplicates.
  4. Displays duplicate files and optionally removes them.

! It is not checked if the files have the same names, but if they have the same code/text.

πŸ’» Example Output

⚠️  Duplicate Files Found:
❌ file1.jpg (Duplicate of file2.jpg)
❌ document.pdf (Duplicate of document_backup.pdf)

If the --delete option is used:

πŸ›’οΈ Removed: file1.jpg
πŸ›’οΈ Removed: document.pdf

🐜 License

MIT Β© Rafael Bianchi


🀝 Contributing

We welcome contributions to improve Scanner Duplicate Files!
If you'd like to contribute, follow these steps:

  1. Fork this repository.
  2. Clone your fork:
    git clone https://github.com/BianchiBill/find-duplicate-files.git
  3. Create a new branch for your feature or fix:
    git checkout -b feature/new-feature
  4. Make your changes and commit them:
    git commit -m "feature: add new feature"
  5. Push your changes to your fork:
    git push origin feature/new-feature
  6. Open a pull request on the dev repository.

πŸ›  Development Setup

To set up the project locally, install dependencies:

npm install

or

yarn install

πŸ“’ Suggestions & Issues

If you find a bug or have an idea for improvement, please open an issue.

Thank you for contributing! πŸš€