semvec/pypi-packages huggingface dataset:
deduplicator 1.0.0
Rapid file deduplication utility for Unix systems
Keywords: deduplication hardlinks backup duplicates

# Deduplicator

Locate duplicate files and optionally deduplicate them using hard links.
Can be used with both python2 and python3.

Example usage:

```sh
find . -print0 |  python3 deduplicator.py -0 --dry-run --hardlink
```