The littleutils include duplicate file finders, image optimizers, file rename tools, archive recompressors, a tempfile utility, file property tools and others.
This is free and open source software.
Features include:
- Several basic file property query utilities.
- Several file renaming utilities.
- Several lossless image file recompressors.
- Several compressed file recompressors.
- Duplicate file finders (repeats, repeats.pl, and repeats.py). repeats (written in C and sh), repeats.pl (written in perl and using routines from the CryptX module), and repeats.py (written in Python and using routines from the digest module) all search for duplicate files in one or more specified directories, using a three-, four-, or five-stage process. This process works as follows:
- Initially, all files in the specified directories (and all of their subdirectories) are listed as potential duplicates. In the first stage, all files with a unique filesize are declared unique and are removed from the list. In the optional second stage, any files which are actually a
hardlink to another file are removed, since they don’t actually take up any more disk space. In the third, all files for which the first 16384 (for repeats) or 1024 (for repeats.pl and repeats.py) bytes (both adjustable with the -m option) have a unique filehash are declared unique and are removed from the list. In the fourth, all files which have a
unique filehash (for the entire file) are declared unique and are removed from the list. And in the optional fifth stage, all files with matching filehashes are compared using cmp and are printed to stdout if they match. This process is much less disk and CPU intensive than creating full hashes for all files. It is implemented using a combination of the filehash, filenode, filesize, rep_hash, rep_node, rep_size, and tempname utilities. The duff, dupd, fdupes, jdupes, and rdfind commands utilize similar strategies.
- Initially, all files in the specified directories (and all of their subdirectories) are listed as potential duplicates. In the first stage, all files with a unique filesize are declared unique and are removed from the list. In the optional second stage, any files which are actually a
- Secure temporary file creation utility.
- PDF and image comparison utilities.
Website: sourceforge.net/projects/littleutils
Support:
Developer: Brian Lindholm and others
License: GNU General Public License v3.0
Return to Duplicate Files CLI Tools
| Explore Linux | |
|---|---|
 | Best Free and Open Source Software - A huge collection of recommended free and open source software covering every major category. |
 | In-depth Linux Software Reviews - Detailed assessments of Linux software covering features, usability and overall quality. |
 | The Big List of Active Linux Distros - An extensive collection of actively developed Linux distributions. |
 | Open Source Alternatives - Alternatives to software and services from Google, Microsoft, Apple, Adobe, IBM, Autodesk, Oracle and others. |
 | Essential Linux System Tools - Indispensable utilities for monitoring, maintaining and managing Linux systems. |
 | Linux Productivity Tools - Useful utilities for improving productivity and streamlining everyday tasks. |
 | Alternatives to Popular CLI Tools - Modern alternatives to familiar command-line utilities supplied with Linux systems. |
 | Awesome Free Linux Game Tools - Tools, utilities and companion software that improve gaming on Linux. |
 | Machine Learning on Linux - Machine learning and deep learning software, self-hosted applications and practical tools. |
 | Saving Money with Linux - Practical ways to reduce electricity consumption and lower computing costs with Linux. |
 | Linux Candy - Fun, entertaining and sometimes delightfully quirky software from the lighter side of Linux. |
Please read our Comment Policy before commenting.