uniq Archives - LinuxLinks

anewer – appends lines from stdin to a file

anewer appends lines from stdin to a file if they don’t already exist in the file.

anew is a tool for adding new lines to files, skipping duplicates. The software also outputs new lines to stdout.

zet is a command-line utility for doing set operations on files considered as sets of lines. It’s free and open source software.

uq is a simple, user-friendly alternative to sort | uniq. It removes duplicate lines from the output, regardless of the order.

The semiuniq program reads over lines of input and write lines of output that are “semi-unique” by eliminating repeated lines that are close.

runiq offers an efficient way (in both time and space) to filter duplicate entries (lines) from textual input.

nauniq is similar to the Unix command uniq but detects repeated lines even if they are not adjacent. It’s written in Perl.

huniq remove duplicates from the given input. Note that huniq does not sort the input, it just removes duplicates.