Commonly used · Reading and processing text
uniq: Merge adjacent duplicate rows
Syntax
uniq [-cd] [file]Options
-c- Show repeat count
-d- Show only duplicate rows
Examples
sort data/names.txt | uniqUsage and sandbox support
uniq only processes adjacent duplicate rows, and global deduplication usually starts with sort.
Hands-on exercises
- Count duplicate namesEveryday
Related commands
catRead and concatenate textlessRead text in pagesmoreView text in pagesheadRead the first few linestailRead last few linesgrepFilter text by patternfindFind paths by name or typewcCount lines, words and bytessortSort lines of textcutExtract columns or characterstrReplace or delete characterssedReplace text or select linesawkExtract structured text fieldsdiffCompare two text filesvimEdit files in terminalnanoModify files with a simple editornlNumber lines of texttacOutput lines of text in reverse orderrevReverse characters line by linepasteSplicing text columns horizontallycommCompare sorted listscmpCompare files to see if they are the sameexpandConvert Tab to spacesunexpandConvert leading spaces to TabfoldWrap long textrgFast recursive text searchjqHandle JSONyqHandle YAMLjoinMerge sorted tables by common fieldsfmtReformat paragraphs word by wordcolumnArrange text tablestringsExtract printable text from binaryodView file byte representationhexdumpShow hexadecimal bytesxxdView or restore hex dumpiconvConvert text encodingdos2unixConvert Windows to newlinesplitSplit file by linescsplitSplit text by patternbcEvaluate a numeric expression