← All Tools
Duplicate Remover🔒 100% local
Remove duplicate lines from text while preserving order. Case-sensitive option available.
Input Items (one per line)
Related Tools
Splits text into lines, trims each one, drops the blanks, and keeps the first occurrence of every value, then reports how many lines went in, how many are unique, and how many were removed. Matching folds capitals together unless you tick the case-sensitive box, so Apple and apple count as one item by default. The list is de-duplicated with a set inside the page.
How to use it
- Paste your list, one item per line.
- Leave Case sensitive unticked to fold Apple and apple together, or tick it to treat them as separate entries.
- Press Remove Duplicates and the summary plus the cleaned list appears below; Copy Output takes the whole block.
Worked example
apple
banana
apple
orange
banana
grapebecomesOriginal: 6 items
Unique: 4 items
Removed: 2 duplicates
apple
banana
orange
grapeApple
apple
BananabecomesOriginal: 3 items
Unique: 2 items
Removed: 1 duplicate
Apple
BananaCase-insensitive by default, so the second spelling is dropped and the first one is what survives.
When to use it
- Cleaning a mailing list or a keyword export before you import it somewhere else.
- Collapsing a log column that repeats the same tag hundreds of times.
- Checking whether two pasted lists actually overlap.
What it does not do
- The first spelling wins. With case-insensitive matching, an Apple above an apple keeps Apple rather than normalising the output to lower case.
- Unticking Keep original order changes nothing visible - both code paths keep first-seen order, so the checkbox currently has no effect.
- It works on whole lines only. There is no field-aware or column-based de-duplication for CSV rows, and the interior whitespace of a line is left alone.