Skip to content

Remove Duplicate Lines

Paste a list and get only unique lines in their original order.

Keep
Empty lines
Runs in your browser — your data is not uploaded.

How to use

  1. Click Paste to insert your list, one item per line, or click Upload to open a text file.
  2. Choose a Mode and adjust Case sensitive, Ignore leading/trailing spaces and Empty lines as needed. The result updates automatically.
  3. Click Copy to copy the result or Download to save it as a text file.

Examples

Ignore case in a keyword list

Input
Austin plumbers
austin plumbers
Dallas electricians
AUSTIN PLUMBERS
Output
Austin plumbers
Dallas electricians

Collapse repeated log messages

Input
INFO service started
INFO service started
WARN connection lost
WARN connection lost
INFO service started
Output
INFO service started
WARN connection lost
INFO service started

Find SKUs listed only once

Input
MUG-12-BLUE
TOTE-CANVAS
MUG-12-BLUE
CAP-NAVY
TOTE-CANVAS
Output
CAP-NAVY

FAQ

Can I remove duplicate lines without sorting?

Leave Sort set to None to preserve line order. With Mode set to Remove duplicates, set Keep to First to retain each line at its first occurrence, or Last to retain it at its last occurrence.

Does it remove extra spaces from the result?

Ignore leading/trailing spaces affects comparison only. Lines that differ only in surrounding spaces or tabs count as duplicates when this option is on, but the retained line keeps its original spacing.

How do I see which lines were duplicates?

Expand the duplicate values list to see each repeated value, its count and its first line number, regardless of Mode. The table shows up to 1,000 values; Copy duplicates copies all repeated values.

How large can my text file or pasted list be?

Uploaded files larger than 50 MB are rejected. Pasted text has no fixed size limit, but very large lists can slow the page because processing runs on the browser's main thread.

Is my list uploaded or saved?

Your list is processed in your browser; its text is not sent over the network or saved. Only option settings are saved in your browser. The production page uses Google Analytics for tool events, but those events do not include list content.