Loona Automation logoLoona Developer Tools
Home › Developer Tools › CSV Dedupe & Cleaner

CSV Dedupe & Cleaner - Remove Duplicate Rows and Tidy Your Data

In short: the CSV Dedupe & Cleaner removes duplicate rows (whole-row or by the key columns you choose), trims stray whitespace, drops empty rows and normalizes line endings - and shows exact before/after row counts.

Merged exports and repeated imports leave the same rows twice. Paste the CSV, choose what counts as a duplicate, and get a clean file with the counts to prove it.

Private by design: everything in this tool happens 100% in your browser with JavaScript. Your input is never uploaded to a server, never stored and never seen by us - close the tab and everything is gone.

How to use the CSV Dedupe & Cleaner

  1. Paste your CSV.
  2. Optionally name key columns (numbers from 1, or header names) - blank means the whole row must match to count as a duplicate.
  3. Tick trimming, empty-row removal or case-insensitive matching as needed.
  4. Click Dedupe & Clean and check the before/after counts.
  5. Copy or download the cleaned CSV.

How it works

Duplicates are detected with an exact key built from either the whole row or only the key columns you list, joined with a control character that cannot appear in normal data - so ab,c and a,bc can never collide. The first occurrence of each key is kept and later ones are counted as removed. Trimming happens before matching, so " Ali " and "Ali" are recognized as the same value. Output is re-serialized with CRLF line endings and correct quoting. The header row is never removed as a duplicate.

Frequently Asked Questions

Is this dedupe tool free?

Yes - completely free, no sign-up, no cap.

What counts as a duplicate?

By default, rows whose every cell matches. With key columns set, rows that match on just those columns - the first one is kept.

Does trimming affect matching?

Yes, when ticked: cells are trimmed before duplicate detection, so stray spaces do not hide duplicates.

Are counts shown?

Yes - total rows before and after, and exactly how many duplicates were removed.

Is my data uploaded?

No. Cleaning happens 100% in your browser.

Related Developer Tools

Embed this tool on your website — free

Add this tool to your own website or blog — it is completely free, needs no sign-up, and always shows the latest version. Copy the code below and paste it into your page where you want the tool to appear. Keeping the small “Powered by Loona Automation” credit line under the embed helps keep this tool free — but you are free to style or remove it; the tool works either way.