uses hash maps instead of pair comparisons
processes files in chunks
separate result tables
virtual rendering (renders only visible rows)
What is next?
optimized fuzzy + normalized duplicate detection
offline semantic approximation first
Handles 65k+ entries easily
No freeze
No crash
Linear time duplicate detection
View 1 → all entries
View 2 → text/phrase duplicates
View 3 → shortcut duplicates
✅ fast search
✅ fast import
✅ scalable architecture
✅ uploads .txt, .csv, .xls, .xlsx, .docx
✅ fuzzy text similarity (AI-like duplicate detection)
✅ address parsing (street + number detection)
✅ URL canonicalization (Google redirect cleanup)
✅ group duplicates by meaning
✅ choose “best version” automatically
✅ duplicate merge tool
✅ highlight why entries are duplicates
✅ semantic matching (same intent text detection)
✅ same text ignoring case
✅ same URL with/without trailing /
✅ extra spaces removed
✅ punctuation normalized
✅ address text normalized
✅ shortcut similarity
✅ “almost same” lines (normalized comparison)
✅ What it does >
This tool can:
🔧 Repair
Multiline text fix
Whitespace cleanup
Invisible character removal
Correct Gboard format
🔍 Duplicate tools
Find duplicate shortcuts
Find duplicate text
Remove duplicates
Export duplicates → doubles.txt
📚 Organization
Alphabetical sorting
Search function
Table preview
📦 Export
Error-free dictionary.txt
Separate doubles.txt
All entries
Text duplicates (phrase side)
Shortcut duplicates
chunk loading
virtual table rendering
hash detection
This tool can :
multiline tekst fix
whitespace cleanup
invisible char removal
juiste Gboard format
dubbele shortcuts vinden
dubbele teksten vinden
duplicates verwijderen
duplicates exporteren → doubles.txt
alfabetisch sorteren
zoekfunctie
preview tabel
foutloze dictionary.txt
aparte doubles.txt
