Online de-duplication tool for you to mention online de-duplication tool, go to the duplicate line, the list of content into the text box, one per line, click on the de-duplication button, you can get a list of non-repetitive data, you can realize the text of txt de-duplication, js de-duplication, java array de-duplication, .net array to remove duplicates and so on.