PSS #2: Finding Duplicate Lines in a text file
Okay, so today I found another reason to really dig PowerShell. I had a text file that was populated with a large number of lines to text, each on their own line. I found that this file had a decent amount of duplicate lines in it. There were over 1,200 lines in the file to start with.
In order to verify I had duplicates, since it wasn’t blatantly obvious, I dragged and dropped the file into Excel which created a single column of text, one line per row.