[PLUG] Removing Duplicate Rows from SQL Dump

[Rich Shepard]

On Mon, 15 Aug 2011, Neal wrote:

> Try uniq: http://unixhelp.ed.ac.uk/CGI/man-cgi?uniq

NealS,

   Thank you! I've been unaware of this tool despite years of using linux.

   This will work for all completely duplicated lines. I'll need to see how
many remain that vary in one or more columns ('fields') such as the
parameter, lab_id number, or qa_qc.

Much appreciated,

Rich