[PLUG] Finding partial duplicate rows with uniq

Rich Shepard rshepard at appl-ecosys.com
Wed Oct 31 00:36:25 UTC 2012


On Tue, 30 Oct 2012, Dale Snell wrote:

> From the above, may I take it that any data other than the first three
> fields is irrelevant?  If so, use cut(1) to write those fields,
> line-by-line, to a scratch file.  Then sort(1) said file, and use uniq(1)
> to delete the duplicate lines.

Dale,

   Actually, the entire row is relevant, but there may be duplicates in the
first three fields. Technically, each row should be unique, but sometimes
the analytical lab reports strange (and/or inconsistent) results.

Thanks,

Rich




More information about the PLUG mailing list