[PLUG] Capture of CSV data

[Ken Stephens]

Chuck Hast wrote:
> Hmmm I guess I did not get the data sample in it. Here
> is a sample. I know how to get csv files into spead sheets
> and i have sort of a idea of getting them into a db, but
> how do I handle a stream of data like that below. All of them are CSV
> formated, so once I can
> get one into something I can graph and twiddle, the rest should be easy.
>
>
> Pth,ID,TRACK#,Mld,COUNT#,Path,InspRes1,InspRes2,Status,EOData
> GET / HTTP/1.1
> Host: 172.20.90.7:9030
> User-Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:30.0)
> Gecko/20100101 Firefox/30.0
> Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
> Accept-Language: en-US,en;q=0.5
> Accept-Encoding: gzip, deflate
> Connection: keep-alive
>
> 06/23/2014,13:53:58.640,Pas,20482,000014,000,0534435,0x0011,0x00000000,0x00000000,0x0800013e,EOData
> 06/23/2014,13:53:59.125,Pas,20482,000015,000,0534436,0x0011,0x00000000,0x00000000,0x0800013f,EOData
> 06/23/2014,13:53:59.562,Pas,20482,000001,000,0534437,0x0011,0x00000000,0x00000000,0x08000131,EOData
> 06/23/2014,13:53:59.937,Pas,20482,000002,000,0534438,0x0011,0x00000000,0x00000000,0x08000132,EOData
> 06/23/2014,13:54:00.328,Pas,20482,000003,000,0534439,0x0011,0x00000000,0x00000000,0x08000133,EOData
> 06/23/2014,13:54:00.796,Pas,20482,000004,000,0534440,0x0011,0x00000000,0x00000000,0x08000134,EOData
> 06/23/2014,13:54:01.375,Pas,20482,000005,000,0534441,0x0011,0x00000000,0x00000000,0x08000135,EOData
> 06/23/2014,13:54:01.843,Pas,20482,000006,000,0534442,0x0011,0x00000000,0x00000000,0x08000136,EOData
> 06/23/2014,13:54:02.125,Pas,20482,000007,000,0534443,0x0011,0x00000000,0x00000000,0x08000137,EOData
> 06/23/2014,13:54:02.328,Pas,20482,000008,000,0534444,0x0011,0x00000000,0x00000000,0x08000138,EOData
> 06/23/2014,13:54:02.593,Pas,20482,000009,000,0534445,0x0011,0x00000000,0x00000000,0x08000139,EOData
> 06/23/2014,13:54:02.906,Pas,20482,000010,000,0534446,0x0011,0x00000000,0x00000000,0x0800013a,EOData
> 06/23/2014,13:54:03.250,Pas,20482,000011,000,0534447,0x0011,0x00000000,0x00000000,0x0800013b,EOData
> 06/23/2014,13:54:03.625,Pas,20482,000012,000,0534448,0x0011,0x00000000,0x00000000,0x0800013c,EOData
> 06/23/2014,13:54:03.968,Pas,20482,000013,000,0534449,0x0011,0x00000000,0x00000000,0x0800013d,EOData
> 06/23/2014,13:54:04.328,Pas,20482,000014,000,0534450,0x0011,0x00000000,0x00000000,0x0800013e,EOData
> 06/23/2014,13:54:04.687,Pas,20482,000015,000,0534451,0x0011,0x00000000,0x00000000,0x0800013f,EOData
> 06/23/2014,13:54:05.62,Pas,20482,000001,000,0534452,0x0011,0x00000000,0x00000000,0x08000131,EOData
> 06/23/2014,13:54:05.437,Pas,20482,000002,000,0534453,0x0011,0x00000000,0x00000000,0x08000132,EOData
> 06/23/2014,13:54:05.781,Pas,20482,000003,000,0534454,0x0011,0x00000000,0x00000000,0x08000133,EOData
> 06/23/2014,13:54:06.140,Pas,20482,000004,000,0534455,0x0011,0x00000000,0x00000000,0x08000134,EOData
> 06/23/2014,13:54:06.484,Pas,20482,000005,000,0534456,0x0011,0x00000000,0x00000000,0x08000135,EOData
> 06/23/2014,13:54:06.875,Pas,20482,000006,000,0534457,0x0011,0x00000000,0x00000000,0x08000136,EOData
> 06/23/2014,13:54:07.203,Pas,20482,000007,000,0534458,0x0011,0x00000000,0x00000000,0x08000137,EOData
> 06/23/2014,13:54:07.562,Pas,20482,000008,000,0534459,0x0011,0x00000000,0x00000000,0x08000138,EOData
>
>
>
>
> On Mon, Jun 23, 2014 at 1:43 PM, Rich Shepard <rshepard at appl-ecosys.com>
> wrote:
>
>> On Mon, 23 Jun 2014, Chuck Hast wrote:
>>
>>> I have many machines in the plant that output data in CSV format Here is
>> a
>>> example of one, I have kept the start up header which I believe is
>>> actually from the browser, but the lines of data are what I am wanting to
>>> capture so it can be graphed both historically and in real time. To
>> obtain
>>> this data I just aim a browser at a address:PortNum where the address is
>>> that of the machine in question and the PortNum is the port number the
>>> data is available on. It is flowing continously:
>> Chuck,
>>
>>     I fail to see a question here.
>>
>> Rich
>> _______________________________________________
>> PLUG mailing list
>> PLUG at lists.pdxlinux.org
>> http://lists.pdxlinux.org/mailman/listinfo/plug
>>
>
>
Chuck,

Are you asking how to scrape this from the machine?  If so, then use 
Perl or PHP to write to a file.  You could use wget on a cron, too. 
There are many ways to skin this cat.

Ken