Extracting WD logfiles

Not really web related since it would need to have a way to deal with timeouts, but that could be added. I modified the script that processed the GSOD climate data to instead process WD logfiles and do it in CLI mode.

In particular, I did years 2006 and 2007, Jan - Dec (except Dec 2007).

It took about a Minute and 30 seconds to run the 34 logfiles I put there.

It did show that I still have some bad data in the logs. I had some temp problems with my VP1 that would cause it to peg high’s or below zero lows and then jump back to normal as if nothing ever happened. I thought I had gotten rid of them all, but looking at the data, apparently not.

Below is a sample run:

Output report of VPLog Extraction

Now I can go and find the bad data, and either correct it, or remove it from the logs

After I move the rest of my logs over, I could then use the same script modified a bit, to collect and find all the highs and lows for any data found in the log files and then update my Station records as I know some of them are out of wack due to the temp sensor issues.