Bad Rain Data and How To Correct the Stats and How to make the graphs correct

Hello…this string was added on to another string, but I was asked to make a new string. This is just one of many problems but it is the problem I am dealing with now.

Yesterday I gracefully took down WD and then brought it back up. It “stuttered” on the log file and a .380" rainfall was added every 5 minutes for the “down” time and ended up adding over 8" to my daily rain. I was told to correct the log file and then re-run the graph update.

First of all after a LOT of work I got the daily, monthly, and yearly totals correct in the 72007lg.txt file. Then I re-started WD and went to the Action section and told it to convert the log file to graphs…I noticed the same 8" error as before. I noticed that there was also a dailylog.txt file and I thought maybe the dailylog.txt file re-corrupted the 72007lg.txt file so I manually corrected both, brought WD back up, re-ran the log conversion to graph program and the same 8" spike was there again. I reopened both log files, and the latest line in each had the 8" of rain data in it.

If I fixed both log files, WHERE is the 8" of bad data coming from.

I am obviously missing some steps here…what files do I need to correct and then what steps do I need to take to get both my stats data and graph data to reflect correct data.

Please provide a layman answer with as much detail as possible.

Thanks,

Lew

only correct the 72007lg.txt file
and after you have corrected it, then go action, convert wd logfiles to datafiles
and then click on recreate last 31 days data file

if still no good then zip and email me the logfile and with info on what is wrong where and I will have a look

also, chin up

ps, which version of WD?
as i have improved the data extraction from the irox station recently

OK, did that

and after you have corrected it, then go action, convert wd logfiles to datafiles

My screen is a bit different. If I am in the right place, mine says:

Action - Convert Log File(s) to Graphs (Reset Graphs)

and then click on recreate last 31 days data file

I selected my log file from the menu and then there were several convert options. The closest to your instruction was:

Convert last 31 days data into current data file (and to the right you choose month 7)

I did that, but it doesn’t stop from happening what happens which I guess I didn’t explain well.

Every time I correct the file and reopen it, it automagically adds 8.610" inches of rain to the day’s total which then increments the annual total by that.

It doesn’t seem to want to use the values I am giving it, it is starting by taking the current IROX data AND an additional 8.610" rain so it shows the day as having extra rain which then shows up in the graphs and stats.

I can send the log file and you can see where I restarted the file and it inserted the 8" of rain. Figuring out why is the mystery…

Thanks,

Lew

I forgot to mention that I am also sending you a screen print from the page I tried to follow your instructions on. I just wanted to be sure I was where you meant for me to be. I don’t t hink there is anything on that page that is adding bad data to the log, something external to the log is adding data to the log.

Thanks

the log you sent me has a corrupted line…i.e a line of data is appended to the end of anotherr line
after saving, double check that has not occured (good idea to leave the blinking mouse on a new line when saving), before converting the logfile to data file and then last 31 days data file
see attached


lew.jpg

I noticed that when working on the file the other day. I didn’t know if your program wanted to end at the last character or on a new line. You have now told me a new line. I did it both ways and it didn’t seem to have any effect on the system adding the rain. unfortunately for purposes of this project, it has started to rain so editing the logs will be even harder.

Will try it again your way but I think I did it without success.

Was I going to the right screen and button?

Thanks,

Lew

as long as you have the log file all lined up nicely then you should have no problems converting the logfile to data file and then converting to last 31 days data

i thought it would have been obvious that it would not be a good thing to have 2 lines of data on the same line like that

Hiya…

When you save the corrected file you don’t seen two lines of data on one line as that condition doesn’t exist until you open the file again. As it turns out, two lines of data on one line are unrelated to my problem. As I mentioned, I tried it both ways before but just to be sure, I tried it again. I closed WD, corrected the log, and opened WD again. As soon as it was “up” and receiving data again, I closed WD and opened the log. Sure enough, the same 8.601" inches of rain were added again like before. Here are the last two lines of the log. The top line is my bottom “corrected” line, and the line below was the first new line added to the file by WD:

8 7 2007 17 45 70.0 89 66.6 29.731 5 3 292 0.000 0.138 0.382 8.173 67.3
8 7 2007 17 57 69.4 91 66.7 29.737 3 1 338 0.000 0.138 8.748 16.539 65.9

See the jump from .382 to 8.748…which then jumps the year total from 8.173 to 16.539.

That same “jump” shows up in my stats wherever data for July is shown.

Thanks again,

Lew

you dont say which version and build number of WD you are using
as I have fixed a start up rain bug with the irox station
so make sure you are using the latest version of WD

Hiya…missed the fact you asked for build version. The screen cap I sent you showed the version to be 10.37e but it doesn’t show Build 7. sorry about that…

I thought I had most current version?

Lew

I forgot to ask earlier…how long should I be able to have WD down and not lose data from the Honeywell PWS? The computer was connected to the WD the whole time, so I was assuming data was continuously available on the PC for WD to access when brought back up?

I only had WD down for a 12 minutes stretch to work on the log files and lost .23" of rain. I thought I could take down WD and not lost data in that brief period of time?

Thanks again,

Lew

as stated make sure you have a more recent version of WD to fix/improve the data extraction of missed data from the irox station when wd is not running
also make sure the time and date on the irox station matches that of the PC
note that the irox station data logging interval can be adjusted to be 5 minutes in the data logger setup in wd
as the default is only 30 minutes…which is might have been …which is why it had not stored any data to extract in the 13 minutes wd was not getting the latest data from the console

Hello…

I am confused as usual. I thought the improved IROX method was implemented in 10.37E which I am running now?

The PC Clock and weather console are within seconds of each other.

If by defaul it stores data for 30 minutes and it was down less time then that, I am still unclear where the data was lost?

I am not trying to get sidetracked from the real problem, i.e. the mystery 8" of rain that won’t go away?

Also, the other issues raised in the other topic, i.e. why my web pages don’t upload?

Thanks!

Lew

I have updated from Build 7 to Build 14, the latest I could find on your site, but as I said, I thought the changes relative to IROX were made in an earlier build? Either way, it is updated.

What would you like me to do next?

Thanks,

Lew

If by defaul it stores data for 30 minutes and it was down less time then that, I am still unclear where the data was lost?

if you have not changed from the default 30 minute logging interval, then if the down time is less than 30 minutes, then there wont be any new data to update

I am not sure I understand your answer. I don’t think I changed any update data values. So you are saying 30 minutes of data is saved. Are you saying 30 minutes of data is saved to my PC and without doing anything, WD will “catch up”? If I need to be down for an hour, I should wait 29 minutes and bring it back up, then back down, then I can go another 29 minutes, and bring it up back up?

I don’t want to get sidetracked from the original problem.

I started this message string due to the bad data I have displayed. What do I need to do to resovle that? Do I need to open yet another string regarding my bad data?

My stats and graphs still show 8.8" of rain for the month and the real total is under 1". I need to fix those numbers and don’t know how, never the less figure out how they got off in the first place.

You have the various things you asked for to work on the problem but I haven’t heard anything regarding the 8" since providing that data?

Lew

30 minute data logging interval means that the data is only loggeg once every 30 minutes
setting to 5 minutes is much bettr

hopefully that clears that up

for the rain total corrections, as long as you correct the log file (i.e correct those wrong amounts) (without creating 2 lines on 1 line) and then convert to data file and last 31 days data file and then also correct the rain totals under barometer offset and rainfall setup, then youalso use the latest version of WD (but maybe there is still a bug there where it keeps on getting the same data over and over at start up from the irox station (i need to add a flag to check for that) (but I have fixed a bug where the total rain on the irox console was added to wd’s rain totals each time wd was started up (wd keeps its rain totals separate from the station), you should be OK

follow those steps and see how you go

hopefully that clears up that issue too

Hello again Windy,

I am back to trying to solve my bad rainfall data problem.

Since this was discussed you uploaded the new version to stop the data looping, but my system still seems to be “hanging onto” that erroneous data.

I once again correct the log file up to the current minute. I brough WD down, updated the log, and brought WD back up. Like before it immediately added back in the erroneous rain data so of course all my stats still show the incorrect amount.

Is there a way to correct the value it is reading in which continually throws off my totals.

Here is a snip from the end of the log showing how it once again added in the 8" or rain:

14 7 2007 17 5 79.7 39 52.5 29.864 5 5 338 0.000 0.000 0.576 8.367 79.7
14 7 2007 17 6 79.7 39 52.5 29.864 5 7 315 0.000 0.000 0.576 8.367 79.7
14 7 2007 17 7 79.7 39 52.5 29.864 5 6 338 0.000 0.000 0.576 8.367 79.7
14 7 2007 17 8 79.7 39 52.5 29.864 5 6 338 0.000 0.000 0.576 8.367 79.7
14 7 2007 17 9 79.7 39 52.5 29.864 6 5 338 0.000 0.000 0.576 8.367 79.7
14 7 2007 17 10 79.7 40 53.2 29.864 6 6 338 0.000 0.000 0.576 8.367 79.7
(you can see here the 4 minute gap when I took it down and brought it back up)
14 7 2007 17 14 80.2 39 53.0 29.864 6 7 338 0.000 0.000 8.941 16.732 80.0
(you can see here how the monthly and annual total immediately jumped up)
14 7 2007 17 15 80.4 39 53.2 29.864 5 6 338 0.000 0.000 8.941 16.732 80.1
14 7 2007 17 16 80.4 38 52.5 29.864 6 9 315 0.000 0.000 8.941 16.732 80.1
14 7 2007 17 17 80.4 39 53.2 29.864 6 6 338 0.000 0.000 8.941 16.732 80.1
14 7 2007 17 18 80.4 39 53.2 29.864 6 6 338 0.000 0.000 8.941 16.732 80.1

I did re-run the convert the last 31 days of data but I still have of course this bad data in my stats.

What should I do next sir?

Lew

you need to also set your correct rain totals under control panel, barometer offset and rainfall
(do that before you exit wd and edit the logfile)
to the same totals you are setting in the logfile
(as its those totals (under barometer offset and rainfall setup) that determine the rain amounts in the logfile, not the other way around)

Yes sir, I saw where you told the other guy to do that. I did it before and I did it again as you can see in this screen cap:

Is this the wrong screen to adjust the totals? Would still be better to adjust the INF file or wherever the bad value is being saved, but even if that is too hard to do, it would seem my manual override should be reflected on the console as well as on the daily stats page?

Thanks,

Lew