cloudy cloudy

Author Topic: Getting Historical Data with WeatherFlow  (Read 979 times)

0 Members and 1 Guest are viewing this topic.

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 60.0.3112.113
    • North Fort Myers Weather
Getting Historical Data with WeatherFlow
« on: September 25, 2017, 10:53:20 PM »
Brain,

Just talked to the guys at WeatherFlow and they say you can request past data from the WeatherFlow servers via the REST interface. Could this be implemented?

I've had WD flatline a couple of times and it would be nice to be able to fill in the data that was missed.

Thanks!

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 60.0.3112.113
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #1 on: September 26, 2017, 02:48:13 AM »
should be possible
they are sending me a unit, so that will make it much easier to work on that
was there a lost internet connection or similar re the flat line , or?

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 60.0.3112.113
    • North Fort Myers Weather
Re: Getting Historical Data with WeatherFlow
« Reply #2 on: September 26, 2017, 04:17:43 AM »
I am currently getting data over UDP and it will flatline maybe every 2 weeks or so. Not sure what is causing it, doesn't appear that that there was any power loss. Restarting WD fixes it. I have a second WD running getting data from a Davis unit and it doesn't flatline. Once you get a chance to get the historical data thing figured out let me know and I'll test it.

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 60.0.3112.113
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #3 on: September 26, 2017, 06:43:58 PM »
what I need to do then maybe is force a reset/re connection of the UDP connection when  flat line is detected?

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 60.0.3112.113
    • North Fort Myers Weather
Re: Getting Historical Data with WeatherFlow
« Reply #4 on: September 26, 2017, 11:47:52 PM »
That might help, wouldn't know unless it is tried. Don't know much about how this stuff works :)

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 60.0.3112.113
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #5 on: September 26, 2017, 11:55:15 PM »
when the data flow next stops, see if there is any error under view, program event log
and see if going into the weather station type and resetting the station type gets the data flowing again
as a test

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 60.0.3112.113
    • North Fort Myers Weather
Re: Getting Historical Data with WeatherFlow
« Reply #6 on: September 27, 2017, 11:44:47 AM »
Will do the next time it happens.

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 61.0.3163.100
    • North Fort Myers Weather
Re: Getting Historical Data with WeatherFlow
« Reply #7 on: October 20, 2017, 10:54:03 PM »
It flatlined again, this is the error in the program event log (or something like this as I forgot to copy the exact wording) :(

Error: Read past end of file

Resetting the station type didn't help.

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 61.0.3163.100
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #8 on: October 20, 2017, 11:42:15 PM »
ah
what I will need to do is to get you a debug version that will hopefully pin point where in the code that error is occuring
there is some clues in the errors, something to do with a file...

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 61.0.3163.100
    • North Fort Myers Weather
Re: Getting Historical Data with WeatherFlow
« Reply #9 on: October 20, 2017, 11:53:18 PM »
Happened again, here is the error message

ERROR: Read beyond end of file  System.SysUtils at time/date 18:51:16:469 10/20/2017

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 61.0.3163.100
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #10 on: October 21, 2017, 12:00:56 AM »
it might be the lightninglog.txt
try deleting that (either in the logfiles or web files)

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 61.0.3163.100
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #11 on: October 21, 2017, 12:01:55 AM »
i.e that logfile might be very large

Offline hankster

  • Posts: 1,256
  • North Fort Myers FL
  • OS/Browser:
  • Mac OS X 10.11.6
  • Chrome 61.0.3163.100
    • North Fort Myers Weather
Re: Getting Historical Data with WeatherFlow
« Reply #12 on: October 21, 2017, 02:05:23 AM »
The ightninglog.txt file was only about 1K in size (not much lightning lately). WD kept flatlining immediately, I had to reboot the computer to get it to run correctly again.

On that note, I did go back and download the past 3 days data from the hub, worked flawlessly and it was fast downloading!

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 61.0.3163.100
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #13 on: October 21, 2017, 02:19:15 AM »
so its not that file that is the problem
I do use a shared memory address to get the data from the cronweatherflow program
I wonder if that is the cause of the problem
i could change the way I do that

Offline Weather Display

  • Posts: 82,636
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 61.0.3163.100
    • Weather Display
Re: Getting Historical Data with WeatherFlow
« Reply #14 on: October 21, 2017, 03:10:13 AM »
try a new .zip update...new way of getting data (new cronweather program and new WD update)