cloudy cloudy

Author Topic: WDL not getting clientraw data  (Read 4961 times)

0 Members and 1 Guest are viewing this topic.

Offline Heuer

  • Posts: 45
  • Nottingham, Great Britain
  • OS/Browser:
  • Win NT 10.0
  • Chrome 51.0.2704.103
WDL not getting clientraw data
« on: July 28, 2016, 06:36:00 PM »
For the last couple of weeks there has been no automatic ftp update to my site: www.myetype.co.uk I am using Meteohub and I have checked it can connect and successfully ftp uploads the test file to the correct WDL directory. The local Meteohub WDL console works and shows the latest data as does the dashboard. Data is being sent correctly and regularly to Weather Underground. FTP upload is activated but the files will not upload. The Davis Vantage Pro console shows all the correct data. If I manually move the latest clientraw files across to the server WDL displays the latest data.  Any thoughts?
Davis VP2+ and Envoy,

Offline Weather Display

  • Posts: 84,321
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 52.0.2743.82
    • Weather Display
Re: WDL not getting clientraw data
« Reply #1 on: July 28, 2016, 06:39:45 PM »
is there some sort of debug info?

Offline Heuer

  • Posts: 45
  • Nottingham, Great Britain
  • OS/Browser:
  • Win NT 10.0
  • Chrome 51.0.2704.103
Re: WDL not getting clientraw data
« Reply #2 on: July 29, 2016, 10:48:03 AM »
Only this:
WD00709 - 2016-07-29 09:56:01
Clientraw not updated since last read: http://www.myetype.co.uk/clientraw.txt?cb=1469786161 - 12345 1.7 2.5 187 19.4 87 1007.0 1.60 50.10 408.40 0.00 0.05 - - - 19 - - 0 0.00 - - - - - - - - - 19 10 01 Oxton-19:10 0 26 28 07 - - - - - - - 19.4 24.8 19.5 9.7 19 Increasing_clouds_and_warmer._Precipitation_possible_within_12_to_24_hours._Windy. 0 1.9 1.8 2.0 2.9 4.1 3.4 5.0 4.0 3.2 2.3 0.7 0.2 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.4 13.0 17.2 880 28/07/2016 24.3 10.3 19.5 9.7 0.0 1.9 1.8 2.0 2.9 4.1 3.4 5.0 4.0 3.2 2.3 18.5 17.2 15.9 15.3 15.2 16.4 18.9 19.2 18.1 16.4 0.00 0.00 0.00 0.00 0.00 1.60 0.00 0.00 0.00 0.00 19.5 9.7 19.4 7.0 0 _ _ 180.0 _ 0 - - - - - - - 220.0 - - - 1013.6 1007.1 4.3 18:17 12:30 - - 17.0 8.4 3.6 2016 _ 0 0 1 180 158 158 158 158 180 180 180 180 203 - - 1.7 - 53.884167 1.02 - 96.0 60.0 - 01:49 !!C10.37Of!! - LT=1469733001 RT=1469733001
Davis VP2+ and Envoy,

Offline Weather Display

  • Posts: 84,321
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 52.0.2743.82
    • Weather Display
Re: WDL not getting clientraw data
« Reply #3 on: July 29, 2016, 06:05:07 PM »
does the time change in the clientraw.txt file?

Offline wvdkuil

  • Wim van der Kuil
  • Posts: 770
  • Amsterdam / Netherlands
  • OS/Browser:
  • Mac OS X 10.10.5
  • Chrome 51.0.2704.103
    • My private weatherstation
Re: WDL not getting clientraw data
« Reply #4 on: July 29, 2016, 06:24:01 PM »
For the last couple of weeks there has been no automatic ftp update to my site: www.myetype.co.uk I am using Meteohub and I have checked it can connect and successfully ftp uploads the test file to the correct WDL directory. The local Meteohub WDL console works and shows the latest data as does the dashboard. Data is being sent correctly and regularly to Weather Underground. FTP upload is activated but the files will not upload. The Davis Vantage Pro console shows all the correct data. If I manually move the latest clientraw files across to the server WDL displays the latest data.  Any thoughts?
As this is strictly a Meteohub problem,  you better ask this on the http://www.wxforum.net/index.php?board=116.0 which is the meteohub thread
or on the http://forum.meteohub.de/index.php

As the times in the clientraw do not change there is no upload done.
if you set in Meteohub in tab "Graph uploads" the setting at the bottom Store local copy in "/public/myweb/uploads/"
then you can use your lan to see if the local copy is more recent.

Also check the system tab => Data:   xxxMB of yyyMB used (ZZ%)
If that ZZ is 100% your data area is full, you need to make room by deleting old data.

You can then post your findings on the correct forum,

Wim

Vantage VUE with a WLIP used for https://weer.sluispark.be/
Vantage VP2 with a USB logger/Meteobridge for https://www.weerstation-herent.be/

Offline Weather Display

  • Posts: 84,321
  • Davis VP2
  • New Zealand
  • OS/Browser:
  • Win NT 10.0
  • Chrome 52.0.2743.82
    • Weather Display
Re: WDL not getting clientraw data
« Reply #5 on: July 29, 2016, 06:26:27 PM »
I was going to suggest to post in the supporting forum..but I think people must get sick of me doing that all the time...

Offline wvdkuil

  • Wim van der Kuil
  • Posts: 770
  • Amsterdam / Netherlands
  • OS/Browser:
  • Mac OS X 10.10.5
  • Chrome 51.0.2704.103
    • My private weatherstation
Re: WDL not getting clientraw data
« Reply #6 on: July 29, 2016, 06:29:24 PM »
 :wink:
I was going to suggest to post in the supporting forum..but I think people must get sick of me doing that all the time...
:wink:
Vantage VUE with a WLIP used for https://weer.sluispark.be/
Vantage VP2 with a USB logger/Meteobridge for https://www.weerstation-herent.be/

Offline Heuer

  • Posts: 45
  • Nottingham, Great Britain
  • OS/Browser:
  • Win NT 10.0
  • Chrome 51.0.2704.103
Re: WDL not getting clientraw data
« Reply #7 on: July 30, 2016, 12:36:53 PM »
Thanks. I have checked the data directory on the Meteohub and it shows 35% full. I am already storing a local copy of the clientraw files and they are updating regularly. If I ftp & drag the latest versions to the WDL directory on the server it updates and WDL shows today's info. So the clientraw files are being generated, the local Meteohub WDL console displays correctly, I can ftp a test file to the server but the clientraw files are not getting regularly updated. There is nothing in the Meteohub logs to suggest a ftp upload has failed. So it seems like the files are being 'sent' but not received by WDL.

My first port of call was the Meteohub forum but I am not getting much joy there: http://forum.meteohub.de/viewtopic.php?f=25&t=11248
Davis VP2+ and Envoy,

Offline niko

  • syzygy
  • Global Moderator
  • Posts: 27,263
  • Crystal Ball broken! Please post the URL.
  • Northern California, U.S.A.
  • OS/Browser:
  • Win 7/Srvr 2008R2
  • Chrome 51.0.2704.106
Re: WDL not getting clientraw data
« Reply #8 on: July 30, 2016, 01:20:43 PM »
Sorry to be equally unhelpful, but if you/we/I can't see an updated file in a browser @ http://www.myetype.co.uk/clientraw.txt then neither can WDL, that's the bottom line :dontknow:

If you are SURE that meteohub is uploading the file then maybe your next step is to ask your webhost if they are running any caching process that is delaying serving the fresh file to the world.

Offline wvdkuil

  • Wim van der Kuil
  • Posts: 770
  • Amsterdam / Netherlands
  • OS/Browser:
  • Mac OS X 10.10.5
  • Chrome 51.0.2704.103
    • My private weatherstation
Re: WDL not getting clientraw data
« Reply #9 on: July 30, 2016, 02:03:57 PM »
Thanks. I have checked the data directory on the Meteohub and it shows 35% full. I am already storing a local copy of the clientraw files and they are updating regularly. If I ftp & drag the latest versions to the WDL directory on the server it updates and WDL shows today's info. So the clientraw files are being generated, the local Meteohub WDL console displays correctly, I can ftp a test file to the server but the clientraw files are not getting regularly updated. There is nothing in the Meteohub logs to suggest a ftp upload has failed. So it seems like the files are being 'sent' but not received by WDL.

My first port of call was the Meteohub forum but I am not getting much joy there: http://forum.meteohub.de/viewtopic.php?f=25&t=11248
1. I attach a screenshot of the two tabs in Meteohub and how they should look for the 4 clientraw files.
2. Especially important tab => Setup Push services => box FTP upload => line Directory
What is specified there?  It should start with something like httpdos/ or html/ or similar in 98% of the websites.  It is the full directory path at your provider.
When using an ftp program you normaly start lower than the root directory where you want your clientraw files uploaded to.
So you should also check with your FTP program if these files are maybe placed into another (lower level) folder.
3. What happens if you press the button "Save and Test" ?
Does the testfile arrive at the expected location? Does is has a new timestamp or is it an old testfile?

This is the wiKi of my template which describes shortly how to set the FTP for the template: http://leuven-template.eu/dokuwiki28/doku.php?id=en:uploadmh4#ftp_settings

Success, Wim
Vantage VUE with a WLIP used for https://weer.sluispark.be/
Vantage VP2 with a USB logger/Meteobridge for https://www.weerstation-herent.be/

Offline wvdkuil

  • Wim van der Kuil
  • Posts: 770
  • Amsterdam / Netherlands
  • OS/Browser:
  • Mac OS X 10.10.5
  • Chrome 51.0.2704.103
    • My private weatherstation
Re: WDL not getting clientraw data
« Reply #10 on: July 30, 2016, 02:28:37 PM »
It is not clear to me where you want the clientraw files to go to.
You mention a  wdl/ directory but the wd/ config file in the root expects the files to be in the root.

http://www.myetype.co.uk/clientraw.txt  = old file 2016-07-28 19:10, three days ago
http://www.myetype.co.uk/wdl/clientraw.txt = file dated 2016-07-31 14:11  that is today
http://www.myetype.co.uk/wdlconfig.xml  = list no location for the files, neither does the html at www.myetype.co.uk

The more recent files in the wdl/ can be read and seem not to be cached, normal 200 response with recent date but file seems old indeed.
At 14:23 GMT a http code 200
Code: [Select]
Date:Sat, 30 Jul 2016 14:23:30 GMT
ETag:"b152e8a2-2af-538da20f965ac"
Last-Modified:Sat, 30 Jul 2016 13:13:10 GMT
A few minutes later same Last-Modified:Sat, 30 Jul 2016 13:13:10 GMT

So the files in the root and in the wdl/ folder are not updated by Meteohub indeed.

But your WD-Live xml does not even look into the wdl/ folder and always shows the 19:10 data from the clientraw files in the root.

Wim


Vantage VUE with a WLIP used for https://weer.sluispark.be/
Vantage VP2 with a USB logger/Meteobridge for https://www.weerstation-herent.be/

Offline Heuer

  • Posts: 45
  • Nottingham, Great Britain
  • OS/Browser:
  • Win NT 10.0
  • Chrome 51.0.2704.103
Re: WDL not getting clientraw data
« Reply #11 on: July 30, 2016, 02:38:56 PM »
This is how it has always been:





The clientraw files are pointed into the root directory and using anything other than / cause the upload to fail on test. Test files arrive in the correct place every time with different time stamps


I tried changing the destination of the clientraw files and put a set of them (manually) in /wdl as a test to see if they updated - they did not, so now deleted. So the files should go into the root as they always have.
.
« Last Edit: July 30, 2016, 02:42:11 PM by Heuer »
Davis VP2+ and Envoy,

Offline wvdkuil

  • Wim van der Kuil
  • Posts: 770
  • Amsterdam / Netherlands
  • OS/Browser:
  • Mac OS X 10.10.5
  • Chrome 51.0.2704.103
    • My private weatherstation
Re: WDL not getting clientraw data
« Reply #12 on: July 30, 2016, 02:57:31 PM »
OK, next question.

The test upload is done when you press the button. There is no problem with special characters in username or password at that time.

But the regular uploads are done with cron such as   ftp://username:password@hostname/

And that facility does not want any spacial characters  such as :  or * or @ in the password as those are reserved characters.

Did you by any change change the ftp password recently?

===

If you have a normal password can you put another invalid password in the password field and see if and where the ftp error messages arrive in the log?

Wim
Vantage VUE with a WLIP used for https://weer.sluispark.be/
Vantage VP2 with a USB logger/Meteobridge for https://www.weerstation-herent.be/

Offline Heuer

  • Posts: 45
  • Nottingham, Great Britain
  • OS/Browser:
  • Win NT 10.0
  • Chrome 51.0.2704.103
Re: WDL not getting clientraw data
« Reply #13 on: July 30, 2016, 03:13:42 PM »
Yes I changed the p/w recently and yes there are special characters (* &) in there. I have just changed the p/w to not include special characters and the clientraw upload is back working again!

Many thanks for the fantastic insight! Never realised the special characters would be a problem as it does not appear to be documented in the Meteohub wiki.
Davis VP2+ and Envoy,

Offline niko

  • syzygy
  • Global Moderator
  • Posts: 27,263
  • Crystal Ball broken! Please post the URL.
  • Northern California, U.S.A.
  • OS/Browser:
  • Win 7/Srvr 2008R2
  • Chrome 51.0.2704.106
Re: WDL not getting clientraw data
« Reply #14 on: July 30, 2016, 03:39:48 PM »
Wow, good catch Wim  8O