WS-1001 data direct to WD?

if you had the version with the console, then WD works direct from that, via wifi multicast connection
but if you have the hub version only, that wifi multicast connection does not work it seems
(the hub only uploads direct to wunderground or to a web server you set (which has the .php script on it to update a json file WD can use) in the hub config setup)

But I see that the “web page” of the hub has a place where you can watch the actual values read by the Weather Station, so it is posible to catch this “web page” and parse it to read the values, isn’t it? I will try to program something to do it (when arrive me the Weather Station, probably next week). I am sure that the values of the WS could be read directly from the network. I think that the hub is internally something similar to console, but without screen.

Ruben

For example, this app:
(Sorry, spanish, but you can use translation)
http://software.sonotrigger.com/2015/06/20/personal-weather-station-monitoring/
Here in Google Play: https://play.google.com/store/apps/details?id=com.gmail.joanpao.Weather_PWS
It grab data directly from Hub when it is conected to local network, and from WU when you are outside. So, it could be done, and I think that not very dificult.
I will try to do, and maybe I can ask to the programer.

Ruben

ah
ok
this should be do able, basicly scraping the data from the hub

so you can access the raw data on the hub via a IP address in a web browser?
can you post a screen shot of that?

Not yet… I still haven’t received the unit. Next week probably I will receive.
I can tell you the advances when I receive it.

I have see a phyton program to decode livedata.htm page with the realtime data, but the user also tells that this method could damage the unit (I am not sure, he say that the unit is very basic and can’t handle a petition every 15 seconds all time). I am not sure about it, or the refresh could be done slowly, maybe temperatura isue. I have to try when I receive the unit.

https://obrienlabs.net/code/observerip-weather-station-python-screen-scraping/
https://obrienlabs.net/code/receiving-data-weather-station/
And here, the author of above articles:
https://github.com/weewx/weewx/wiki/observer
Say:
I strongly recommend you do not advertise the scraping method. It is known to cause issues with the ObserverIP unit. The ObserverIP (black box with antenna on it) is an inexpensive unit that can barely survive an uptime of 30 days, let alone screen scraping every 15 seconds.

Ruben

yes, that was my understanding, that the scraping of the data can cause the hub to lock up
you can set WD to get the data from the WU data

I can’t understand why this has to happen… Maybe was a default unit, because weewx suport direct conection scraping web “livedata” page and nobody has reported anything like this. I want to try, because I don’t want to depend of external WU or Internet Connection, or installing an additional web server to handle php… This is not necessary sure. If the unit is sending requests every 16 seconds to PHP server, there is no problem to send txt data of a webpage at same rate.

If you want, I can try to program some additional software (like 1-wire) to poll the data from the hub and pass to WD.

Ruben

your first link , it says clearly that the screen scaping:

This method may cause your ObserverIP to crash!

but its OK to instead set the hub to send the data to a web site php script (that creates the json file that WD can then read in)
I have already outlined that above

Well… I have a, maybe, very good idea, but I can’t try it until I receive the unit.

If scraping is not a good idea, so I will try to implement a very simple “web server” socket based, listening the packets that IP Observer will send, and I think that I could parse and save this data to allow WD process it. So anybody hasn’t to use a webserver to receive the data. When I can test this, I say you Brian, so you could, or implement it on WD or use as separate program to pass the data to WD as 1-wire reader do.

Ruben

you dont need to do any work
its all available
the php script is available
to run on a server
which creates a json file that you set WD to get from the server

Yes, I understant you, but I don’t want to mount a server on the WD computer, I don’t want to run a remote server that doesn’t work when there are a storm and maybe ADSL line goes down. I want a local program that take the data of the weather station and pass it to WD. It is very easy to implement, and much better than depending of other services.

Ruben

the console version of the station does send data via direct TCP/IP socket connection (via the local WIFI)
and WD works with that
but the hub version does not do that

Well, it is really very very easy to parse incoming HTTP requests sent by IP Observer using a socket, no need to scrap screen, no need to start any server.

The code will be like this one. I am doing in C# UWP application, but is easy to do it in any other language.

Start a listener with a socket on port 80:

  
            StreamSocketListener listener = new StreamSocketListener();
            listener.ConnectionReceived += Listener_ConnectionReceived; ;
            listener.Control.KeepAlive = true;
           try
            {
                NotifyUser("Server Online");
                NotifyUser("Waiting messages on port " + port);
                await listener.BindServiceNameAsync(port);
            }
            catch (Exception exception)
            {
                NotifyUser("Fallo inicializando servidor: " + exception.Message);
            }


When receive a packet, htto request is only text. So read, parse parameters and return a correct OK response to de box.


       async private void Listener_ConnectionReceived(StreamSocketListener sender, StreamSocketListenerConnectionReceivedEventArgs args)
        {
            NotifyUserFromAsyncThread("Conexi

---

![Captura de pantalla completa 20032017 180334.jpg|1002x855](upload://uDZViWMVDJLI6tMCmd2UxupoQkC.jpeg)

Well, first version of a “micro IP Observer listener”.
No scrapping, only waiting at programed port. Receive data sended by IP Observer, parse it and save to a file with the same “ws1001.json” file format. You can choose location.

In the IP Observer you have to select “custom” server, and program the IP of the computer when this program runs, and the port that you put on listening program. The listening port is also programable, defect is 85 to leave untouched HTTP port (80) if you have any web server or other program that uses that port (like Skype).

I can’t test it with WD because I am running it on a XP computer, and I have to rebuild it specially for XP. If anyone wants to test it, the program is here: https://www.dropbox.com/s/az9vraga7xsfib9/IPObserverRecMFC.exe?dl=0

The program needs Visual Studio C++ libraries that could be downloaded from here: https://www.microsoft.com/en-US/download/details.aspx?id=53587

UPDATE: Versi


I also have added ability into WD to act as a web server, i.e to listen for http direct IP connection
that ability is there as well
i.e the WiFi IP server->client
settings

in any case, if you could email me the file you have your software creating and set in WD to use (raw script data file)

I have updated the “compatible XP” version to generate also a Weather CSV file, but also seem doesn’t work.

I will try to use your server->client setting… If this work, much better not needing extra software.

Ruben

I am not sure that “WiFi IP server->client” are working… I have tried putting on IP the own IP or the client IP, but neither of both seem to work. I also don’t understant why specity a IP, as it will be a server, so the IP must be set on client… I have changed also Port to 85 that I am using currently.

I attach the files that I am currently generating, and also the “server program” source Project (Visual Studio 2017 C++ with MFC).

Ruben
PD: .txt extensi


IPObserverRecMFC.zip (144 KB)

ws1001.json.csv.txt (181 Bytes)

ws1001.json.txt (927 Bytes)

I see whats wrong
there must have been a slight change to the json format
an extra space
I have accounted for that now
use a new .zip update of WD, ready now

Now is working!

I am not sure I have to put the file location on “URL” TextBox, or on “Select raw script data file”, but in any case I have put the same on both and it works. I try to improve a little my program to allow change update time, because now I change program to receive each 15 seconds. The IP Observer sends me another packet when I close the socket, so it receive more than 1 message per second if I don’t limit it!. I will let user to choose this maximun receiving rate.

I also add some parameters that PHP program calculate (but I don’t know if WD needs it!).

If you add this direct receiving Support to the WD, let me and then this program won’t need anymore.

Thanks in advance.

Ruben
PD: I have realized that on “WD title” appear: “Stationless, VWS data.csv”… is this ok? It is taking csv file or json file? (my program is actually generating both)