WXSIM-Lite 2016-09-02-12Z Bad Data.

Hi this mornings 12Z run contained bad data for me on hour (+66)

wxsim-lite 2016-09-02-12Z bad data.

+63,11.4,6.0,11.5,280.8,82.8,1020.7,276.6,0.2,20.0,171.7,5622.3,0.10,
+66,-273.1,-272.0,452.7,270.0,0.0,0.0,14.7,-273.1,47236.0,19.6,-3.3,10.22,
+69,9.3,6.5,5.9,306.1,96.9,1021.8,276.6,0.7,10.2,176.9,5639.2,0.00,

regards,

Tony you prompted me to check mine and I have the same error. Does this show up as an error somewhere for you or is it ignored and the programs seem to run OK? I am not seeing any errors with this.

Stuart

Hi Stuart,
Good question, I will try and answer it, hopefully without confusing you.

Q1 :> Does the Error show up somewhere or is it ignored and the programs seem to run OK
A1 :> Generally NO, the newest version of WxSim-Lite can handle these errors and does not throw a dialog box error (though I think it shows up near bottom of WxSim-Lite itself) but never seen it.
A1:1 :> This particular time was different, we had local network issues around the same time - so the file only par downloaded (this threw the correct (“error 62 : input past end of file”)) just a coincidence that it happened on this run. If it had downloaded fully with the error line as well, it would not have thrown the error as per mentioned earlier and it would allow the WXSIM Forecast to still run without error.

Comment : I am not seeing any errors with this.
Reply : I am never usually near the weather PC (usually at the other end of property at work), so the only reason I know each time that WxSim-Lite GFS Data has a corrupt line or has not downloaded or was not available (or has NaN’s which seems to be fixed as had none for ages) is by way of my own automated checks.

1: Via Cron Job - I grab a copy of the latest gfs.wxsim.com/lite/ (Data file for my location) and store it on my host server located in Sydney (about 1090 odd km away) prior to the scheduled WxSim-Lite Run.
I started this way back at the start of testing WxSim-lite due to the NaN issues mainly (which seem to have now been resolved). But it servers a few purposes:

1. My host server has never failed to capture the latest (unless it did not exist or the gfs.wxsim.com/lite/ server was down). In the beginning on Sam’s server he stored the previous zulu run as well, so we could always grab that if our local download failed for whatever reason, or on occasion’s Sam would rerun a failed run, so I could pick up a good file. Previous runs are no longer stored to my knowledge.
2. With my Host Server stored copy I run a very basic script to check for NaN’s and emails me if there are NaN’s or if the file did not exist or server was not available to download from.
3. In this recent case it allowed me to download my Host Server copy (even though it had an error) as by the time I could get to the Weather PC after work the 12z run had been replaced with 18Z on gfs.wxsim.com/lite/ .
4. Then my final automated checks which are the fail safe alert to email me when a Zulu Run has not been used in the latest Forecast, what I do is at the end of every forecast when uploading WxSim data to my Host Server, is also upload the (“gfslatest.txt”) and (“lastgoodgfs.txt”) files which I cross reference with another basic script (run via Cron Job) to check that the Latest GFS is equal to the Last Good GFS, this is also automatically displayed of my Weather Sites Status Page (see image below).

2: One script I would like to fathom out is to check for the rouge data lines (I’ve not been able to script that) the NaN one was simple.

As I said, I do all this as my Weather PC is normally in black screen mode at the other end of the property, I only get a chance to look at it on days off or the odd occasion when forced to correct an issues with whatever.
Hopefully that answers your question,
Kind Regards,

Hi,
This evenings " 2016-09-09 06Z " WxSim-Lite data, bad for me again.

wxsim-lite 2016-09-09 06Z bad data.

+3,12.1,11.5,3.5,28.8,100.0,1008.2,276.6,6.2,99.0,66.8,5594.0,2.92, +6,-273.1,-272.0,461.0,270.0,0.0,0.0,7.5,-273.1,47832.6,-44.1,-4.2,-45.06, +9,11.1,10.5,3.9,340.3,100.0,1008.1,276.6,6.7,98.3,64.2,5585.2,1.05,

Hi Stuart, with ref to your previous query (no error dialog s) just the normal bad data / old data in red in WxSim-Lite (see attached img.
Regards,

wxsim-lite2016090906z.PNG933×715 45 KB

Hi Stuart

Also if you select the “download” button in the WXSIM-LITE window, a “bad data” window will open if you are downloading bad data.

James

My 06Z data was bad at +6. I really must start checking my data when I am around. Although I am usually not around midday when the 06Z data arrives.

Stuart

Just letting you know I saw this thread, and hope to repair these lingering issues. I need to get together with Sam on this, and he’s been very busy with a project at work. Thankfully the programs can generally handle these bad lines (amybe not always).

Tom