Weather-Watch.com

Weather Equipment/Software => WxSim => Topic started by: Tom Ehrensperger on January 13, 2019, 02:54:04 AM

Title: WXSIM 2019, Build 1.0 Released!
Post by: Tom Ehrensperger on January 13, 2019, 02:54:04 AM
I've just released a new version!  Also, I've cleaned up/updated the manual and the web site a bit.  To UPGRADE (for existing users), use this installer:

www.wxsim.com/wxsimupg.exe

If you are NOT a registered user, you can get the demo here:

www.wxsim.com/wxsimdem.upg

I'm pasting in below the changes implemented in the last few versions.  Also, note that WXSIMATE (included) is now Version 7.0, which has updated URL's (which all work!)

Thanks, as always, for your support of my programs!

Tom
------------------------------------------------------------------------------------------------------------------------------
Version 2019 Build 1.0, (completed January 11, 2019) has the following change relative to Version 2018, Build 1.3 (described below):

(1) A new output file, latestblyr.csv, has been added, to display a variety of data related to nocturnal and capping inversions.  See ‘Boundary Layer Predictions’ in section 19, above.

(2) Minor formatting changes were made on WXSIM’s Data Entry form, to allow display of tenths of a degree in the normal max and min temperatures for the date, and also to allow proper display of slightly longer site names.

(3) Minor formatting changes were made in wret.exe, to allow display of slightly longer file identifiers.


Version 2018 Build 1.3, (September 19, 2018) had the following change relative to Version 2018, Build 1.2 (described below):

(1) In the latestshort.csv file, the time will now be consistent with the Daylight Saving Time setting.  Perviously, during DST, the date would change according to DST, but the time wouldn’t.  This is still the case in latest.csv, as I did not want to “break” any scripts that might be in use, which are already adapted to this.  The latestshort.csv file is actually a custom file created at the request of a single user, who also requested this change.  The file is of course available to anyone who has a need for it.


Version 2018 Build 1.2, (completed August 25, 2018) had the following changes relative to Version 2018, Build 1.1 (described below):

(1) A problem (apparently introduced in a recent version), which casued production of unwanted .csv files (i.e. when .wxf only is checked) was corrected.

(2) Maximum daily solar radiation was added to the latestdaily.csv file, right before max UV, at the request of a user.  Note that this is a smoothed value, so that on partly cloudy days it will “underestimate” the brief maxima which occur as the sun comes out from behind clouds.


Version 2018 Build 1.1, (completed August 5, 2018) had the following changes relative to Version 2018, Build 1.0 (described below):

(1) An item that was new in Build 1.0 (below), but which I forgot to list, is the “Adjust” button next to Auto Haze under Refinements on the Data Entry form.  When you click this, a form appears which allows you to specify an offset for the amount of haze generated by the Auto Haze routine.  The primary motivation for this is the addition of solar panel power output forecasting (described below), as this can be quite sensitive to the amount of haze.

(2) Changes were made in the solar panel algorithms to allow a new parameter related to the response of the panels to diffuse (scattered) versus direct sunlight.  Originally, this was included as a constant, but experience with a second customer, with a different brand or type of panel showed that this can vary.  Unless the new value is specified, the program defaults to the original constant.

(3) Another parameter was added to the solar panel algorithm: maximum inverter power.  My second customer has an inverter which occasionally maxes out at a certain wattage, so I added this as an optional variable.  If not specified, the inverter maximum power is assumed to be unlimited.

(4) A bug in Build 1.0 had caused the new wet bulb global temperature to be left blank in the first line of latest.csv.  This has been corrected.

(5) In wret.exe, a message in Build 1.0 had pointed out the lack of Fire Weather Index in older forecast files.  However, this turned out to stop execution during analysis runs (including with autoleearn.exe), so it has been removed.  The default fire index for older forecast files is now set to zero, as it cannot be properly calculated from the data they contain.

(6) In wret.exe, the number of checked items in each section (‘Temperatures and Thickness’ and ‘Other Data’) has been increased from 15 to 20.  The blue-text help items for these also now reflect these changes.

(7) The print option in WXSIM (‘None’, ‘Short Form’, ‘Long Form’, or ‘Graph and Summaries’) is now saved on exit.

(8) The latestsolardaily.csv file now outputs kilowatt-hours in the last column, instead of watt-hours.  (The column heading had previously said kw-hr, so this change effectively corrects a mislabeled column heading, which itself remains as before).  Also, minimum and maximum daily panel temperatures for days with insufficient data are now reported as “M” (“missing”) instead of the previous obviously erroneous defaults.
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: atsio on January 13, 2019, 01:30:17 PM
Tom, first WXSIM 2019 forecast ran without any issues!!!  8)

Thanos
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: Stegrie on January 18, 2019, 10:18:58 AM
Hi,
The first run after upgrade was perfect, i will wait how wxsimlite goes. :D
Stefan
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: DrRob on January 19, 2019, 11:58:47 PM
Hi Tom.

I am receiving "Error 6 in wxmain" on this build.
The location of the error is variable (between day 2 and day 4)
It changes based on the time of day the program is run.

I notice during my day that between 10 am and 4 pm there is always an error.
As I was up early this morning, I noted that the error has been occurring since 4 am.
(all times in gmt+10)

Rob
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: dsscheibe on January 20, 2019, 08:03:23 AM


If you are NOT a registered user, you can get the demo here:

www.wxsim.com/wxsimdem.upg

page comes up missing 404
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: oreitsma on January 20, 2019, 08:05:11 AM
Hi Tom.

I am receiving "Error 6 in wxmain" on this build.
The location of the error is variable (between day 2 and day 4)
It changes based on the time of day the program is run.

I notice during my day that between 10 am and 4 pm there is always an error.
As I was up early this morning, I noted that the error has been occurring since 4 am.
(all times in gmt+10)

Rob

Hi,

I`m glad that I am not the only one.
I have exactly same problem.
The run after the run with the error goes fine again.
I had it two times now with this new version.

Hope Tom can find something.

Brgds,
Oebel
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: broadstairs on January 26, 2019, 09:50:57 AM
Past couple of days I've been seeing errors on this release, error 70 several times followed by several error 6. A reload and download of wxsimate data and rerun of lite and subsequent run goes ok. If this happens again I will go back a release which did not expose me to this.

Stuart
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: Tom Ehrensperger on January 27, 2019, 07:30:05 PM
Sorry about these errors!  Which happens first, error 70 or error 6?  (I would think 70 might happen AFTER 6, but I'm not sure).  I don't know if it's something about the new version, or if there's been a data problem lately.  If you see it again, please send me custinit.txt, rgcode.txt, localdat.txt, localcal.txt, wxsmini.txt, wdata.txt, cty.fdt, fdata.txt, and cor.txt, as those are probably all the files that could be involved.  Also, if you revert to another version and can definitely show that the new version has the problem and the old version does't, that would be helpful.

Thanks!

Tom
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: broadstairs on January 28, 2019, 07:40:38 AM
Sorry about these errors!  Which happens first, error 70 or error 6?  (I would think 70 might happen AFTER 6, but I'm not sure).  I don't know if it's something about the new version, or if there's been a data problem lately.  If you see it again, please send me custinit.txt, rgcode.txt, localdat.txt, localcal.txt, wxsmini.txt, wdata.txt, cty.fdt, fdata.txt, and cor.txt, as those are probably all the files that could be involved.  Also, if you revert to another version and can definitely show that the new version has the problem and the old version does't, that would be helpful.

Thanks!

Tom

Tom the problem is intermittent and as I was not watching it I don't know for sure which error came first, as a guess it was the 70. Has not happened for acouple of days now but am wondering if it could be related to when lite runs the analysis which is not every night. I'll watch it over the next few days and will send the files if it does happen again.

Stuart
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: broadstairs on January 29, 2019, 09:04:29 AM
Well this morning WXSim managed to crash my PC - it hung up with an error 480 from WXSim and I needed to power off my PC to recover as nothing worked. I have reverted to the previous version for now.. I have gathered the files mentioned previously but with this error I dont know if they are valid.

Stuart
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: Mearns on January 29, 2019, 11:38:06 PM
Have been running this build for 10 days - no problems so far.
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: jahuff on January 30, 2019, 12:52:02 PM
Hi Everyone,

Build 1.0 running well here.

Thanks Tom.

John
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 02, 2019, 08:14:03 AM
Hi Tom,
As you know I'm in a rather rough situation at present with past weeks of living in thick smoke and fires threatening us (all occurring at the wrong time as we are a third way through preparing our property for sale due to my health declining, which will render the weather site offline eventually = as we have no idea where we will be after we sell). So at last yesterday I had a breather from the smoke as it cleared slightly here and from the exhaustion of 24hr monitoring (though still on Watch and Act). I found this thread and decided to update wxsim even though I will shut down in due course and although had a few teething issues, got it running OK.
However with ref to your comments quoted below, I found that my personal mysql script failed due to the inclusion of a new field in latest.csv this new field is the UTC date/timeUTC stamp though does not have a header.
I have rectified my own personal scripts (not used by others) so all good.
If you add a Header it will not impact mine. Though surprised I could not find any mention of this on the forum aside from my original post and Wim's reply at https://www.weather-watch.com/smf/index.php/topic,67079.msg539599.html#msg539599 (https://www.weather-watch.com/smf/index.php/topic,67079.msg539599.html#msg539599) which was all prior to this upgrade.
I also found a few other things in other .csv files which I'd like to question one day (when all this fire/move/etc is over, though no capacity left to go into detail on those.


Quote
Version 2018 Build 1.3, (September 19, 2018) had the following change relative to Version 2018, Build 1.2 (described below):

(1) In the latestshort.csv file, the time will now be consistent with the Daylight Saving Time setting.  Previously, during DST, the date would change according to DST, but the time wouldn’t.  This is still the case in latest.csv, as I did not want to “break” any scripts that might be in use, which are already adapted to this.  The latestshort.csv file is actually a custom file created at the request of a single user, who also requested this change.  The file is of course available to anyone who has a need for it.

Kind Regards,
Stay safe and healthy where ever you are,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: kocher on February 02, 2019, 10:02:42 AM
Regards Tony

These information have left me worried.
Above all, I wish you better in your health.
I also hope that your problems end with the risk of fire, smoke, sale of the house ...

I'm sorry that you have to close the page and, I'm sure you'll be back soon.
I am an enthusiast of your scripts for WxSim.

Effectively, with the WxSim update of October 2018, your scripts stopped working on my page.
In January 2019, I managed to solve the problem as indicated in:

https://www.weather-watch.com/smf/index.php/topic,66593.msg542442.html#msg542442 (https://www.weather-watch.com/smf/index.php/topic,66593.msg542442.html#msg542442)

I pray for the solution of all your current problems.

Greetings from San Sebastian, Spain

Javier

Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 02, 2019, 10:37:14 AM
Hi Javier,
As always I thank you for your kind words.
Though at this stage I feel I may not have the capacity to continue after our eventual move, only time will tell.
Sadly I thought all was good after recent post, however I am now getting error 6, all was brilliant before the upgrade and also at a time of need while during ongoing fire situation I feel now I should have left well enough alone.
I am in a position where I am not able to monitor wxsim/website as I used to due to current situation so when I check it now and then I now find errors. such a pity, if it continues I'll just shut it down as that is not my standard displaying incorrect old not updated data.
Will see what happens, kind regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: broadstairs on February 02, 2019, 11:58:29 AM
Tony I had issues with the 2019 release and since going back have not (touch wood) had any.

Stuart
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 02, 2019, 12:58:17 PM
Hi Stuart,
Thanks matey, will try that, if it fails I'm done.
Tom as per your request on error 6 which I get on some runs, wonder if it is Cumulus or your wxsim source data or maybe 9 day vs say 4 day forecast.
zipped files attached.
Kind regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 02, 2019, 01:22:05 PM
Hi reinstated old version and did manual run, all good.
Off to bed now, will see if auto runs are fault free when I awake.
One thing I did note is that in wxsimate, I was running :
Metar : proxy/wxsim (in old and new version)
Synop : proxy/wxsim (in old and new version)
RAOB : rap.ucar.edu (in old but (proxy/wxsim) in new version). did not realise till revert so not sure if it was an underling issue.

kind regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: broadstairs on February 02, 2019, 03:00:56 PM
SYNOP is the only one I see in old version now with proxy value in. RAOB is
Code: [Select]
www.rap.ucar.edu
Stuart
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: Tom Ehrensperger on February 02, 2019, 09:40:00 PM
Tony, thanks for the files from when you got the error.  I'm working on it! :)

Tom
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 02, 2019, 10:52:00 PM
Thanks Tom,
Old version forecast's ran ok overnight, though I had to remove my fix for the additional UTC stamp in latest.csv (I forgot to last night).
Only issue I have now in old is that autolearn will not run, it crashes with error 62 input past end of file.
Smoke back thick as again today. :(
Kind Regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: Tom Ehrensperger on February 03, 2019, 12:29:16 AM
Hi Tony,

I DID manage to reproduce the error, though I haven't quite found the variable that's overflowing, because I have lots of error trapping, that sends the error to the handler instead of leaving it where it occurred.  However, I'm almost sure it is associated with the fact that you are running a long forecast, with 60 iterations per interval, which has the counter up to 15,900 when the error occurs.  I think some related variable must be about twice that, and is an integer exceeding the bounds of such things (32,768, I think).  I easily solved this by cutting back to 20 iterations per interval.  In fact, I see no reason to use more than 6.  This is under parameters.

I'm confused about why there would be any difference between the older and new versions here, though.  I can't think of anything I changed related to this.  I also don't know whether Stuart was seeing the same thing.  In any case, I'd be interested to hear how the new version does with 6 (or as much as 20) iterations per interval.  If that solves the problem, I can prevent this somehow.

With autolearn, does it crash immediately?  Can you send me a screen shot? Can you send me alrninit.txt?

Thanks!

Tom
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 03, 2019, 01:23:21 AM
Hi Tom,
Greatly appreciated, just reinstalled upgraded version again and reduced iterations to 6, will see how it goes next auto run.
Tried autolearn again but same issue. yes crashes as soon as i click run immediately. have attached as requested.
Kind Regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 03, 2019, 09:19:46 AM
Hi Tom,
I have found the reason for autolearn error 62, though can only assume there must have been a save issue somewhere during the upgrade and next run stage.
I found that the correc.txt file was not line format structured as it normally is. eg seemed to be centred vs left aligned with line breaks.
Any way lucky I had previous day backup, so added recent day line to old file and all ran perfect.
So now running new version no issues.
Strange about the iteration issue as I have been running at 60 for months now (just to see if it would differ or break) I like doing that.
Kind Regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 03, 2019, 06:56:30 PM
Hi Tom,
Overnight runs went fine no errors, however this mornings 05:00 run (which is gfs 12z) failed after the 7th day with error 6 in wxsim.
I have run 9 days without error for years, so unsure what is causing it.
For now I have cut back to 7 days.
Kind regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: hrvistaweather on February 04, 2019, 01:20:17 AM
Hi Tom,
another issue, my 11:00 (gfs 18z) run failed this time wxsimate unable to download (not sure if it was Metar (proxy.wxsim.net...) or RAOB (proxy.wxsim.net....) sorry did not capture the windows exception error.
So I changed source as per image below and all ran ok again, will wait and see what happens next run.
Kind regards,
Title: Re: WXSIM 2019, Build 1.0 Released!
Post by: broadstairs on February 16, 2019, 04:36:12 PM
Tom I'm wondering if you have managed to get to the issues which several of us have had with this release?

Stuart