cloudy

Author Topic: Data Quality  (Read 10010 times)

0 Members and 1 Guest are viewing this topic.

curly

  • Guest
Data Quality
« on: November 26, 2010, 11:07:08 AM »
The more I look at the charts, I wonder how the temperature data accuracy is compiled?
http://weather.gladstonefamily.net/site/C9670?tile=10;days=3#Data

Why the red 4+ degree variance?
« Last Edit: November 26, 2010, 11:35:19 AM by curly »

Offline TNETWeather

  • Kevin Reed (KrelvinAZ)
  • Global Moderator
  • Posts: 5,869
  • Gremlins are at work...
  • Mesa, AZ
    • TNET Weather Station - Mesa AZ
Re: Data Quality
« Reply #1 on: November 26, 2010, 11:43:26 AM »
The site is being compared with the list of sites below.   In my area, sometimes one or more of those sites is way off, which effects the rating.  However, the key thing to look for is the MADIS rating, not the big check/X/? (don't recall seeing an ? before).  The thumbs up or down is more accurate.

You have 2 thumbs up for all of your readings so you should be fine.

Ref from the page:
Quote
The 'MADIS rating' reports on the percentage of observations that pass the MADIS checks. You should aim for two thumbs up!


My report typically has an X for Dewpoint because one of the below compare sites is way way off.... (not at the moment now though).

http://weather.gladstonefamily.net/site/C2582?tile=10;days=7#Data

Haven't looked at this for some time... Wind Vector is new.

All you need is Time, Aptitude and Desire ... and you can build just about anything...

curly

  • Guest
Re: Data Quality
« Reply #2 on: November 26, 2010, 12:23:54 PM »
Your charts look more flat line.
Is CWOP telling me that my actual temperature rises and falls 5 degrees every 10 minutes and my station is not reporting it?

Offline BigOkie

  • Posts: 623
  • Tulsa, OK
    • East Tulsa (Douglas)
Re: Data Quality
« Reply #3 on: November 26, 2010, 04:07:44 PM »
Your charts look more flat line.
Is CWOP telling me that my actual temperature rises and falls 5 degrees every 10 minutes and my station is not reporting it?

I wouldn't worry so much about what the MADIS rating is.  I had that problem with the MADIS rating being off about 18 months ago and I obsessed over it.  I finally realized that I was making myself nuts over it and quit worrying about it.

It resolved itself within about a month.

And the red oscillating line is the comparison stations...not you.  The blue line should be you.

Offline niko

  • syzygy
  • Global Moderator
  • Posts: 22,157
  • Crystal Ball broken! Please post the URL.
  • Northern California, U.S.A.
    • http://www.realweatherstation.com
Re: Data Quality
« Reply #4 on: November 26, 2010, 04:19:26 PM »
Your charts look more flat line.
Is CWOP telling me that my actual temperature rises and falls 5 degrees every 10 minutes and my station is not reporting it?

And the red oscillating line is the comparison stations...not you.  The blue line should be you.

There's clearly a problem with one or more of the stations used in the analysis of your station's temp, the graph should look like the baro one. I suggest you do as the page says "You can signup on the wxqc mailing list and post information about this situation there".
« Last Edit: November 26, 2010, 04:21:05 PM by niko »

Offline jbrooks987

  • Jim
  • Posts: 897
  • Hays, KS
    • Hays, KS Weather
Re: Data Quality
« Reply #5 on: November 27, 2010, 12:27:43 AM »
I have the same issue, except with humidity.   I don't believe there are other stations closer than 5 or so miles to me which would make their comparison a tad difficult. I can "adjust" my settings  within WD to bring it more in line with what the others have but.....

Offline ALITTLEweird1

  • Mark
  • Posts: 3,984
  • Snoqualmie,WA
    • Snoqualmie Weather
Re: Data Quality
« Reply #6 on: November 27, 2010, 12:51:28 AM »
I dont like how they compare your readings to others either. Just because other stations are 5 degrees different than yours, it doesnt make it wrong. They dont account for hills, or mountains in between stations. I get a bad percentage from them too on certin days. I'm close to taking my CWOP stats off of my page.
"Nature can do without man, but man cannot do without nature."

Davis VP2 + 1-Wire Solar + 1-wire Lightning + 1-Wire UV + Logitech Webcam

curly

  • Guest
Re: Data Quality
« Reply #7 on: November 27, 2010, 01:42:05 AM »
CWOP is stating that my readings are not within an acceptable error range.
If this is the case, is my data worth sending if it's that far off?

Offline niko

  • syzygy
  • Global Moderator
  • Posts: 22,157
  • Crystal Ball broken! Please post the URL.
  • Northern California, U.S.A.
    • http://www.realweatherstation.com
Re: Data Quality
« Reply #8 on: November 27, 2010, 01:47:15 AM »
That whole QA thing is auto generated by computer, I think you need to communicate with them and point out the problems with the analysis.

Offline ALITTLEweird1

  • Mark
  • Posts: 3,984
  • Snoqualmie,WA
    • Snoqualmie Weather
Re: Data Quality
« Reply #9 on: November 27, 2010, 02:01:14 AM »
I just emailed them... I'll see what they say.
"Nature can do without man, but man cannot do without nature."

Davis VP2 + 1-Wire Solar + 1-wire Lightning + 1-Wire UV + Logitech Webcam

Offline Scalphunter

  • Posts: 202
  • Saxman, Alaska
Re: Data Quality
« Reply #10 on: November 27, 2010, 02:59:21 AM »
 I have that same problem too few station to compare too and some of the ones they use are anywhere from 60-100 miles away. I just worry about the Madis checks and forget the x's. Heck I'm 250 feet from salt water so my humidity reading can be anything from 60-90% with no wind. Temps  are generally good except sunny days can heat the  area up compard to the ligth house they us where they don't have any trees around them to block air flow.

John

Offline ALITTLEweird1

  • Mark
  • Posts: 3,984
  • Snoqualmie,WA
    • Snoqualmie Weather
Re: Data Quality
« Reply #11 on: December 03, 2010, 11:20:46 PM »
I just emailed them... I'll see what they say.

Here's their response..

Quote

Mark,

Your temperature and wind obs look very good (less than 1% QC failure).
Your barometer, however, which shouldn't be affected by the terrain
is failing 100% of the time with a 2mb bias.  Russ can probably help you
adjust your pressure obs to eliminate this bias.

Thanks for sharing your data,

Patty


I dont understand how my barometer can be off If I have it set by NOAA, as of 4:20pm

From NOAA Barometer: 30.24 in
From my station:         30.14 in
 
"Nature can do without man, but man cannot do without nature."

Davis VP2 + 1-Wire Solar + 1-wire Lightning + 1-Wire UV + Logitech Webcam

Offline niko

  • syzygy
  • Global Moderator
  • Posts: 22,157
  • Crystal Ball broken! Please post the URL.
  • Northern California, U.S.A.
    • http://www.realweatherstation.com
Re: Data Quality
« Reply #12 on: December 03, 2010, 11:48:23 PM »
Mark, the email mentions a 2 mb discrepancy. 2 mb is only 0.06 in hg, the numbers you quote show your baro 0.1 in hg low compared to NOAA which (allowing for rounding and unless I'm missing something) seems to be right in line with the discrepancy in Patty's email.

Offline ALITTLEweird1

  • Mark
  • Posts: 3,984
  • Snoqualmie,WA
    • Snoqualmie Weather
Re: Data Quality
« Reply #13 on: December 03, 2010, 11:55:05 PM »
I adjusted my barometer again to NOAA's for my area. I'll keep an eye on it to make sure it stays close.
"Nature can do without man, but man cannot do without nature."

Davis VP2 + 1-Wire Solar + 1-wire Lightning + 1-Wire UV + Logitech Webcam

Offline ALITTLEweird1

  • Mark
  • Posts: 3,984
  • Snoqualmie,WA
    • Snoqualmie Weather
Re: Data Quality
« Reply #14 on: December 04, 2010, 12:06:08 AM »
I just got another email from them. There comparing my barometer readings to the closet airport which is about 30 miles South West of me. The elevation of that airport is 32 feet. My elevation is almost 800 feet. How can they compare mine to that? I dont understand unless Im missing something here.
"Nature can do without man, but man cannot do without nature."

Davis VP2 + 1-Wire Solar + 1-wire Lightning + 1-Wire UV + Logitech Webcam