Auditing the latest BEST and EC data for Malahat

Over the last few weeks I’ve been looking at the latest BEST data and sometimes comparing it to data from Environment Canada (EC) I scraped off their website.

To start with I am looking at one station. In BEST it is StationID 7973 – “MALAHAT, BC”.  In EC it is station MALAHAT which is Station_No 1014820.

I am comparing the BEST SV (Single Valued) data to the BEST QC (Quality Controlled) data.  The first  minor problem is that the EC data has records from the 1920s and 1930s that BEST does not have (that I have found). Thats no big deal. The next problem is that out of 166 MOnth/Year records, not one of them matched exactly. BEST SV and QC data is to 3 decimal points while EC is to 1.

For example. Jan 1992 has QC = 5.677, as does SV, while EC = 5.8. Close. But not an exact match.

However, the real problem is that  there are 5 records that have been discarded between SV and QC. Two out of the five make no sense at all, and one is iffy.

Where it says “No Row” it means BEST has discarded the record completely between SV and QC.

1991 is iffy. EC has it has 4.5, SV has 3.841. Close, but not that close

1993 makes no sense at all.

2002 is fine. Thats a huge error. But where the heck did BEST get the -13.79 number in the first place.

2003 is fine. But again,   where the heck did BEST get the -4.45 number in the first place.

Finally, 2005 makes no sense at all. There is little difference between -1.1 and -1.148. Certainly most records are that different.

And those are just the discarded records!

There are another 48 record with a difference of .1C or greater and  here are the greater than .2C ones.

What a mystery. 

2 thoughts on “Auditing the latest BEST and EC data for Malahat

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s