Proof of concept project that includes backend scripts to scrape National Weather Service (NWS)
"Weather observations for the past three days" (3 Day Observed History) HTML pages and store contents in a database.
Also includes simple PHP/Javascript web application to share data in chart and table formats.
An example of the files that are being scraped is:
http://w1.weather.gov/data/obhistory/KANK.html
There are 16 data fields, but only the Air Temperature and Pressure (altimeter (in.)) are reliable numeric values.
These are stored as floats in the database. The rest of the values are stored as strings.
| D a t e | Time (mst) |
Wind (mph) | Vis. (mi.) | Weather | Sky Cond. | Temperature (ºF) | Relative Humidity | Wind Chill (°F) | Heat Index (°F) | Pressure | Precipitation (in.) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Air | Dwpt | 6 hour | altimeter (in) | sea level (mb) | 1 hr | 3 hr | 6 hr | ||||||||||
| Max. | Min. | ||||||||||||||||
| 19 | 14:55 | S 17 G 29 | 10.00 | Fair | CLR | 45 | 21 | 39% | 38 | NA | 30.14 | NA | |||||
| 19 | 14:35 | S 15 G 24 | 10.00 | Fair | CLR | 45 | 22 | 40% | 38 | NA | 30.14 | NA | |||||
| 19 | 14:15 | SW 14 G 24 | 10.00 | Fair | CLR | 46 | 22 | 39% | 40 | NA | 30.14 | NA | |||||
| 19 | 13:55 | S 17 G 28 | 10.00 | Fair | CLR | 46 | 22 | 38% | 39 | NA | 30.14 | NA | |||||
| 19 | 13:35 | S 18 G 29 | 10.00 | Fair | CLR | 46 | 22 | 38% | 39 | NA | 30.14 | NA | |||||
| 19 | 03:35 | N 13 | 10.00 | Fair | CLR | 23 | 15 | 70% | 11 | NA | 30.28 | NA | |||||
| 19 | 03:15 | N 16 G 21 | 10.00 | Fair | CLR | 24 | 15 | 69% | 11 | NA | 30.27 | NA | |||||
| D a t e | Time (mst) |
Wind (mph) | Vis. (mi.) | Weather | Sky Cond. | Air | Dwpt | Max. | Min. | Relative Humidity | Wind Chill (°F) | Heat Index (°F) | altimeter (in.) | sea level (mb) |
1 hr | 3 hr | 6 hr |
| 6 hour | |||||||||||||||||
| Temperature (ºF) | Pressure | Precipitation (in.) | |||||||||||||||