RESOLVED -- Problem Importing Data From Weather Underground
Posted: Sun Aug 26, 2018 12:55 am
I just got a Weatherbridge device running and have installed Meteotemplate. I've pointed to my site where meteotemplate is installed and data seems to be populating the MySQL database as expected. The MySQL in an instance on the provider's servers so I'm not running a "personal" copy of MySQL.
I tried importing data from Weather Underground using the Data Import on Control Panel. As far as I can tell everything is configured properly. If I try the "Show Field Numbers" button I get this error:
Loading data from: https://www.wunderground.com/weathersta ... 5&format=1
Unable to load data from WU or incorrect WU specified.
When I run the Test Import I get:
Summary
There is a problem with the date and time, nothing would be imported. Check the date/time format you specified and the actual values in the file.
Record number 1 has incorrect date/time format, this data row is completely ignored...
Date parsed as: 1969-12-31 19:00
Skipping..
I checked with my provider to see if they could whitelist Wunderground. That did nothing. They did a couple of other things as well.
I tried using the Text/CSV import with the data that comes from WU. The attached file is a potion of that CSV. Using the "Show Field Numbers" in that feature produces the error:
Loading file...
Loading CSV/text file from http://darney.org/wunderground_import.csv
File loaded successfully.
Header row in the file, skipping first line, using for field labels.
Starting to parse data....
The tested file has 0 data sets.
Not enough rows for parsing.
Doing a Test Import with the CSV produces this error:
Calculating dew point based on parsed values...
Temperature and humidity both valid... converting and calculating dew point....
Dew point calculated: -172.84 F
Calculating apparent temperature based on parsed values...
Temperature, humidity, and wind speed all valid... converting and calculating apparent temperature....
Apparent temperature calculated: -7.24 F
Summary
There is a problem with the date and time, nothing would be imported. Check the date/time format you specified and the actual values in the file.
What am I doing wrong?!? The file looks right. The data looks right. The config looks right. Are there any suggestions?
CSV Data Sample:
Time TemperatureF DewpointF PressureIn WindDirection WindDirectionDegrees WindSpeedMPH WindSpeedGustMPH Humidity HourlyPrecipIn Conditions Clouds dailyrainin SoftwareType DateUTC
2018-08-25 00:04:54 59.4 57.4 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:04:54
2018-08-25 00:09:52 59.4 57.4 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:09:52
2018-08-25 00:14:56 59.5 57.6 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:14:56
2018-08-25 00:19:54 59.5 57.6 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:19:54
2018-08-25 00:24:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:24:52
2018-08-25 00:29:54 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:29:54
2018-08-25 00:34:56 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:34:56
2018-08-25 00:39:58 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:39:58
2018-08-25 00:44:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:44:52
2018-08-25 00:49:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:49:52
I tried importing data from Weather Underground using the Data Import on Control Panel. As far as I can tell everything is configured properly. If I try the "Show Field Numbers" button I get this error:
Loading data from: https://www.wunderground.com/weathersta ... 5&format=1
Unable to load data from WU or incorrect WU specified.
When I run the Test Import I get:
Summary
There is a problem with the date and time, nothing would be imported. Check the date/time format you specified and the actual values in the file.
Record number 1 has incorrect date/time format, this data row is completely ignored...
Date parsed as: 1969-12-31 19:00
Skipping..
I checked with my provider to see if they could whitelist Wunderground. That did nothing. They did a couple of other things as well.
I tried using the Text/CSV import with the data that comes from WU. The attached file is a potion of that CSV. Using the "Show Field Numbers" in that feature produces the error:
Loading file...
Loading CSV/text file from http://darney.org/wunderground_import.csv
File loaded successfully.
Header row in the file, skipping first line, using for field labels.
Starting to parse data....
The tested file has 0 data sets.
Not enough rows for parsing.
Doing a Test Import with the CSV produces this error:
Calculating dew point based on parsed values...
Temperature and humidity both valid... converting and calculating dew point....
Dew point calculated: -172.84 F
Calculating apparent temperature based on parsed values...
Temperature, humidity, and wind speed all valid... converting and calculating apparent temperature....
Apparent temperature calculated: -7.24 F
Summary
There is a problem with the date and time, nothing would be imported. Check the date/time format you specified and the actual values in the file.
What am I doing wrong?!? The file looks right. The data looks right. The config looks right. Are there any suggestions?
CSV Data Sample:
Time TemperatureF DewpointF PressureIn WindDirection WindDirectionDegrees WindSpeedMPH WindSpeedGustMPH Humidity HourlyPrecipIn Conditions Clouds dailyrainin SoftwareType DateUTC
2018-08-25 00:04:54 59.4 57.4 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:04:54
2018-08-25 00:09:52 59.4 57.4 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:09:52
2018-08-25 00:14:56 59.5 57.6 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:14:56
2018-08-25 00:19:54 59.5 57.6 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:19:54
2018-08-25 00:24:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:24:52
2018-08-25 00:29:54 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:29:54
2018-08-25 00:34:56 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:34:56
2018-08-25 00:39:58 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:39:58
2018-08-25 00:44:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:44:52
2018-08-25 00:49:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:49:52