RESOLVED -- Problem Importing Data From Weather Underground

[cdarney3]

I just got a Weatherbridge device running and have installed Meteotemplate. I've pointed to my site where meteotemplate is installed and data seems to be populating the MySQL database as expected. The MySQL in an instance on the provider's servers so I'm not running a "personal" copy of MySQL.

I tried importing data from Weather Underground using the Data Import on Control Panel. As far as I can tell everything is configured properly. If I try the "Show Field Numbers" button I get this error:

Loading data from: https://www.wunderground.com/weathersta ... 5&format=1

Unable to load data from WU or incorrect WU specified.

When I run the Test Import I get:

Summary
There is a problem with the date and time, nothing would be imported. Check the date/time format you specified and the actual values in the file.

Record number 1 has incorrect date/time format, this data row is completely ignored...
Date parsed as: 1969-12-31 19:00
Skipping..

I checked with my provider to see if they could whitelist Wunderground. That did nothing. They did a couple of other things as well.

I tried using the Text/CSV import with the data that comes from WU. The attached file is a potion of that CSV. Using the "Show Field Numbers" in that feature produces the error:

Loading file...

Loading CSV/text file from http://darney.org/wunderground_import.csv

File loaded successfully.
Header row in the file, skipping first line, using for field labels.

Starting to parse data....

The tested file has 0 data sets.
Not enough rows for parsing.

Doing a Test Import with the CSV produces this error:

Calculating dew point based on parsed values...
Temperature and humidity both valid... converting and calculating dew point....
Dew point calculated: -172.84 F
Calculating apparent temperature based on parsed values...
Temperature, humidity, and wind speed all valid... converting and calculating apparent temperature....
Apparent temperature calculated: -7.24 F

Summary
There is a problem with the date and time, nothing would be imported. Check the date/time format you specified and the actual values in the file.

What am I doing wrong?!? The file looks right. The data looks right. The config looks right. Are there any suggestions?

CSV Data Sample:
Time TemperatureF DewpointF PressureIn WindDirection WindDirectionDegrees WindSpeedMPH WindSpeedGustMPH Humidity HourlyPrecipIn Conditions Clouds dailyrainin SoftwareType DateUTC
2018-08-25 00:04:54 59.4 57.4 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:04:54
2018-08-25 00:09:52 59.4 57.4 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:09:52
2018-08-25 00:14:56 59.5 57.6 30.24 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:14:56
2018-08-25 00:19:54 59.5 57.6 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:19:54
2018-08-25 00:24:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:24:52
2018-08-25 00:29:54 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:29:54
2018-08-25 00:34:56 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:34:56
2018-08-25 00:39:58 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:39:58
2018-08-25 00:44:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:44:52
2018-08-25 00:49:52 59.7 57.7 30.25 East 88 0 0 93 0 0 meteobridge 2018-08-25 04:49:52

[Johnny]

Hi there, it's quite a long time since I did this, but after entering your weather Underground ID, you then click on 'Show Field Numbers' button, you should then see the image below. Use the field numbers shown in the results in the corresponding 'Variables' boxes. Are you getting that far?

From what you're saying you're getting a list of data entries after clicking 'Show Field Numbers'?

WU-Field-Numbers.jpg (32.41 KiB) Viewed 8115 times

[cdarney3]

No. I do not get that list. I only get:

Loading data from: https://www.wunderground.com/weathersta ... 5&format=1
Unable to load data from WU or incorrect WU specified.

If I select Show Fields when trying to import a CSV I get:

Loading file...
Loading CSV/text file from http://darney.org/wunderground_import.csv

File loaded successfully.
Header row in the file, skipping first line, using for field labels.

Starting to parse data....

The tested file has 0 data sets.
Not enough rows for parsing.


I attached the whole file I'm trying to import.

[Jachym]

Hi,
Ive had this issue with two other people recently with WU. The strange thing is that the URL of the data file did not change and the format of that file is exactly the same. However for some reason servers are unable to communicate. I suspect they must have made some change in their firewall, which affected many users. If you try that URL in a browser it works, but trying to load it via a script returns 0 bytes file.
¨However it is not the case of all, for me for example it works...
Not sure what they have done really...

[cdarney3]

Indeed. I can execute the link from a browser and it returns data. The file I attached in a previous post is the results of that. I wasn't able to load that as a Text/CSV either. Is there a problem with the format of that file?

[cdarney3]

RESOLVED

I worked with my provider (several times) and,after trying several access related things like white listing, etc., the support guy I got suggested that, perhaps, the PHP version running for my domain may be the issue. The default PHP version that installs when created a MySQL instance is v5.4.45. He upgraded my PHP version to v.7.0 and SUDDENLY things started working as expected. I can now import data from Weather Underground and read CSV files. I'm not sure what the minimum version for Meteotemplate is. The Wiki says 5.4 but, apparently, the version I was using is not "5.4" enough.

Now it's time for me to get my page looking right!