Page 1 of 1
Importing Data Issue
Posted: Sun Dec 10, 2017 2:50 pm
by hankster
Just setting up the template and having an issue with importing data. I use Weather Display and used the function built-in to create the import file and upload to the web site. The uploaded files look good and all of the info is metric. Here are the results of loading the txt file (all of this looks correct):
The tested file has 8644 data sets.
Field delimiter is comma (,)
First dataset is: 2017/11/01 00:00,15.0,100.0,1019.2,1.9,1.9,0.0,0.0,45,0.0
The header row contains 10 columns.
The data row contains 10 fields.
Loaded data:
Field Field Number Value (first data set)
YYYY/m/d H:i 0 2017/11/01 00:00
avtemperature(C) 1 15.0
avhumidity 2 100.0
avbarometer(hpa) 3 1019.2
avwindspeed(km/h) 4 1.9
gustspeed(km/h) 5 1.9
rainfall(mm) 6 0.0
rainrate(mm/hr) 7 0.0
avdirection 8 45
avsolar 9 0.0
When I run a test of the files it shows that the info would be imported as English measure with no conversion from metric as shown below.
Summary
The following would be imported to database:
Date/time: 2017-11-01 00:00
Temperature: 15.0 F
Dewpoint: 15 F
Apparent Temperature: 16.2 F
Humidity: 100.0 %
Pressure: 1019.20 inhg
Wind speed: 1.9 mph
Wind gust: 1.9 mph
Precipitation: 0.00 in
Rain rate: 0.00 in/h
Wind direction: 45 degrees
Solar radiation: No solar sensor - ignored.
Ideas???
Re: Importing Data Issue
Posted: Sun Dec 10, 2017 8:50 pm
by Johnny
Hi Hankster, just a thought here, when you were setting up the template, did you set the correct units before your import?
Administration/Main Setup
- Units.JPG (101.74 KiB) Viewed 13146 times
Re: Importing Data Issue
Posted: Sun Dec 10, 2017 9:18 pm
by hankster
Hi Johnny, Been working with Jachym on this. I guess I just misunderstood the Summary output with the F, inhg, etc after the data. The units are all correct and everything imported correctly.
Re: Importing Data Issue
Posted: Sun Dec 10, 2017 9:25 pm
by Johnny
Oh Cool, that's good news, glad you're all sorted
Johnny
Re: Importing Data Issue
Posted: Fri Jan 12, 2018 11:52 pm
by i_fiorentino
Hi,
i'm very interested about import data from weather display.
Which file have you choice to import data?
Log files or whatelse?
Thank you so much.
Regards,
Alessandro
Re: Importing Data Issue
Posted: Sat Jan 13, 2018 12:20 am
by Jachym
Hi,
monthly log files (TXT)
Re: Importing Data Issue
Posted: Sat Jan 13, 2018 1:58 am
by hankster
In the logfiles directory you will see files named something like:
122017lg.txt
112017lg.txt
102017lg.txt
92017lg.txt
Re: Importing Data Issue
Posted: Sat Jan 13, 2018 2:45 pm
by i_fiorentino
Thanks for reply!
Two questions:
1) I've just finisched to complete import section but there isn't any field about rain rate in weather display logfiles.
how can i fill rain rate field on meteotemplate import data?
2) WD logfiles has monthly and yearly rain amount but these fields isn't show on meteotemplate import data.
How can i do to import also these data?
Here it is how meteotemplate read WD logfile....is it correct?
Code: Select all
Loading file...
Loading CSV/text file from ../112010lg.txt
File loaded successfully.
Header row in the file, skipping first line, using for field labels.
Starting to parse data....
The tested file has 10250 data sets.
Field delimiter is space ()
First dataset is: 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
The header row contains 38 columns.
The data row contains 25 fields.
Number of columns is not equal to number of fields.
Loaded data:
Field Field Number Value (first data set)
day 0 1
month 1 null
year 2 11
hour 3 2010
minute 4 null
temperature 5 0
6 null
7 2
humidity 8 07.3
9 null
10 94
11 06.4
12 1000.1
dewpoint 13 null
14 null
15 3
barometer 16 null
17 null
18 3
19 112
windspeed 20 0.4
21 0.0
22 0.0
gustspeed 23 21.3
direction 24 7.3
Thank in advance for your support.
Regards,
Alessandro
Re: Importing Data Issue
Posted: Sat Jan 13, 2018 6:51 pm
by hankster
You imported incorrectly. The option for "Date and Time Field" should be "Date and Time in a single field". Your field setup should then be as shown in the attachment.
- Untitled2.jpg (90.1 KiB) Viewed 12957 times
- Untitled.jpg (57.69 KiB) Viewed 12958 times
Re: Importing Data Issue
Posted: Sat Jan 13, 2018 8:10 pm
by i_fiorentino
Is it ok this system answered?
Code: Select all
Loading file...
Loading CSV/text file from ../112010lg.txt
File loaded successfully.
Header row in the file, skipping first line, using for field labels.
Starting to parse data....
The tested file has 10250 data sets.
Field delimiter is comma (,)
First dataset is: 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
The header row contains 1 columns.
The data row contains 1 fields.
Loaded data:
Field Field Number Value (first data set)
day month year hour minute temperature humidity dewpoint barometer windspeed gustspeed direction rainlastmin dailyrain monthlyrain yearlyrain heatindex 0 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
Re: Importing Data Issue
Posted: Sat Jan 13, 2018 8:22 pm
by i_fiorentino
Bingo!
This is the correct configuration:
....and system answer is:
Code: Select all
Loading file...
Loading CSV/text file from ../112010lg.txt
File loaded successfully.
Header row in the file, skipping first line, using for field labels.
Starting to parse data....
The tested file has 10250 data sets.
Field delimiter is tab ()
First dataset is: 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
The header row contains 17 columns.
The data row contains 17 fields.
Loaded data:
Field Field Number Value (first data set)
day 0 1
month 1 11
year 2 2010
hour 3 0
minute 4 2
temperature 5 07.3
humidity 6 94
dewpoint 7 06.4
barometer 8 1000.1
windspeed 9 3
gustspeed 10 3
direction 11 112
rainlastmin 12 0.4
dailyrain 13 0.0
monthlyrain 14 0.0
yearlyrain 15 21.3
heatindex 16 7.3
Re: Importing Data Issue
Posted: Sun Jan 14, 2018 10:27 am
by i_fiorentino
Morning to all.
I've completed setting form on import data menu.
All it seems ok but i've one question about that.
Rain rate value are not present as a field in weather display log.
Which number should i set in this field?
Thanks in advance,
Alessandro