Importing Data Issue

[hankster]

Just setting up the template and having an issue with importing data. I use Weather Display and used the function built-in to create the import file and upload to the web site. The uploaded files look good and all of the info is metric. Here are the results of loading the txt file (all of this looks correct):

The tested file has 8644 data sets.
Field delimiter is comma (,)
First dataset is: 2017/11/01 00:00,15.0,100.0,1019.2,1.9,1.9,0.0,0.0,45,0.0
The header row contains 10 columns.
The data row contains 10 fields.
Loaded data:
Field Field Number Value (first data set)
YYYY/m/d H:i 0 2017/11/01 00:00
avtemperature(C) 1 15.0
avhumidity 2 100.0
avbarometer(hpa) 3 1019.2
avwindspeed(km/h) 4 1.9
gustspeed(km/h) 5 1.9
rainfall(mm) 6 0.0
rainrate(mm/hr) 7 0.0
avdirection 8 45
avsolar 9 0.0

When I run a test of the files it shows that the info would be imported as English measure with no conversion from metric as shown below.

Summary
The following would be imported to database:
Date/time: 2017-11-01 00:00
Temperature: 15.0 F
Dewpoint: 15 F
Apparent Temperature: 16.2 F
Humidity: 100.0 %
Pressure: 1019.20 inhg
Wind speed: 1.9 mph
Wind gust: 1.9 mph
Precipitation: 0.00 in
Rain rate: 0.00 in/h
Wind direction: 45 degrees
Solar radiation: No solar sensor - ignored.

Ideas???

[Johnny]

Hi Hankster, just a thought here, when you were setting up the template, did you set the correct units before your import?

Administration/Main Setup

Units.JPG (101.74 KiB) Viewed 13138 times

[hankster]

Hi Johnny, Been working with Jachym on this. I guess I just misunderstood the Summary output with the F, inhg, etc after the data. The units are all correct and everything imported correctly.

[Johnny]

Oh Cool, that's good news, glad you're all sorted

Johnny

[i_fiorentino]

Hi,
i'm very interested about import data from weather display.
Which file have you choice to import data?
Log files or whatelse?

Thank you so much.
Regards,


Alessandro

[Jachym]

Hi,
monthly log files (TXT)

[hankster]

In the logfiles directory you will see files named something like:

122017lg.txt
112017lg.txt
102017lg.txt
92017lg.txt

[i_fiorentino]

Thanks for reply!

Two questions:

1) I've just finisched to complete import section but there isn't any field about rain rate in weather display logfiles.
how can i fill rain rate field on meteotemplate import data?

2) WD logfiles has monthly and yearly rain amount but these fields isn't show on meteotemplate import data.
How can i do to import also these data?

Here it is how meteotemplate read WD logfile....is it correct?

Code: Select all

Loading file...

Loading CSV/text file from ../112010lg.txt

File loaded successfully.
Header row in the file, skipping first line, using for field labels.

Starting to parse data....

The tested file has 10250 data sets.
Field delimiter is space ()
First dataset is: 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
The header row contains 38 columns.
The data row contains 25 fields.
Number of columns is not equal to number of fields.
Loaded data:
Field	Field Number	Value (first data set)
day	0	1
month	1	null
year	2	11
hour	3	2010
minute	4	null
temperature	5	0
6	null
7	2
humidity	8	07.3
9	null
10	94
11	06.4
12	1000.1
dewpoint	13	null
14	null
15	3
barometer	16	null
17	null
18	3
19	112
windspeed	20	0.4
21	0.0
22	0.0
gustspeed	23	21.3
direction	24	7.3

Thank in advance for your support.
Regards,


Alessandro

[hankster]

You imported incorrectly. The option for "Date and Time Field" should be "Date and Time in a single field". Your field setup should then be as shown in the attachment.

Untitled2.jpg (90.1 KiB) Viewed 12949 times

Untitled.jpg (57.69 KiB) Viewed 12950 times

[i_fiorentino]

Is it ok this system answered?

Code: Select all

Loading file...

Loading CSV/text file from ../112010lg.txt

File loaded successfully.
Header row in the file, skipping first line, using for field labels.

Starting to parse data....

The tested file has 10250 data sets.
Field delimiter is comma (,)
First dataset is: 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
The header row contains 1 columns.
The data row contains 1 fields.
Loaded data:
Field	Field Number	Value (first data set)
day month year hour minute temperature humidity dewpoint barometer windspeed gustspeed direction rainlastmin dailyrain monthlyrain yearlyrain heatindex	0	1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3

[i_fiorentino]

Bingo!

This is the correct configuration:





....and system answer is:

Code: Select all

Loading file...

Loading CSV/text file from ../112010lg.txt

File loaded successfully.
Header row in the file, skipping first line, using for field labels.

Starting to parse data....

The tested file has 10250 data sets.
Field delimiter is tab ()
First dataset is: 1 11 2010 0 2 07.3 94 06.4 1000.1 3 3 112 0.4 0.0 0.0 21.3 7.3
The header row contains 17 columns.
The data row contains 17 fields.
Loaded data:
Field	Field Number	Value (first data set)
day	0	1
month	1	11
year	2	2010
hour	3	0
minute	4	2
temperature	5	07.3
humidity	6	94
dewpoint	7	06.4
barometer	8	1000.1
windspeed	9	3
gustspeed	10	3
direction	11	112
rainlastmin	12	0.4
dailyrain	13	0.0
monthlyrain	14	0.0
yearlyrain	15	21.3
heatindex	16	7.3

[i_fiorentino]

Morning to all.
I've completed setting form on import data menu.

All it seems ok but i've one question about that.
Rain rate value are not present as a field in weather display log.
Which number should i set in this field?



Thanks in advance,


Alessandro