Large databases

Post Reply
azchrisf
Observer
Observer
Posts: 46
Joined: Tue Jan 02, 2018 2:55 pm
Location: Phoenix, AZ
Station model: Davis Vantage Pro 2 Plus
Software: Meteobridge
Contact:

Large databases

Post by azchrisf » Wed Jan 17, 2018 6:22 pm

How is Meteotemplate setup for VERY large weather databases that could contain years worth of data (i.e. millions of rows, in one year mine will make 1.05 million rows of measurements, based on 30 seconds each)?

I'm worried about the pages/queries slowing down too much with all the data.
Image

User avatar
Jachym
Site Admin
Site Admin
Posts: 1686
Joined: Fri Aug 18, 2017 10:12 pm
Location: Brno, Czech Republic
Station model: WH1080
Software: Meteobridge
Contact:

Re: Large databases

Post by Jachym » Wed Jan 17, 2018 6:54 pm

Not many pages use the entire database and caching is implemented. 99% of pages only uses one yr of data for example, or a month, in which case MySQL only analyzes that portion of your database.

The stats pages are also cached, which is why I very often get emails why values did not change after changing history data - you always need to clear the station cache in the cPanel.

Post Reply