Get the latest tech news
How to store weather forecast data for fast time-series APIs (2022)
Using multi-dimensional gridded files and time-series data-structures
At Open-Meteo, we use 35 weather variables like wind-speed, direction, relative humidity, pressure, weather-code, clouds, precipitation or snow height. Time-series-based gridded files are a key ingredient to efficiently store and update weather-model data and be able to quickly retrieve forecasts for single geographical points. For longer time-series and archives, different techniques have to be used that focus on compression and support large distributed storages to be cost effective.
Or read this on Hacker News