基于Hadoop的气象数据分布式存储技术研究.pdf

信息技术 XINXIJISHU 2022 年第 1 期
基于 Hadoopdoop
，
open source framework is proposed． On the basis of in-depth analysis of attributes and characteristics of data
the solution proves that the meteorological data has strong adaptability to distributed storage framework and
high potentiality for large-scale applications after being fully optimized． Besides the solution gives some specif-
，
ic innovations in HBase database Row Key design and small file merging strategies． Finally the article makes
detailed design and implementation for the two main widespread structured and unstructured meteorological
data by the example of automatic weather stations data and radar product data respectively．
� � � �
Key words meteorological data storage Hadoop Row Key merging of files
0 引 言 据的覆盖范围、数据的传输频次以及数据应用与
， ， ，
近年来 随