Research on Application of Electromagnetic Environment Data Warehouse Based on Big Data

Abstract

The widespread use of electromagnetic space utilization technology across various fields—including maritime, terrestrial, aeronautical, orbital, electrical, and telecommunications—has generated vast amounts of electromagnetic environment data. To manage challenges, such as the storage of large raw datasets, data discrepancies, isolated data across multiple pathways, and low data value density, a big data-based electromagnetic environment data warehouse is proposed. This warehouse standardizes data from diverse sources, integrates and reconstructs it according to business themes, and uses a mix of relational and non-relational databases for storage. It meets the needs for high data reliability, fast access, and massive storage capacity, offering a solution to data overload while supporting data mining and knowledge discovery in the electromagnetic field.