MultiHeart: Secure and Robust Heartbeat Pattern Recognition in Multimodal Cardiac Monitoring System

Abstract

The widespread adoption of heartbeat monitoring sensors has increased the demand for secure and trustworthy multimodal cardiac monitoring systems capable of accurate heartbeat pattern recognition. While existing systems offer convenience, they often suffer from critical limitations, such as variability in the number of available modalities and missing or noisy data during multimodal fusion, which may compromise both performance and data security. To address these challenges, we propose MultiHeart, which is a robust and secure multimodal interactive cardiac monitoring system designed to provide reliable heartbeat pattern recognition through the integration of diverse and trustworthy cardiac signals. MultiHeart features a novel multi-task learning architecture that includes a reconstruction module to handle missing or noisy modalities and a classification module dedicated to heartbeat pattern recognition. At its core, the system employs a multimodal autoencoder for feature extraction with shared latent representations used by lightweight decoders in the reconstruction module and by a classifier in the classification module. This design enables resilient multimodal fusion while supporting both data reconstruction and heartbeat pattern classification tasks. We implement MultiHeart and conduct comprehensive experiments to evaluate its performance. The system achieves 99.80% accuracy in heartbeat recognition, surpassing single-modal methods by 10% and outperforming existing multimodal approaches by 4%. Even under conditions of partial data input, MultiHeart maintains 94.64% accuracy, demonstrating strong robustness, high reliability, and its effectiveness as a secure solution for next-generation health-monitoring applications.