Content area
Driven by rapid advancements in interconnection, packaging, integration, and computing technologies, parallel and distributed systems have significantly evolved in recent years. These systems have become essential for addressing modern computational demands, offering enhanced processing power, scalability, and resource efficiency. This paper provides a comprehensive overview of parallel and distributed systems, exploring their interrelationships, their key distinctions, and the emerging trends shaping their evolution. We analyse four parallel computing paradigms—heterogeneous computing, quantum computing, neuromorphic computing, and optical computing—and examine emerging distributed systems such as blockchain, serverless computing, and cloud-native architectures. The associated challenges are highlighted, and potential future directions are outlined. This work serves as a valuable resource for researchers and practitioners aiming to stay informed about trends in parallel and distributed computing while understanding the challenges and future developments in the field.
Details
Quantum computing;
Simulation;
Collaboration;
Artificial intelligence;
Edge computing;
Trends;
Bandwidths;
Supercomputers;
Blockchain;
Fault tolerance;
Cloud computing;
Workloads;
High performance computing;
Internet of Things;
Field programmable gate arrays;
Array processors;
Distributed processing;
Computer networks;
Efficiency
; Md Akbar Hossain 1 ; Wang, Yi 2
1 School of Computing, Eastern Institute of Technology, Napier 4104, New Zealand;
2 School of Mathematical and Computational Sciences, Massey University, Palmerston North 4410, New Zealand;