Anomaly-aware adaptation approach for self-adaptive cyber-physical system of systems using reinforcement learning

Abstract

A cyber-physical system of systems (CPSoS) is a system composed of multiple constituent systems that interact with both physical and cyber environments. Self-adaptivity is essential for CPSoS because it works on both cyber and physical uncertainties in various environments. Two obstacles to achieving self-adaptive CPSoS are time constraints and system anomalies. An adaptation should be processed within a certain period and consider anomalies caused by system changes due to mechanical faults, cyber-attacks, or emergent behaviors. However, since existing adaptation approaches cannot fully handle both aspects, this paper proposes an advanced approach, A$^4$, for a self-adaptive system that can handle known anomalies without enormous time in runtime. This approach learns the known anomalies before runtime and mitigates their impact when they are detected. The research evaluated the A$^4$ approach for virtual and physical CPSoS and showed that A$^4$ is more efficient than other approaches.