Lightweight Online Profiling-Based Configuration Adaptation for Video Analytics System in Edge Computing

Abstract

Video Analytics System has emerged as a promising technology to realize deep neural network based intelligent applications for video streams. Its objective is to maximize the video analytics performance of video streams, such as accuracy, while utilizing the limited computing resource capacity efficiently. Existing video analytics systems attempt to adapt configurations to optimize resource-accuracy tradeoffs under limited resource capacity. Especially, several works recently propose a configuration adaptation algorithm based on online profiling to overcome the inefficiency of one-time offline profiling caused by the dynamics of the configuration's impact on video analytics accuracy. However, their systems are inefficient or limited to process the video analytics of multiple video streams in a GPU-enabled edge server. Furthermore, their online profiling methods still leads to a high profiling cost. In this paper, we design a video analytics system to adapt configurations for optimizing the resource-accuracy tradeoffs of multiple video streams with respect to frame rate and resolution fully under limited resource capacity of a GPU-enable edge server. In addition, we propose a lightweight online profiling method, utilizing the underlying characteristics of the video objects. Then, based on it, we propose a configuration adaptation algorithm to find the best configuration of each video stream and minimize accuracy degradation of multiple video streams under limited resource capacity of a GPU-enable edge server. To evaluate the proposed algorithm, we use a subset of surveillance videos and annotations from VIRAT 2.0 Ground dataset. The experimental results show that, in a GPU-enabled edge server, our video analytics system achieves the optimal configuration adaptation on resource-accuracy tradeoffs and our algorithm reduce the profiling cost of existing systems significantly while achieving the video analytics performance comparable to them.