A study on an optical adaptation framework for streaming multiple video objects

Abstract

With the multi-angle video contents available at a user terminal, the user can select his/her preferred alternate views among the given multiple video streams captured at different view angles for a same event. This enhanced experience often entails a streaming problem in real-time over the network such as the Internet with bandwidth change in time. In order to cope with this problem, multi-angle video contents are encoded at different bitrates and the appropriate video streams are then selected or transcoded for delivery to meet such a bandwidth constraint. Therefore, the selection and transcoding operations become essential processing steps to adapt to such a time-varying bandwidth of the network. In this dissertation, we propose an optimal adaptation framework for streaming multiple video streams by jointly formulating the selection and transcoding problems into a unified optimization problem. An optimal set of multiple video streams is selected or transcoded in the sense that the perceptual quality is maximized by solving the unified optimization problem for given bandwidth and transcoding cost constraints. The proposed adaptation scheme is effective for the decision of selection and transcoding operations on multiple video streams. We present plenty of the experimental results to show the effectiveness of the proposed method.