Adaptive Web-Based VR Streaming of Multi-LoD 3D Scenes via Author-Provided Relevance Scores

Abstract

The growing storage requirements of 3D virtual scenes, combined with the increased heterogeneity of consumption devices, trigger the need for novel, on-demand streaming techniques of textured meshes. This paper proposes a way to perform relevance-aware Adaptive Bit-Rate (ABR) scheduling using MPEG-DASH, tailored to VR consumption in the web browser. Scene authors can annotate the relative importance of scene assets to optimize scheduling decisions. Our approach outperforms the state-of-the-art (measured using the MS-SSIM metric) across different scene complexities and network configurations, and is found to be most beneficial when scene complexity is high and network conditions are relatively poor.