Quantifying and Exploiting VR Frame Correlations: An Application of a Statistical Model for Viewport Pose

Ying Chen, Sasamon Omoma, Hojung Kwon, Hazer Inaltekin,Maria Gorlatova

IEEE Transactions on Mobile Computing（2024）

引用 0|浏览0

暂无评分

摘要

In virtual reality (VR), users' head pose , that is, the location and the orientation of users' viewport, determines the view of the virtual world that is shown to the users. The importance of the viewport pose to VR experiences calls for the development of VR viewport pose models. However, no study has obtained a full pose (the position and the orientation) model applicable to modeling the viewport pose in VR experiences. In this paper, informed by our experimental measurements of viewport trajectories across 4 different types of VR interfaces, we first develop a statistical model of viewport poses in VR environments. Based on the developed model, we examine the correlations between pixels in VR frames that correspond to different viewport poses, and obtain an analytical expression for the visibility similarity (ViS) of the pixels across different VR frames. We then propose a lightweight ViS-based algorithm (ALG-ViS) that adaptively splits VR frames into the background and the foreground, reusing the background across different frames. Our implementation of ALG-ViS in two Oculus Quest 2 rendering systems demonstrates ALG-ViS running in real time, supporting the full VR frame rate, and outperforming baselines on measures of frame quality and bandwidth consumption.

查看译文

关键词

Frame correlation,game engine-based simulations,pose model,VR viewport trajectory,virtual reality,VR viewport model

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要