Abstract: A processing system includes a server to render and encode a video bitstream for transmission to a client device. The server detects scene changes between consecutive frames of the video bitstream and generates an indication of the scene change for transmission to the client device. The client device detects the indication of the scene change and resets a temporal frame buffer storing data associated with frames of the video bitstream in response to detecting the indication of the scene change.

Abstract: Systems, apparatuses, and methods for reducing latency for wireless virtual and augmented reality applications are disclosed. A virtual reality (VR) or augmented reality (AR) system includes a transmitter rendering, encoding, and sending video frames to a receiver coupled to a head-mounted display (HMD). In one scenario, rather than waiting until the entire frame is encoded before sending the frame to the receiver, the transmitter sends an encoded left-eye portion to the receiver while the right-eye portion is being encoded. In another scenario, the frame is partitioned into a plurality of slices, and each slice is encoded and then sent to the receiver while the next slice is being encoded. In a further scenario, each slice is being encoded while the next slice is being rendered. In a still further scenario, each slice is prepared for presentation by the receiver while the next slice is being decoded by the receiver.

Abstract: A method and apparatus for reducing latency in a virtual reality system including a plurality of devices comprises capturing and transmitting, by a first device, a first batch of data to a second device. The second device renders and encodes a second data based upon the first batch of data, and transmits the first encoded image to the first device. Based upon a determination of a likelihood of collision between a transmission of a second batch of data from the first device and the transmission of the second data, the first device adjusts a frequency of capturing and transmitting the second batch of data.

Abstract: Systems, apparatuses, and methods for reducing latency for wireless virtual and augmented reality applications are disclosed. A virtual reality (VR) or augmented reality (AR) system includes a transmitter rendering, encoding, and sending video frames to a receiver coupled to a head-mounted display (HMD). In one scenario, rather than waiting until the entire frame is encoded before sending the frame to the receiver, the transmitter sends an encoded left-eye portion to the receiver while the right-eye portion is being encoded. In another scenario, the frame is partitioned into a plurality of slices, and each slice is encoded and then sent to the receiver while the next slice is being encoded. In a further scenario, each slice is being encoded while the next slice is being rendered. In a still further scenario, each slice is prepared for presentation by the receiver while the next slice is being decoded by the receiver.

Abstract: Systems, apparatuses, and methods for hiding latency for wireless virtual reality (VR) and augmented reality (AR) applications are disclosed. A wireless VR or AR system includes a transmitter rendering, encoding, and sending video frames to a receiver coupled to a head-mounted display (HMD). In one scenario, the receiver measures a total latency required for the system to render a frame and prepare the frame for display. The receiver predicts a future head pose of a user based on the total latency. Next, a rendering unit at the transmitter renders, based on the predicted future head pose, a new frame with a rendered field of view (FOV) larger than a FOV of the headset. The receiver rotates the new frame by an amount determined by the difference between the actual head pose and the predicted future head pose to generate a rotated version of the new frame for display.

Abstract: Systems, apparatuses, and methods for reducing latency for wireless virtual and augmented reality applications are disclosed. A virtual reality (VR) or augmented reality (AR) system includes a transmitter rendering, encoding, and sending video frames to a receiver coupled to a head-mounted display (HMD). In one scenario, rather than waiting until the entire frame is encoded before sending the frame to the receiver, the transmitter sends an encoded left-eye portion to the receiver while the right-eye portion is being encoded. In another scenario, the frame is partitioned into a plurality of slices, and each slice is encoded and then sent to the receiver while the next slice is being encoded. In a further scenario, each slice is being encoded while the next slice is being rendered. In a still further scenario, each slice is prepared for presentation by the receiver while the next slice is being decoded by the receiver.

Abstract: A client device for use in processing reality technology content is provided. The client device comprises memory configured to store data and a processor in communication with the memory. The processor is configured to receive, from a server device via network communication channel, a video stream comprising encoded video frames and motion vector information and extract, at the client device, the motion vector information. The processor is also configured to decode the video frames, determine whether to at least one of time warp the video frames and space warp the video frames using the extracted motion vector information. The processor is also configured to display the warped video frame data.

Abstract: Systems, apparatuses, and methods for reducing latency for wireless virtual and augmented reality applications are disclosed. A virtual reality (VR) or augmented reality (AR) system includes a transmitter rendering, encoding, and sending video frames to a receiver coupled to a head-mounted display (HMD). In one scenario, rather than waiting until the entire frame is encoded before sending the frame to the receiver, the transmitter sends an encoded left-eye portion to the receiver while the right-eye portion is being encoded. In another scenario, the frame is partitioned into a plurality of slices, and each slice is encoded and then sent to the receiver while the next slice is being encoded. In a further scenario, each slice is being encoded while the next slice is being rendered. In a still further scenario, each slice is prepared for presentation by the receiver while the next slice is being decoded by the receiver.

Abstract: A method and system for producing a single view video signal based on a multiview video coding (MVC) signal stream. A MVC signal stream representing multiple spatially related views of a scene, including a base view and at least one dependent view, is decoded to provide multiple decoded video signals representing the spatially related views, with respective portions of the MVC signal stream representing one of multiple temporally adjacent video frames, and the MVC signal stream representing multiple sequences of spatially adjacent video frames. The decoded video signals are processed to provide a processed video signal representing one of the spatially related views using image information from more than one of the decoded video signals. As a result, more image data is used during processing, thereby improving the spatial and temporal image quality.

Abstract: A method and system are provided for navigating and selecting objects within a 3D video image by computing a depth coordinate based upon two-dimensional (2D) image information from left and right views of such objects. In accordance with preferred embodiments, commonly available computer navigation devices and input devices can be used to achieve such navigation and object selection.

Abstract: A system and method for providing user control of the projection of two-dimensional (2D) image information within the three-dimensional (3D) display space of a 3D-capable display device. Advantageously, the system and method disclosed herein allow a user to view 3D video even when the source video includes 2D content, by allowing the user to adjust the z-axis position of the 2D content, thereby causing the 2D content to be projected at a user-specified image depth within 3D space. The user can adjust the z-axis position of the 2D content in real time while contemporaneously viewing the imagery, e.g., via a remote control, and such adjustment can be stored for later use when similar or other 2D content is being viewed.

Abstract: A method and system for producing a single view video signal based on a multiview video coding (MVC) signal stream. A MVC signal stream representing multiple spatially related views of a scene, including a base view and at least one dependent view, is decoded to provide multiple decoded video signals representing the spatially related views, with respective portions of the MVC signal stream representing one of multiple temporally adjacent video frames, and the MVC signal stream representing multiple sequences of spatially adjacent video frames. The decoded video signals are processed to provide a processed video signal representing one of the spatially related views using image information from more than one of the decoded video signals. As a result, more image data is used during processing, thereby improving the spatial and temporal image quality.