Abstract: Methods, systems, and devices for frequency synchronization and phase correction at a rendering device are described. One method may include receiving, from a display device (e.g., a head-mounted display (HMD) device), a vertical sync count and an indication of one or more frame repeats. The rendering device may estimate a vertical sync frequency based on the received vertical sync count, and determine a phase corresponding to a minimum frame repeat based on the indication of the one or more frame repeats. The rendering device may adjust a vertical sync frequency to the estimated vertical sync frequency and a phase to the determined phase. The rendering device may transmit one or more frames to the display device using the adjusted frequency and/or the adjusted phase.

Abstract: A method and a system for warping a rendered frame is disclosed. On a host device of a split-rendering system, the method includes generating the rendered frame based on head tracking information of a user. The method also includes identifying a region of interest (ROI) of the rendered frame. The method also includes generating metadata for a warping operation from the ROI. The method further include transmitting the rendered frame and the metadata for a warping operation of the rendered frame. On a client device of the split-rendering system, the method includes transmitting head tracking information of a user by a client device. The method also includes receiving the rendered frame and metadata. The method further includes warping the rendered frame using the metadata and display pose information. The host device and the client device may be combined into an all-in-one head mounted display.

Abstract: Aspects of the present disclosure provide a method for compressing a point cloud. The method includes determining a sub-division technique for the volume based on one or more numbers derived from a distribution of points in the volume, dividing the volume into a number of sub-volumes according to the sub-division technique, and determining whether each sub-volume of the sub-volumes is occupied by at least one point. The method includes generating a bit sequence for the volume comprising a control code that is based on the sub-division technique and an occupancy indicator that indicates whether or not each sub-volume is occupied by at least one point.

Abstract: Methods, systems, and devices for split rending of multiple graphic layers are described. An extended reality (XR) system may include a processing device that generates and renders multiple graphic layers and a display device that displays the graphic layers to create a virtual environment. The processing device may divide the multiple graphic layer into sets of graphic layers and composite each set into a composite layer for transmission to the display device over a respective stream. Each group of graphic layers may include graphic layers of the same type that are consecutively ordered with respect to their Z orders and that have similar frame rates.

Abstract: Techniques are described for addressing rolling shutter delay and in some cases rolling shutter delay and stabilization. Processing circuits may receive image content in overlapping portions of images, and may adjust the image content until there is overlap in the overlapping portions. Processing circuits may also receive information of deviation of the device from a common reference. Based on the overlapping image content, the deviation of the device from the common reference, and image content in non-overlapping portions, the processing circuits may determine mapping of coordinates to a rectangular mesh for generating an equirectangular image.

Abstract: A method for stitching images by an electronic device is described. The method includes obtaining at least two images. The method also includes selecting a stitching scheme from a set of stitching schemes based on one or more content measures of the at least two images. The set of stitching schemes includes a first stitching scheme, a second stitching scheme, and a third stitching scheme. The method further includes stitching the at least two images based on a selected stitching scheme.

Abstract: An example device for calculating a quality metric for video data includes a memory configured to store a spherical image of the video data, and one or more processors implemented using discrete logic circuitry and configured to determine a user field of view for the spherical image, determine weighting values for pixels of the spherical image based on the user field of view; and calculate a quality metric for the user field of view of the spherical image using the weighting values, wherein calculating the quality metric comprises applying the weighting values to values for the pixels.

Abstract: A method performed by an electronic device is described. The method includes receiving a plurality of images from a first camera with a first field of view and a second plurality of images from a second camera with a second field of view. An overlapping region exists between the first field of view and the second field of view. The method also includes predicting a disparity of a moving object present in a first image of the first plurality of images. The moving object is not present in a corresponding second image of the second plurality of images. The method further includes determining warp vectors based on the predicted disparity. The method additionally includes combining an image from the first plurality of images with an image from the second plurality of images based on the determined warp vectors.

Abstract: A method performed by an electronic device is described. The method includes receiving a plurality of images from a first camera with a first field of view and a second plurality of images from a second camera with a second field of view. An overlapping region exists between the first field of view and the second field of view. The method also includes predicting a disparity of a moving object present in a first image of the first plurality of images. The moving object is not present in a corresponding second image of the second plurality of images. The method further includes determining warp vectors based on the predicted disparity. The method additionally includes combining an image from the first plurality of images with an image from the second plurality of images based on the determined warp vectors.

Abstract: One or more processors may perform one or more lookup table (LUT)-based image processing operations on an input image to produce an output image, wherein performing the one or more image processing operations on the input image introduces one or more banding artifacts in the output image. The one or more processors may determine one or more sub-regions of the output image that include the one or more banding artifacts. The one or more processors may perform one or more artifact reduction operations on the one or more sub-regions of the output image without performing the one or more artifact reduction operations on remaining sub-regions of the output image.

Abstract: Example techniques are described for image processing. Processing circuitry may warp image content of a previous frame based on pose information of a device when the device requested image content information of the previous frame and pose information of the device when the device requested image content information of a current frame to generate warped image content, and blend image content from the warped image content with image content of the current frame to generate an error concealed frame. A display screen may display image content based on the error concealed frame.

Abstract: Techniques are described for addressing rolling shutter delay and in some cases rolling shutter delay and stabilization. Processing circuits may receive image content in overlapping portions of images, and may adjust the image content until there is overlap in the overlapping portions. Processing circuits may also receive information of deviation of the device from a common reference. Based on the overlapping image content, the deviation of the device from the common reference, and image content in non-overlapping portions, the processing circuits may determine mapping of coordinates to a rectangular mesh for generating an equirectangular image.

Abstract: A wearable display device is described that is connected to a host device. The wearable display device includes one or more sensors configured to generate eye pose data indicating a user's field of view, one or more displays, and one or more processors. The one or more processors are configured to output a representation of the eye pose data to the host device and extract one or more depth values for a rendered frame from depth data output by the host device. The rendered frame is generated using the eye pose data. The one or more processors are further configured to modify one or more pixel values of the rendered frame using the one or more depth values to generate a warped rendered frame and output, for display at the one or more displays, the warped rendered frame.

Abstract: A method for stitching images by an electronic device is described. The method includes obtaining at least two images. The method also includes selecting a stitching scheme from a set of stitching schemes based on one or more content measures of the at least two images. The set of stitching schemes includes a first stitching scheme, a second stitching scheme, and a third stitching scheme. The method further includes stitching the at least two images based on a selected stitching scheme.

Abstract: An example device for calculating a quality metric for video data includes a memory configured to store a spherical image of the video data, and one or more processors implemented using discrete logic circuitry and configured to determine a user field of view for the spherical image, determine weighting values for pixels of the spherical image based on the user field of view; and calculate a quality metric for the user field of view of the spherical image using the weighting values, wherein calculating the quality metric comprises applying the weighting values to values for the pixels.

Abstract: A method includes receiving, at a device, a plurality of image frames corresponding to a video stream. The plurality of image frames include a first image frame having a first resolution and a second image frame having a second resolution that is lower than the first resolution. The method also includes detecting, at the device, a trigger by analyzing the second image frame. The method further includes designating, at the device, the first image frame as an action frame based on the trigger.

Abstract: In various aspects, the disclosure provides for aggregating bandwidth in broadband subscription services including sending a query to a device and determining that the device is a bridging device; receiving a sharing profile from the bridging device; and routing a first data generated by a local area network (LAN) client to an external network over at least the bridging device using the sharing profile or over a backhaul link; and, in various aspects, further including receiving a second data from the external network over at least the bridging device using the sharing profile or over the backhaul link, wherein the second data is received in response to the first data; and routing the second data to the LAN client.

Abstract: A method includes receiving, at a device, a plurality of image frames corresponding to a video stream. The plurality of image frames include a first image frame having a first resolution and a second image frame having a second resolution that is lower than the first resolution. The method also includes detecting, at the device, a trigger by analyzing the second image frame. The method further includes designating, at the device, the first image frame as an action frame based on the trigger.

Abstract: In a video encoder, pixel values of a macro-block are processed to determine an activity measure indicative of the type of content in the macro-block. Several techniques are employed for determining the activity measure of a macro-block. In an embodiment, a default quantization scale for quantizing a macro-block is modified based on the activity measure of the macro-block. In another embodiment, the macro-block is classified into one of multiple classes based on its activity measure. The default quantization scale for quantizing the macro-block is modified based on the classification of the macro-block. In yet another embodiment, an encoding mode to be used for encoding a macro-block is also determined on the basis of the class of the macro-block. Several of the techniques exploit the fact that the human visual system (HVS) has different sensitivities in perceiving a (rendered) macro-block or video frame, depending on the type of macro-block content.

Abstract: A method, system and apparatus of lossy compression technique for video encoder bandwidth reduction using compression error data are disclosed. In one embodiment, a method includes storing an error data from a compression of an original reference data in an off-chip memory, accessing the error data during a motion compensation operation, and performing the motion compensation operation by applying the error data through an algorithm (e.g., determined by the method of storing the error data). The method may include generating a predicted frame in the motion compensation operation using a motion vector and an on-chip video data. In addition, the method may include determining the error data as a difference between a compressed reference data (e.g., is created by compressing the original reference data) and an original reference data (e.g., reconstructed from a prior predicted frame and a decompressed encoder data).