Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. The middle region can be mapped into one or more rectangular areas of an output video frame. The top region can be mapped into a first rectangular area of the output video frame using a mapping that converts a square to a circle, such that pixels in the circular top region are expanded to fill the first rectangular region. The bottom region can be mapped into a second rectangular area of the output video frame such that pixels in the circular bottom region are expanded to fill the second rectangular region.

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining at least one 360-degree rectangular formatted projected picture; detecting a projection boundary in the at least one 360-degree rectangular formatted projected picture; disabling at least one of an in-loop filtering, an intra-prediction, or an inter-prediction, based on detecting the at least one 360-degree rectangular formatted projected picture comprises the projection boundary; and generating an encoded video bitstream.

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. The middle region can be mapped into one or more rectangular areas of an output video frame. The top region can be mapped into a first rectangular area of the output video frame using a mapping that converts a square to a circle, such that pixels in the circular top region are expanded to fill the first rectangular region. The bottom region can be mapped into a second rectangular area of the output video frame such that pixels in the circular bottom region are expanded to fill the second rectangular region.

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. The middle region can be mapped into one or more rectangular areas of an output video frame. The top region can be mapped into a first rectangular area of the output video frame using a mapping that converts a square to a circle, such that pixels in the circular top region are expanded to fill the first rectangular region. The bottom region can be mapped into a second rectangular area of the output video frame such that pixels in the circular bottom region are expanded to fill the second rectangular region.

Abstract: Methods and systems for processing video data are provided. In one example, a first video bitstream can be obtained, which can include video frames of a spherical representation of 360-degree video data. Two-dimensional pixel coordinates of a pixel location of a planar surface of a geometry can be determined. The planar surface can be part of a plurality of planar surfaces of the geometry. Two-dimensional normalized coordinates can be determined for the pixel location based on an adaptation parameter and the two-dimensional pixel coordinates. Three-dimensional coordinates of a sample point of the spherical representation of the 360-degree video data can be determined based on the two-dimensional normalized coordinates. A pixel value for the pixel location of the planar surface of the geometry can be determined based on the sample point, and a second video bitstream can be generated that includes pixel values determined for pixel locations of the plurality of planar surfaces of the geometry.

Abstract: Techniques and systems are provided for processing 360-degree video data. For example, a picture of the 360-degree video data can be obtained. The picture can include samples projected from a three-dimensional format to a two-dimensional format. A weight value can be determined for at least one sample of the picture. The weight value can be determined based at least on a position of the at least one sample in the picture. At least one adaptive parameter can be determined for the at least one sample using the determined weight value. The at least one adaptive parameter can include one or more of an adaptive weighted distortion, an adaptive weighted quantization parameter value, or an adaptive weighted lambda value. A cost associated with coding the at least one sample using one or more coding modes can be determined using the at least one adaptive parameter of the at least one sample.

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining a 360-degree rectangular formatted projected picture, where the 360-degree rectangular formatted projected picture includes at least a first region, the at least first region includes at least one region boundary, and the at least first region includes a first region area; determining at least one guard band area located within the first region area, where the at least one guard band area is located alongside the at least one region boundary, and the first region area further includes a projected region area located outside the at least one guard band area; and coding a current coding block in the at least one guard band area using at least one additional guard band sample.

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. Using a cylindrical equal area projection, such as the Lambert cylindrical equal area projection, the middle region can be mapped into one or more rectangular areas of an output video frame.

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining a 360-degree rectangular formatted projected picture, the 360-degree rectangular formatted projected picture including a first region with a region boundary and a first region area; identifying coding tree units (CTUs) within the first region area; selectively identifying a first coding unit (CU) and a second CU from within the CTUs; determining an initial QP value for the first CU; determining an initial QP value for the second CU; identifying the first CU as a region boundary CU; identifying the second CU as a non-region boundary CU; reducing the initial QP value for the first CU to a final first QP value in response to identifying the first CU as a region boundary CU, and generating an encoded video bitstream comprising: the final QP value for the first CU, and the initial QP value for the second CU.

Abstract: In various implementations, computing systems and computer-implemented methods can be used for correcting the distortion present in a fisheye image, and rendering the image for display as 360-degree video. In various implementations, a computing device can receive 2-dimensional video data captured by an omnidirectional camera. The computing device can map an image from each video frame to a 3-dimensional hemispherical representation. In various implementations, this mapping can be executed using a polynomial model. The 3-dimensional hemispherical representation can then be used in a 360-degree video presentation, to provide a virtual reality experience.

Abstract: Methods and systems for processing video data are provided. For example, a video bitstream can be obtained that includes a video frame of a spherical representation of 360-degree video data. The video frame can include a planar surface of a geometry, and the planar surface can include a plurality of pixels. Three-dimensional coordinates of a target point of the spherical representation can be determined. A planar surface of the geometry to which the target point is to be mapped can also be determined. The planar surface can be determined based on the three-dimensional coordinates of the target point. Two-dimensional coordinates of a mapping location on the planar surface to which the target point is to be mapped can be determined based on the three-dimensional coordinates of the target point and an adaptation parameter. A pixel value can then be generated based on one or more pixels associated with the mapping location. The pixel value can be assigned to the target point.

Abstract: Techniques and systems are provided for processing 360-degree video data. For example, 360-degree video data can be obtained that includes a representation including spherical video data mapped to faces of a geometry. The representation includes a viewport corresponding to an orientation in a 360-degree scene. A window can be determined on a spherical representation of the 360-degree scene at the orientation corresponding to the viewport of the representation. The window is determined based on a front face of the geometry corresponding to the representation. A viewport-aware quality metric can then be determined for the window on the spherical representation of the 360-degree scene.

Abstract: The present disclosure describes a method, an apparatus, and a computer readable medium for congestion control in wireless communications. For example, the example method may include determining a plurality of picture transmission deltas, wherein a picture transmission delta is a difference between transmission times of two consecutive pictures. The example method further includes determining whether congestion associated with receiving real-time transport protocol (RTP) packets is present based on a picture transmission delta jitter, determining a new maximum bit rate based on a current maximum bit rate and a determination that congestion is present, and transmitting the new maximum bit rate to a sending device.

Abstract: Techniques and systems are described for mapping 360-degree video data to a truncated square pyramid shape. A 360-degree video frame can include 360-degrees' worth of pixel data, and thus be spherical in shape. By mapping the spherical video data to the planes provided by a truncated square pyramid, the total size of the 360-degree video frame can be reduced. The planes of the truncated square pyramid can be oriented such that the base of the truncated square pyramid represents a front view and the top of the truncated square pyramid represents a back view. In this way, the front view can be captured at full resolution, the back view can be captured at reduced resolution, and the left, right, up, and bottom views can be captured at decreasing resolutions. Frame packing structures can also be defined for 360-degree video data that has been mapped to a truncated square pyramid shape.

Abstract: Techniques and systems are described for encoding 360-degree video data using the planes of a truncated square pyramid to map the 360-degree data for different fields of view. 360-degree video data can include multiple frames, where each frame includes spherical video data. In various implementations, a video coding system can select a field of view for the video data, and determine an offset from the center of the spherical video data that corresponds to the field of view. Using the offset, the system can determine a projection of the spherical video data onto the planes of the truncated square pyramid, where the base plane represents a front view and the top plane represents a back view. The system can then map the video data according to the projection such that each plane of the truncated square pyramid includes a portion of the spherical video data.

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining at least one 360-degree rectangular formatted projected picture; detecting a projection boundary in the at least one 360-degree rectangular formatted projected picture; disabling at least one of an in-loop filtering, an intra-prediction, or an inter-prediction, based on detecting the at least one 360-degree rectangular formatted projected picture comprises the projection boundary; and generating an encoded video bitstream.

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining a 360-degree rectangular formatted projected picture, the 360-degree rectangular formatted projected picture including a first region with a region boundary and a first region area; identifying coding tree units (CTUs) within the first region area; selectively identifying a first coding unit (CU) and a second CU from within the CTUs; determining an initial QP value for the first CU; determining an initial QP value for the second CU; identifying the first CU as a region boundary CU; identifying the second CU as a non-region boundary CU; reducing the initial QP value for the first CU to a final first QP value in response to identifying the first CU as a region boundary CU, and generating an encoded video bitstream comprising: the final QP value for the first CU, and the initial QP value for the second CU.

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining a 360-degree rectangular formatted projected picture, where the 360-degree rectangular formatted projected picture includes at least a first region, the at least first region includes at least one region boundary, and the at least first region includes a first region area; determining at least one guard band area located within the first region area, where the at least one guard band area is located alongside the at least one region boundary, and the first region area further includes a projected region area located outside the at least one guard band area; and coding a current coding block in the at least one guard band area using at least one additional guard band sample.

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. The middle region can be mapped into one or more rectangular areas of an output video frame. The top region can be mapped into a first rectangular area of the output video frame using a mapping that converts a square to a circle, such that pixels in the circular top region are expanded to fill the first rectangular region. The bottom region can be mapped into a second rectangular area of the output video frame such that pixels in the circular bottom region are expanded to fill the second rectangular region.

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. Using a cylindrical equal area projection, such as the Lambert cylindrical equal area projection, the middle region can be mapped into one or more rectangular areas of an output video frame.