Patents Assigned to VID Scale, Inc.
-
Publication number: 20200267381Abstract: Systems, methods and instrumentalities are disclosed for adaptively selecting an adaptive loop filter (ALF) procedure for a frame based on which temporal layer the frame is in. ALF procedures may vary in computational complexity. One or more frames including the current frame may be in a temporal layer of a coding scheme. The decoder may determine the current frame's temporal layer level within the coding scheme. The decoder may select an ALF procedure based on the current frame's temporal layer level. If the current frame's temporal layer level is higher within the coding scheme than some other temporal layer levels, an ALF procedure that is less computationally complex may be selected for the current frame. Then the decoder may perform the selected ALF procedure on the current frame.Type: ApplicationFiled: October 31, 2018Publication date: August 20, 2020Applicant: VID SCALE, INC.Inventors: Rahul Vanam, Yuwen He, Yan Ye
-
Publication number: 20200267429Abstract: A streaming device may request and download multi-layer video segments based on a number of factors including the artistic interest associated with the video segments and/or the status of a buffer area managed by the streaming device. The multi-layer segments may be coded using scalable coding techniques or a combination of scalable coding and simulcast coding techniques by which each of the video segments may be coded into one or more representations of different qualities and/or bitrates. When requesting the multi-layer segments, the streaming device may ensure that the fullness of the buffer area falls between a buffer underflow threshold and a backfilling threshold under various network conditions. The streaming device may estimate the available network bandwidth in order to facilitate the scheduling decisions. The streaming device may consider the artistic interest associated with the video segments during scheduling and may give priority to those segments with higher artistic interest.Type: ApplicationFiled: December 12, 2016Publication date: August 20, 2020Applicant: Vid Scale, Inc.Inventors: Yong He, Ahmed Hamza, Srinivas Gudumasu, Yan Ye, Eduardo Asbun
-
Patent number: 10750172Abstract: Prediction systems and methods for video coding are described based on nearest neighboring pixels. In exemplary embodiments, to code a first pixel, a plurality of neighboring pixels of the first pixel are reconstructed. The coefficients of a filter such as a Wiener filter are derived based on the reconstructed neighboring pixels. The Wiener filter is applied to the reconstructed neighboring pixels to predict the first pixel. The coefficients of the Wiener filter may be derived on a pixel-by-pixel or a block-by-block basis. The reconstructed pixels may be pixels in the same picture (for intra prediction) or in a reference picture (for inter prediction). In some embodiments, the residuals of the prediction are encoded using RDPCM. In some embodiments, the residuals may be predicted using a Wiener filter.Type: GrantFiled: April 21, 2017Date of Patent: August 18, 2020Assignee: Vid Scale, Inc.Inventors: Rahul Vanam, Yuwen He, Yan Ye
-
Publication number: 20200260120Abstract: Systems, methods, and instrumentalities may be provided for discounting reconstructed samples and/or coding information from spatial neighbors across face discontinuities. Whether a current block is located at a face discontinuity may be determined. The face discontinuity may be a face boundary between two or more adjoining blocks that are not spherical neighbors. The coding availability of a neighboring block of the current block may be determined, e.g., based on whether the neighboring block is on the same side of the face discontinuity as the current block. For example, the neighboring block may be determined to be available for decoding the current block if it is on the same side of the face discontinuity as the current block, and unavailable if it Is not on the same side of the face discontinuity. The neighboring block may be a spatial neighboring block or a temporal neighboring block.Type: ApplicationFiled: September 19, 2018Publication date: August 13, 2020Applicant: Vid Scale, Inc.Inventors: Philippe Hanhart, Yuwen He, Yan Ye
-
Publication number: 20200252629Abstract: Sampling grid information may be determined for multi-layer video coding systems. The sampling grid information may be used to align the video layers of a coding system. Sampling grid correction may be performed based on the sampling grid information. The sampling grids may also be detected. In some embodiments, a sampling grid precision may also be detected and/or signaled.Type: ApplicationFiled: April 22, 2020Publication date: August 6, 2020Applicant: VID SCALE, INC.Inventors: Yan Ye, Yuwen He, Jie Dong
-
Patent number: 10735546Abstract: Systems, methods, and instrumentalities are disclosed for media caching proxy techniques (e.g., applications) that enable caching of multimedia content delivered, for example, using the Dynamic Adaptive Streaming over HTTP (DASH) protocol. A request may be received from a client for a media presentation description (MPD) file relating to media content. The media content may comprise a plurality of media segments. An MPD file may be received from cache. A subset of the plurality of media segments of the media content stored within the cache may be determined. An available bandwidth on a backhaul link may be determined. A dynamic MPD file may be generated based on the MPD file, the subset of the plurality of media segments of the media content that is stored within the cache of the middle box platform, and/or the available bandwidth on the backhaul link. The dynamic MPD file may be transmitted to the client.Type: GrantFiled: June 29, 2016Date of Patent: August 4, 2020Assignee: VID SCALE, Inc.Inventors: Bartosz Balazinski, Jun Li, Debashish Purkayastha
-
Patent number: 10735764Abstract: Video data may be palette decoded. Data defining a palette table may be received. The palette table may comprise index values corresponding to respective colors. Palette index prediction data may be received and may comprise data indicating index values for at least a portion of a palette index map mapping pixels of the video data to color indices in the palette table. The palette index prediction data may comprise run value data associating run values with index values for at least a portion of a palette index map. A run value may be associated with an escape color index. The palette index map may be generated from the palette index prediction data at least in part by determining whether to adjust an index value of the palette index prediction data based on a last index value. The video data may be reconstructed in accordance with the palette index map.Type: GrantFiled: January 17, 2019Date of Patent: August 4, 2020Assignee: VID SCALE, Inc.Inventors: Chia-Ming Tsai, Yuwen He, Xiaoyu Xiu, Yan Ye
-
Publication number: 20200221122Abstract: A device may determine whether to enable or disable bi-directional optical flow (BIO) for a current coding unit (CU) (e.g., block and/or sub-block). Prediction information for the CU may be identified and may include prediction signals associated with a first reference block and a second reference block (e.g., or a first reference sub-block and a second reference sub-block). A prediction difference may be calculated and may be used to determine the similarity between the two prediction signals. The CU may be reconstructed based on the similarity. For example, whether to reconstruct the CU with BIO enabled or BIO disabled may be based on whether the two prediction signals are similar, it may be determined to enable BIO for the CU when the two prediction signals are determined to be dissimilar. For example, the CU may be reconstructed with BIO disabled when the two prediction signals are determined to be similar.Type: ApplicationFiled: July 3, 2018Publication date: July 9, 2020Applicant: VID SCALE, INC.Inventors: Yan Ye, Xiaoyu Xiu, Yuwen He
-
Patent number: 10708605Abstract: A video device may generate an enhanced inter-layer reference (E-ILR) picture io assist in predicting an enhancement layer picture of a. scalable bitstream. An E-ILR picture may include one or more E-ILR blocks. An E-ILR block may be generated using a differential method, a residual method, a bi-prediction method, and/or a uni-prediction method. The video device may determine a first time instance. The video device may subtract a block of a first base layer picture characterized by the first time instance from a block of an enhancement layer picture characterized by the first time instance to generate a differential block characterized by the first time instance. The video device may perform motion compensation on the differential block and add the motion compensated differential picture to a block of the second base layer picture characterized by the second time instance to generate an E-ILR. block.Type: GrantFiled: April 4, 2014Date of Patent: July 7, 2020Assignee: VID SCALE, Inc.Inventors: Yuwen He, Yan Ye
-
Patent number: 10694204Abstract: Systems and methods are disclosed for improving the prediction efficiency for residual prediction using motion compensated residual prediction (MCRP). Exemplary residual prediction techniques employ motion compensated prediction and processed residual reference pictures. Further disclosed herein are systems and methods for generating residual reference pictures. These pictures can be generated adaptively with or without considering in-loop filtering effects. Exemplary de-noising filter designs are also described for enhancing the quality of residual reference pictures, and compression methods are described for reducing the storage size of reference pictures. Further disclosed herein are exemplary syntax designs for communicating residuals' motion information.Type: GrantFiled: May 2, 2017Date of Patent: June 23, 2020Assignee: Vid Scale, Inc.Inventors: Chun-Chi Chen, Xiaoyu Xiu, Yuwen He, Yan Ye
-
Publication number: 20200169573Abstract: Systems and methods for adaptively streaming video content to a wireless transmit/receive unit (WTRU) or wired transmit/receive unit may comprise obtaining a media presentation description that comprises a content authenticity, requesting a key for a hash-based message authentication code; receiving the key for the hash-based message authentication code, determining a determined hash for a segment of the media presentation description, requesting a reference hash for the segment from a server, receiving the reference hash for the segment from the server, and comparing the reference hash to the determined hash to determine whether the requested hash matches the determined hash.Type: ApplicationFiled: January 29, 2020Publication date: May 28, 2020Applicant: Vid Scale, Inc.Inventor: Alexander Giladi
-
Publication number: 20200169768Abstract: Media content coded using scalable coding techniques may be cached among a group of cache devices. Layered segments of the media content may be pre-loaded onto the cache devices, which may be located throughout a content distribution network, including a home network. The caching location of the media content may be determined based on multiple factors including a content preference associated with the group of cache devices and device capabilities. A cache controller may manage the caching of the media content.Type: ApplicationFiled: January 29, 2020Publication date: May 28, 2020Applicant: Vid Scale, Inc.Inventors: Yong He, Yuwen He, Yan Ye, Ralph Neff
-
Publication number: 20200169753Abstract: 360-degree video content may be coded. A sampling position in a projection format may be determined to code 360-degree video content. For example, a sampling position in a target projection format and a sampling position in a reference projection format may be identified. The sample position in the target projection format may be related to the corresponding sample position in the reference projection format via a transform function. A parameter weight (e.g., a reference parameter weight) for the sampling position in the reference projection format may be identified. An adjustment factor associated with the parameter weight for the sampling position in the reference projection format may be determined. The parameter weight (e.g., adjusted parameter weight) for the sampling position in the target projection format may be calculated. The calculated adjusted parameter weight may be applied to the sampling position in the target projection format when coding the 360-degree video content.Type: ApplicationFiled: June 29, 2018Publication date: May 28, 2020Applicant: VID SCALE, INC.Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
-
Patent number: 10666953Abstract: Sampling grid information may be determined for multi-layer video coding systems. The sampling grid information may be used to align the video layers of a coding system. Sampling grid correction may be performed based on the sampling grid information. The sampling grids may also be detected. In some embodiments, a sampling grid precision may also be detected and/or signaled.Type: GrantFiled: February 5, 2018Date of Patent: May 26, 2020Assignee: VID SCALE, Inc.Inventors: Yan Ye, Yuwen He, Jie Dong
-
Patent number: 10652588Abstract: Systems, methods, and instrumentalities are disclosed for inverse shaping for high dynamic range (HDR) video coding. A video coding device, e.g., such as a decoder, may determine a plurality of pivot points associated with a plurality of piecewise segments of an inverse reshaping model. The plurality of pivot points may be determined based on an indication received via a message. Each piecewise segment may be defined by a plurality of coefficients. The video coding device may receive an indication of a first subset of coefficients associated with the plurality of piecewise segments. The video coding device may calculate a second subset of coefficients based on the first subset of coefficients and the plurality of pivot points. The video coding device may generate an inverse reshaping model using one or more of the plurality of pivot points, the first subset of coefficients, and the second subset of coefficients.Type: GrantFiled: September 21, 2016Date of Patent: May 12, 2020Assignee: VID SCALE, Inc.Inventors: Louis Kerofsky, Yuwen He, Yan Ye, Arash Vosoughi
-
Publication number: 20200137462Abstract: Systems, methods, and instrumentalities are disclosed for a 360-degree video streaming. A video streaming device may receive a 360-degree video stream from a network node. The video streaming device may determine a viewport associated with the video streaming device and/or the 360-degree video stream. The video streaming device may determine (e.g., based on the viewport} to request in advance a first segment and a second segment of the 360-degree video stream. The video streaming device may determine a relative priority order for the first segment and the second segment. The video streaming device may generate an anticipated requests message. The anticipated requests message may indicate the determined relative priority order, for example, by listing the first segment and the second segment in decreasing relative priority based on the determined relative priority order. The video streaming device may send the anticipated requests message to the network node.Type: ApplicationFiled: June 1, 2018Publication date: April 30, 2020Applicant: VID SCALE, INC.Inventors: Yong He, Yan Ye
-
Publication number: 20200120359Abstract: A coding device (e.g., that may be or may include encoder and/or decoder) may receive a frame-packed picture of 380-degree video. The coding device may identify a face in the frame-packed picture that the current block belongs to. The coding device may determine that a current block is located at a boundary of the face that the current block belongs to. The coding device may identify multiple spherical neighboring blocks of the current block. The coding device may identify a cross-face boundary neighboring block. The coding device may identify a block in the frame-packed picture that corresponds to the cross-face boundary neighboring block. The coding device may determine whether to use the identified block to code the current block based on availability of the identified block. The coding device may code the current block based on the determination to use the identified block.Type: ApplicationFiled: April 10, 2018Publication date: April 16, 2020Applicant: VID SCALE, INC.Inventors: Philippe Hanhart, Yuwen He, Yan Ye
-
Patent number: 10616597Abstract: Systems, methods, and instrumentalities are disclosed for reference picture set mapping for scalable video coding. A device may receive an encoded scalable video stream comprising a base layer video stream and an enhancement layer video stream. The base layer video stream and the enhancement layer video streams may be encoded according to different video codecs. For example, the base layer video stream may be encoded according to H.264/AVC and the enhancement layer may be encoded according to HEVC. The enhancement layer video stream may include inter-layer prediction information. The inter-layer prediction information may include information relating to the base layer coding structure. The inter-layer prediction information may identify one or more reference pictures available in a base layer decoded picture buffer (DPB). A decoder may use the inter-layer prediction information to decode the enhancement layer video stream.Type: GrantFiled: February 20, 2018Date of Patent: April 7, 2020Assignee: VID SCALE, Inc.Inventors: Yong He, Yan Ye, Yuwen He
-
Publication number: 20200107027Abstract: A video coding device may identify a network abstraction layer (NAL) unit. The video coding device may determine whether the NAL unit includes an active parameter set for a current layer. When the NAL unit includes the active parameter set for the current layer, the video coding device may set an NAL unit header layer identifier associated with the NAL unit to at least one of: zero, a value indicative of the current layer, or a value indicative of a reference layer of the current layer. The NAL unit may be a picture parameter set (PPS) NAL unit. The NAL unit may be a sequence parameter set (SPS) NAL unit.Type: ApplicationFiled: December 5, 2019Publication date: April 2, 2020Applicant: VID SCALE, INC.Inventors: Yong He, Yan Ye, Xiaoyu Xiu, Yuwen He
-
Patent number: 10609395Abstract: A high dynamic range (HDR) signal processing device may receive a video signal and an operating mode indication. The operating mode indication may indicate a format of the video signal, for example, an HDR format or a non-DR format. Whether to perform adaptive reshaping on the video signal may be determined based on the operating mode indication. For example, it may be determined to perform the adaptive reshaping if the operating mode indicates that the video signal is in an HDR format. It may be determined to bypass the adaptive reshaping if the operating mode indicates that the video signal is in the non-HDR format. Multiple types of HDR reconstruction metadata may be received via a network abstraction layer (NAL) unit.Type: GrantFiled: July 28, 2016Date of Patent: March 31, 2020Assignee: VID SCALE, Inc.Inventors: Louis Kerofsky, Yuwen He, Yan Ye