Motion Vector Patents (Class 375/240.16)
  • Patent number: 11405633
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, a modified motion vector set; and performing the conversion based on the modified motion vector set. Due to the current block satisfying a condition, the modified motion vector set is a modified version of a motion vector set associated with the current block.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: August 2, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11405631
    Abstract: Decoding a current frame includes identifying a first reference frame and a second reference frame for decoding the current frame; storing reference motion vectors of reference blocks of the first reference frame, where other reference frames are used to decode the first reference frame; identifying motion trajectories that pass through the current frame by projecting the reference motion vectors of the reference blocks of the first reference frame onto the current frame using at least a third reference frame of the other reference frames, where the projecting identifies, for a first current block of the current frame a corresponding first reference block in the first reference frame, and a corresponding reference motion vector of the reference motion vectors is associated with the corresponding first reference block; and projecting the corresponding reference motion vector onto the second reference frame to obtain a second reference block in the second reference frame.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: August 2, 2022
    Assignee: GOOGLE LLC
    Inventors: Jingning Han, Yaowu Xu, James Bankoski, Jia Feng
  • Patent number: 11405634
    Abstract: The present technique relates to an image processing device and method capable of suppressing a decrease in encoding efficiency. The image processing device includes: a predictive vector generating unit that generates a predictive vector of a current parallax vector of a current block used in prediction using correlation in a parallax direction using a reference parallax vector referred when generating a predictive motion vector, when encoding the current parallax vector; and a difference vector generating unit that generates a difference vector between the current parallax vector and the predictive vector generated by the predictive vector generating unit. The present disclosure can be applied to an image processing device.
    Type: Grant
    Filed: July 17, 2020
    Date of Patent: August 2, 2022
    Assignee: Sony Corporation
    Inventors: Yoshitomo Takahashi, Shinobu Hattori
  • Patent number: 11402883
    Abstract: An information handling system includes a cooling fan operable in one of a plurality of fan speed levels, and a connector to which a headphone device can be connected. A mode controller sets the cooling fan to a first fan speed levels, receives an indication that the headphone device is connected to the connector, and sets the cooling fan in a second, higher fan speed level in response to receiving the indication.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: August 2, 2022
    Assignee: Dell Products L.P.
    Inventors: Salus Lin, Ping-Sheng Kao
  • Patent number: 11394964
    Abstract: Coding and decoding methods for coding and decoding a coded data stream representing at least one image split into blocks. The method includes, for a current block, determining if the current block is coded according to an intra coding mode or another coding mode, the intra coding mode using an intra prediction mode selected from a group of intra prediction modes, according to an intra prediction mode associated with a neighbouring block of the current block. When coded according to the intra coding mode, an intra prediction mode in the group is determined for the current block, according to an intra prediction mode associated with a previously decoded block of the image. The current block is decoded according to the determined intra prediction mode associated with the current block. When coded according to the other coding mode, the current block is decoded according to the other coding mode.
    Type: Grant
    Filed: June 18, 2019
    Date of Patent: July 19, 2022
    Assignee: ORANGE
    Inventors: Felix Henry, Mohsen Abdoli
  • Patent number: 11394985
    Abstract: Computer processor hardware: parses a data stream into first portions of encoded data and second portions of encoded data; implements a first decoder to decode the first portions of encoded data into a first rendition of a signal; implements a second decoder to decode the second portions of encoded data into reconstruction data, the reconstruction data specifying how to modify the first rendition of the signal; and applies the reconstruction data to the first rendition of the signal to produce a second rendition of the signal.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: July 19, 2022
    Inventors: Luca Rossato, Guido Meardi
  • Patent number: 11394992
    Abstract: Video processing methods and apparatuses for coding a current block by constructing a candidate set including an average candidate generated from two or more original motion candidates. At least one MV of the average candidate is derived by directly averaging MVs of the original motion candidates in one of list 0 and list 1 without scaling regardless whether the MVs are pointing to same or different reference pictures. A selected candidate is determined from the candidate set as a MVP for a current MV of the current block for encoding or decoding the current block.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: July 19, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Yu-Ling Hsiao, Tzu-Der Chuang, Chih-Wei Hsu, Chun-Chia Chen
  • Patent number: 11394976
    Abstract: An image decoding method carried out by a decoding apparatus according to the present invention comprises the steps of: deriving a correspondence block corresponding to the current block of the current picture, the correspondence block being located in a co-located picture; deriving a movement vector of the correspondence block; scaling the movement vector of the correspondence block on the basis of a first temporal distance and second temporal distance, the first temporal distance being the difference between the POC values of the co-located picture and POC values of the reference picture of the correspondence block, and the second temporal distance being the difference between the POC values of the co-located picture and POC values of the current picture containing the current block; deriving the movement vector updated on the basis of the scaled movement vector and location of the current block; and deriving a movement vector of the current block on the basis of the updated movement vector.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: July 19, 2022
    Assignee: LG Electronics Inc.
    Inventors: Naeri Park, Junghak Nam, Jaehyun Lim, Seunghwan Kim, Jungdong Seo, Jaeho Lee, Hyeongmoon Jang
  • Patent number: 11394968
    Abstract: An encoder that encodes a current block to be encoded in an image is provided. The encoder includes: processor; and memory coupled to the processor, in which, in operation, the processor: generates a first prediction image based on a motion vector, the first prediction image being an image with full-pel precision; generates a second prediction image using an interpolation filter by interpolating a value at a fractional-pel position between full-pel positions included in the first prediction image; and encodes the current block based on the second prediction image, and in the using of the interpolation filter, the interpolation filter is switched between a first interpolation filter and a second interpolation filter differing in a total number of taps from the first interpolation filter.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: July 19, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Chong Soon Lim, Hai Wei Sun, Han Boon Teo, Jing Ya Li, Che-Wei Kuo, Kiyofumi Abe, Tadamasa Toma, Takahiro Nishi, Yusuke Kato
  • Patent number: 11394986
    Abstract: A process for determining the selection of filters and input samples is provided for scalable video coding. The process provides for re-sampling using video data obtained from an encoder or decoder process of a base layer (BL) in a multi-layer system to improve quality in Scalable High Efficiency Video Coding (SHVC). In order to accommodate other applications such as interlace/progressive scalability and to increase the resolution of the alignment between layers, it is proposed that the phase offset adjustment parameters be signaled.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: July 19, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Koohyar Minoo, David M. Baylon, Ajay Luthra
  • Patent number: 11386856
    Abstract: The present disclosure relates to a method and a device for adjusting a MINI LED backlight television picture, and discloses that when a television backlight module adopts a MINI LED backlight lamp bead, according to a route of a motion track in a motion picture, the next dark field in an edge area is pre-lightened at a higher refresh rate or an edge of a bright picture is subjected to black shielding when a brightness of previous and next frames changes obviously, thereby improving the picture display effect.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: July 12, 2022
    Assignee: SHENZHEN SKYWORTH-RGB ELECTRONIC CO., LTD.
    Inventors: Wensheng Hong, Minghuo Yu
  • Patent number: 11385069
    Abstract: An optical navigation system comprising a control circuit and an optical navigation device. The optical navigation device comprises: an image sensor, configured to generate a plurality of image frames; and a motion reporting device, configured to report a first motion of the optical navigation device to the control circuit at a first time after a reference time, and configured to report a second motion to the control circuit at a second time after the first time. The first motion and the second motion are calculated according to the image frames. The control circuit calculates a first scaled motion according to the first motion, the second motion, a first time difference between the first time and the reference time, and a second time difference between the first time and the second time.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: July 12, 2022
    Assignee: PixArt Imaging Inc.
    Inventors: Willie Song, Zi Hao Tan
  • Patent number: 11388419
    Abstract: Improved video coding techniques include deriving prediction pixel blocks for use in intra-coding video and combined inter- and intra-coding video. In a first aspect, the techniques may include deriving value(s) for pixel location(s) of the prediction pixel block by, when a prediction direction vector assigned to the prediction vector points to quadrants I or III of a Cartesian plane, deriving the pixel location's value from pixel values in two regions of previously-decoded pixel data intercepted by extending the prediction direction vector in two opposite directions through the pixel location. When the prediction direction vector points toward quadrants II of the Cartesian plane, deriving the pixel location's value from pixel values in one region intercepted by the prediction direction vector through the pixel location, and from a second region intercepted by a vector that is orthogonal to the prediction direction vector.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: July 12, 2022
    Assignee: Apple inc.
    Inventors: Mei Guo, Jun Xin, Hsi-Jung Wu, Alexandros Tourapis, Krishnakanth Rapaka
  • Patent number: 11388393
    Abstract: A method for coding image information includes generating prediction information by predicting information on a current coding unit, and determining whether the information on the current coding unit is the same as the prediction information. When the information on the current coding unit is the same as the prediction information, a flag indicating that the information on the current coding unit is the same as the prediction information is coded and transmitted. When the information on the current coding unit is not the same as the prediction information, a flag indicating that the information on the current coding unit is not the same as the prediction information and the information on the current coding unit are coded and transmitted. At the generating of the prediction information, the prediction information is generated by using the information on the coding unit neighboring to the current coding unit.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: July 12, 2022
    Assignees: Electronics and Telecommunications Research Institute, University-Industry Cooperation Group of Kyung Hee University
    Inventors: Se Yoon Jeong, Hui Yong Kim, Sung Chang Lim, Jin Ho Lee, Ha Hyun Lee, Jong Ho Kim, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn, Gwang Hoon Park, Kyung Yong Kim, Han Soo Lee, Tae Ryong Kim
  • Patent number: 11388415
    Abstract: A method of video encoding at a video encoder can include receiving a picture, and determining a substitutional representation of the picture by performing an optimization process to tune elements of the substitutional representation of the picture to optimize a rate-distortion performance of coding the substitutional representation of the picture based on an end-to-end (E2E) optimized framework. The E2E optimized framework can be an artificial neural network (ANN) based video coding framework that is pretrained. The substitutional representation of the picture can be encoded to generate a bitstream.
    Type: Grant
    Filed: April 15, 2021
    Date of Patent: July 12, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiao Wang, Wei Jiang, Wei Wang, Shan Liu
  • Patent number: 11388396
    Abstract: Video coding and decoding in which the bitstream is generated using affine motion compensation mode are described. One example includes generating, for a reconstruction of a current video unit, a list of affine motion vector prediction candidates in which each candidate in the list is calculated without using a clipping operation, wherein the clipping operation limits a magnitude of the candidate motion vectors to a range; and performing the reconstruction of the current video unit using the list of affine motion vector prediction candidates.
    Type: Grant
    Filed: March 5, 2021
    Date of Patent: July 12, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11388401
    Abstract: Transform-level partitioning of a prediction residual block is performed to improve compression efficiency of video data. During encoding, a prediction residual block is generated responsive to prediction-level partitioning performed against a video block, a transform block partition type to use is determined based on the prediction residual block, a non-recursive transform-level partitioning is performed against the prediction residual block according to the transform block partition type, and transform blocks generated as a result of the transform-level partitioning are encoded to a bitstream.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: July 12, 2022
    Assignee: GOOGLE LLC
    Inventors: Sarah Parker, Debargha Mukherjee, Yue Chen, Elliott Karpilovsky, Urvang Joshi
  • Patent number: 11388413
    Abstract: The disclosed computer-implemented method may include downsampling and encoding one or more video segments into a plurality of encoded segments with a first encoder using a plurality of encoding parameter value sets and decoding and upsampling the plurality of encoded segments to a plurality of decoded segments at an original resolution of the one or more video segments. The method may also include determining, based on analyzing the plurality of decoded segments, an optimal encoding parameter value set for the one or more video segments. The method may further include encoding the one or more video segments with a second encoder using the optimal encoding parameter value set. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: July 12, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Ping-Hao Wu, Ioannis Katsavounidis
  • Patent number: 11381834
    Abstract: Video processing methods and apparatuses for coding a current block comprise receiving input data of a current block, partitioning the current block into multiple sub-blocks, deriving sub-block MVs for the current block according to a sub-block motion compensation coding tool, constraining the sub-block MVs to form constrained sub-block MVs, and encoding or decoding the current block using the constrained sub-block MVs. The sub-block MVs may be constrained according to a size, width, or height of the current block or a sub-block, an inter prediction direction of one of control point MVs of the current block, the current block, or current sub-block, the control point MVs, or a combination of the above.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: July 5, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chen-Yen Lai, Chih-Wei Hsu
  • Patent number: 11381829
    Abstract: An image decoding method may include: deriving motion information of a first prediction unit determined by a first partitioning mode of a current block and motion information of a second prediction unit determined by a second partitioning mode of the current block; generating a prediction block of the first prediction unit by using the motion information of the first prediction unit and generating a prediction block of the second prediction unit by using the motion information of the second prediction unit; and generating a prediction block of the current block in units of sub-prediction unit determined by combining the first prediction unit and the second prediction unit by using the first prediction block and the second prediction block.
    Type: Grant
    Filed: August 19, 2016
    Date of Patent: July 5, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Naeri Park, Junghak Nam, Jaehyun Lim
  • Patent number: 11381807
    Abstract: There are provided mechanisms for temporal motion vector prediction of a current picture in a series of pictures of a video sequence. The method comprises determining, for a current block of the current picture, whether any one of: left, top, top-right and left-bottom spatial neighboring blocks of the current block in the current picture uses a collocated picture as a reference picture. The method further comprises, when the determination is that one of the left, top, top-right and left-bottom spatial neighboring block uses a collocated picture as a reference picture, using a motion vector of the one of the spatial neighboring blocks as a temporal vector of the current block.
    Type: Grant
    Filed: November 20, 2019
    Date of Patent: July 5, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Ruoyang Yu, Kenneth Andersson, Du Liu
  • Patent number: 11375231
    Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry can decode, from a coded video bitstream, a first syntax element signaled at a first coding level. The first syntax element can indicate a maximum number of merge motion vector prediction (MVP) candidates. The first coding level can be higher than a picture parameter set (PPS) level. The processing circuitry can determine the maximum number of merge MVP candidates based on the first syntax element. The processing circuitry can reconstruct coding blocks associated with the first coding level based at least on the maximum number of merge MVP candidates. The first coding level can be a sequence level and the first syntax element can be signaled in a sequence parameter set (SPS).
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: June 28, 2022
    Assignee: Tencent America LLC
    Inventors: Ling Li, Xiang Li, Shan Liu
  • Patent number: 11375220
    Abstract: Aspects of the disclosure provide an apparatus that includes processing circuitry and a method for video decoding. The processing circuitry decodes coding information of a block to be reconstructed from a coded video bitstream. The coding information indicates intra prediction information for the block. For the block coded with a directional mode, the processing circuitry determines the directional mode based on a nominal mode and an angular offset. The coding information indicates the nominal mode and the angular offset. The processing circuitry determines a non-separable transform for the block based on the nominal mode, and reconstructs the block based on the directional mode and the non-separable transform. In an example, the processing circuitry determines a transform set mode that is associated with the nominal mode, and the transform set mode indicates a set of one or more non-separable transforms that includes the non-separable transform.
    Type: Grant
    Filed: September 24, 2020
    Date of Patent: June 28, 2022
    Assignee: Tencent America LLC
    Inventors: Xin Zhao, Liang Zhao, Shan Liu
  • Patent number: 11375228
    Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, a modified motion vector set; and performing the conversion based on the modified motion vector set. Due to the current block satisfying a condition, the modified motion vector set is a modified version of a motion vector set associated with the current block.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: June 28, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11375229
    Abstract: The invention relates to the encoding or decoding of at least one portion of an image by predicting the at least one portion using at least one predictor, the at least one predictor being determined as a function of at least one reference image portion and as a function of values of a plurality of items of motion information. After having obtained a value of a first item of the plurality of items, a value of a second item is evaluated as a function of the obtained value of the first item, the second item being an item of the plurality of items and being distinct from the first item. Next, the at least one predictor is determined as a function of the at least one reference image portion and as a function of the first and second items.
    Type: Grant
    Filed: January 11, 2021
    Date of Patent: June 28, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Guillaume Laroche, Christophe Gisquet, Patrice Onno
  • Patent number: 11375226
    Abstract: An embodiment of the method receives input data associated with a current block in a current picture at a video encoder or receiving a video bitstream corresponding to compressed data including the current block in the current picture at a video decoder, wherein the current block is coded or to be coded in an affine mode according to an affine motion model; calculates and storing affine parameters for a plurality of coded blocks in the current picture; retrieves the affine parameters of one or more coded blocks from the temporal buffer; derives an affine candidate including affine motion vectors using the retrieved affine parameters of the neighboring block; and encodes or decodes the current block by predicting the current block using one or more motion compensated blocks by the derived affine candidate.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: June 28, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Han Huang, Xiaozhong Xu, Shan Liu
  • Patent number: 11368713
    Abstract: A method of subblock-based temporal motion vector prediction is performed at a computing device. The computing device acquires a video bitstream including data associated with multiple encoded pictures. While decoding a current picture in the video bitstream, the computing device selects, according to syntax elements signaled in the video bitstream, one reference picture as a collocated picture of the current picture, and determines a temporal vector between the collocated picture and the current picture from motion information of spatially neighboring blocks of a current code unit (CU) according to a fixed order. Next, the computing device splits the current CU into multiple sub-CUs, obtains a temporal motion vector predictor for each sub-CU from the temporal vector and motion information of a block in the collocated picture that corresponds to a respective subblock of the current picture and decodes the current CU according to the temporal motion vector predictors.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: June 21, 2022
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Yi-Wen Chen, Xianglin Wang
  • Patent number: 11368707
    Abstract: Disclosed are an inter prediction mode-based image processing method and an apparatus therefor. Particularly, a method for processing an image on the basis of inter prediction may comprise the steps of: determining whether a motion vector scale adaptation is applied to a block; up-scaling a down-scaled MVD (Motion Vector Difference) when the motion vector scale adaptation is applied to the block; deriving a MV (Motion Vector) for the block, using the up-scaled MVD and a MVP (Motion Vector Predictor); and generating a predictive block of the block, using the derived MV.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: June 21, 2022
    Assignee: LG ELECTRONICS, INC.
    Inventors: Jaehyun Lim, Naeri Park, Jungdong Seo, Junghak Nam
  • Patent number: 11367289
    Abstract: Enclosed are embodiments of an ML-based framework for drivable surface annotation. In an embodiment, a method comprises: obtaining, using at least one processor, multimodal map data for a geographic region; and automatically annotating, using the at least one processor, one or more semantic masks of the map data using a machine learning model.
    Type: Grant
    Filed: July 16, 2021
    Date of Patent: June 21, 2022
    Assignee: Motional AD LLC
    Inventors: Sergi Adipraja Widjaja, Venice Erin Baylon Liong, Zhuang Jie Chong, Apoorv Singh
  • Patent number: 11367165
    Abstract: In one embodiment, a method includes receiving a first frame associated with a first time and one or more second frames of a video having a resolution lower than a target resolution, wherein each second frame is associated with a second time prior to the first time, generating a first feature map for the first frame and one or more second feature maps for the one or more second frames, up-sampling the first feature map and the one or more second feature maps to the target resolution, warping each of the up-sampled second feature maps according to a motion estimation between the associated second time and the first time, and generating a reconstructed frame having the target resolution corresponding to the first frame by using a machine-learning model to process the up-sampled first feature map and the one or more up-sampled and warped second feature maps.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: June 21, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Lei Xiao, Salah Eddine Nouri, Douglas Robert Lanman, Anton S Kaplanyan, Alexander Jobe Fix, Matthew Steven Chapman
  • Patent number: 11368682
    Abstract: A device for encoding/decoding the image according to the present invention includes an intra prediction module configured to: determine an intra prediction mode of a current block; determine a scanning order of multiple sub blocks in the current block on the basis of the determined intra prediction mode; and perform intra prediction of the current block on the basis of the determined scanning order.
    Type: Grant
    Filed: April 19, 2017
    Date of Patent: June 21, 2022
    Assignee: Intellectual Discovery Co., Ltd.
    Inventors: Dong Gyu Sim, Ho Chan Ryu, Yong Jo Ahn
  • Patent number: 11363290
    Abstract: Methods of enabling and disabling a decoder-side motion vector refinement (DMVR) video decoder and/or encoder are described. One example method includes determining a width (W) and a height (H) of a video block, making a determination, based on a condition of the video block, between enabling and disabling a decoder side motion vector refinement step for a conversion between the video block and a coded representation of the video block, in a case that the determination is enabling, performing the conversion by enabling the decoder side motion vector refinement step; and in a case that the determination is disabling, performing the conversion by disabling the decoder side motion vector refinement step, wherein the decoder side motion vector refinement step includes refining value of a motion vector signaled in the coded representation and using the refined value during the conversion.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: June 14, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Hongbin Liu, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11363294
    Abstract: A video processing method includes determining an image before a current frame in time sequence as a long-term reference image according to an identifier, determining a motion vector candidate list of a current coding unit, receiving a plurality of indexes, and obtaining an initial motion vector of the current coding unit from the motion vector candidate list according to the indexes. If a reference image pointed to by the initial motion vector is a short-term reference image, the initial motion vector is corrected to obtain a corrected motion vector and prediction is performed for the current coding unit according to the corrected motion vector. If the reference image is a long-term reference image, prediction is performed for the current coding unit according to the initial motion vector without correcting the initial motion vector.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: June 14, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Weiran Li, Xiaozhen Zheng
  • Patent number: 11363289
    Abstract: An image decoding method performed by a decoding device according to the present invention comprises the steps of: acquiring information on inter prediction of a target block through a bit stream; deriving motion information of the target block on the basis of the information on inter prediction; deriving a prediction sample by performing inter prediction for the target block on the basis of the motion information; generating a reconstruction block on the basis of the prediction sample; deriving modified motion information of the target block on the basis of the reconstruction block; and updating the motion information of the target block on the basis of the modified motion information. According to the present invention, modified motion information of the target block can be calculated, and the motion information of the target block can be updated on the basis of the modified motion information, so that the overall coding efficiency can be improved.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: June 14, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Jungdong Seo, Jaehyun Lim
  • Patent number: 11363286
    Abstract: A method of video operations includes generating derivative byproducts related to encoded video captured of a scene, initializing a first operation based on the encoded video, and initializing a second operation different from the first operation based on the derivative byproducts.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: June 14, 2022
    Assignee: Verint Americas Inc.
    Inventor: Francois Morin
  • Patent number: 11363270
    Abstract: An encoding device includes a deriving unit and an encoding unit. The deriving unit is configured to derive a first reference value based on fixed point precision representing roughness of a weighting factor that is used for multiplying a reference image. The encoding unit is configured to encode a first difference value that is a difference value between the weighting factor and the first reference value and the fixed point precision. The weighting factor is included in a first range of predetermined bit precision having the first reference value at approximate center. The first difference value is in the predetermined range.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: June 14, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Akiyuki Tanizawa, Takeshi Chujoh
  • Patent number: 11356693
    Abstract: Coding a motion vector difference (MVD) during an inter-prediction process. Example techniques may include determining a particular coding and/or signaling method for an MVD from among two or more MVD coding and/or signaling techniques. A video coder (e.g., a video encoder and/or a video decoder) may determine a particular MVD coding and/or signaling technique based on characteristics of video data or coding methods, including MV precision, Picture Order Count (POC) difference, or any other already coded/decoded information of a block of video data.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: June 7, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Wei-Jung Chien, Jianle Chen, Li Zhang, Marta Karczewicz
  • Patent number: 11356660
    Abstract: A decoder includes circuitry configured to receive a bitstream, identify a first frame, locate a first independent reference region within the first frame, extract the first independent reference region from the first frame, decode a second frame using the first independent reference region as a reference for the second frame.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: June 7, 2022
    Assignee: OP Solutions, LLC
    Inventors: Hari Kalva, Borivoje Furht, Velibor Adzic
  • Patent number: 11356669
    Abstract: A moving picture coding apparatus includes an intra-inter prediction unit which calculates a second motion vector by performing a scaling process on a first motion vector of a temporally neighboring corresponding block, when selectively adding, to a list, a motion vector of each of one or more corresponding blocks each of which is either a block included in a current picture to be coded and spatially neighboring a current block to be coded or a block included in a picture other than the current picture and temporally neighboring the current block, determines whether the second motion vector has a magnitude that is within a predetermined magnitude or not within the predetermined magnitude, and adds the second motion vector to the list when the intra-inter prediction unit determines that the second motion vector has a magnitude that is within the predetermined magnitude range.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: June 7, 2022
    Assignee: Velos Media, LLC
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Kyoko Tanikawa, Hisao Sasai, Toru Matsunobu, Kengo Terada
  • Patent number: 11356696
    Abstract: An image coding method includes: deriving a candidate for a motion vector predictor from a co-located motion vector; adding the candidate to a list; selecting the motion vector predictor from the list; and coding a current block and coding a current motion vector, wherein the deriving includes: deriving the candidate by a first derivation scheme in the case of determining that each of a current reference picture and a co-located reference picture is a long-term reference picture; and deriving the candidate by a second derivation scheme in the case of determining that each of the current reference picture and the co-located reference picture is a short-term reference picture.
    Type: Grant
    Filed: December 9, 2020
    Date of Patent: June 7, 2022
    Assignee: SUN PATENT TRUST
    Inventors: Viktor Wahadaniah, Chong Soon Lim, Sue Mon Thet Naing, Hai Wei Sun, Toshiyasu Sugio, Takahiro Nishi, Hisao Sasai, Youji Shibahara, Kyoko Tanikawa, Toru Matsunobu, Kengo Terada
  • Patent number: 11356700
    Abstract: The invention relates to the encoding of spherical 360-degree videos using 2D block-based encoders. The encoding requires a spherical 360-degree image to be projected onto a projection subpart of a 2D image, using for instance CMP, OHP, ISP, TSP, SSP or RSP techniques. The boundary of the projected image may then be extended, within the 2D image, into an extended block-based boundary portion based on the block structure used by the 2D encoder to then encode the 2D image. The boundary extension may be set along block edges in the vicinity of the projected image. The extended pixels added to the projected image may be padding pixels with values set based on continuing 360-degree image projection or based on neighboring pixels. More homogenous blocks can be obtained for better compression by the encoder, while the seam artefacts resulting from discontinuity between projected subparts of the 360-degree image are reduced.
    Type: Grant
    Filed: June 22, 2018
    Date of Patent: June 7, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Patrice Onno, Guillaume Laroche, Jonathan Taquet, Christophe Gisquet
  • Patent number: 11356694
    Abstract: By the moving picture coding method and the moving picture decoding method, it is possible to improve coding efficiency. The moving picture coding apparatus includes a merge block candidate calculation unit that (i) specifies merge block candidates at merge mode, by using colpic information such as motion vectors and reference picture index values of neighbor blocks of a current block to be coded and a motion vector and the like of a collocated block of the current block which are stored in a colPic memory, and (ii) generates a combined merge block by using the merge block candidates.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: June 7, 2022
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Hisao Sasai
  • Patent number: 11348247
    Abstract: A method for generating semantic information may include obtain a scanning image. The scanning image may include a plurality of pixels representing an anatomical structure. The method may also include obtain a trained segmentation model. The method may further include determine a location probability distribution of the anatomical structure in the scanning image based on the trained segmentation model. The method may also include generate a segmentation result related to the anatomical structure based on the location probability distribution. The method may further include save the segmentation result into a tag of a digital imaging and communications in medicine (DICOM) file.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: May 31, 2022
    Assignee: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
    Inventors: Ke Wu, Jieyan Ma, Weijuan Li
  • Patent number: 11350107
    Abstract: An image encoding/decoding method and apparatus for performing template matching-based intra prediction are provided. An image decoding method may comprise deriving a first intra-prediction mode for a current block, generating a first intra-prediction block corresponding to the first intra-prediction mode, deriving a second intra-prediction mode for the current block, generating a second intra-prediction block corresponding to the second intra-prediction mode, and generating a final intra-prediction block by using a weighted sum of the first intra-prediction block and the second intra-prediction block.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: May 31, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Dong San Jun, Sung Chang Lim, Jung Won Kang, Hyun Suk Ko, Jin Ho Lee, Ha Hyun Lee, Hui Yong Kim
  • Patent number: 11350124
    Abstract: A video processing method includes determining a reference image before a current frame in time sequence as a long-term reference image according to an identifier, determining a motion vector candidate list of a current coding unit, and obtaining first and second initial motion vectors of the current coding unit from the motion vector candidate list. The first and second initial motion vectors point to first and second reference images, respectively, that are forward and backward frames of the current frame, respectively. The method further includes performing or not performing a target operation according to whether the first and second reference images are short-term or long-term reference images.
    Type: Grant
    Filed: March 8, 2021
    Date of Patent: May 31, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Weiran Li, Xiaozhen Zheng
  • Patent number: 11350092
    Abstract: Provided is an encoder which includes circuitry and memory. Using the memory, the circuitry splits an image block into a plurality of partitions, obtains a prediction image for a partition, and encodes the image block using the prediction image. When the partition is not a non-rectangular partition, the circuitry obtains (i) a first prediction image for the partition, (ii) a gradient image for the first prediction image, and (iii) a second prediction image as the prediction image using the first prediction image and the gradient image. When the partition is a non-rectangular partition, the circuitry obtains the first prediction image as the prediction image without using the gradient image.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: May 31, 2022
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Ryuichi Kanoh, Chong Soon Lim, Ru Ling Liao, Hai Wei Sun, Sughosh Pavan Shashidhar, Han Boon Teo, Jing Ya Li
  • Patent number: 11350118
    Abstract: An image encoding/decoding method of the present invention constructs a merge candidate list of a current block, derives motion information of the current block on the basis of the merge candidate list and a merge candidate index, and performs inter prediction on the current block on the basis of the derived motion information, wherein the merge candidate list can improve encoding/decoding efficiency by adaptively determining a plurality of merge candidates on the basis of the position or size of a merge estimation region (MER) to which the current block belongs.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: May 31, 2022
    Assignee: DIGITALINSIGHTS INC.
    Inventor: Yong Jo Ahn
  • Patent number: 11343533
    Abstract: An apparatus and method for marking availability of a candidate coding block for merge estimation of a current coding block within a coding tree unit (CTU). The candidate block may be marked as unavailable if a splitting depth of the current coding block is equal to or larger than a predetermined threshold and a first location of the candidate block and a second location of the current block are included in a same merge estimation region (MER). Otherwise, the candidate block is marked as available. A candidate block may be marked as unavailable also, when a parent block “parentCurr” of the current block and a parent block “parentCand” of the candidate block, with both parent blocks obtained by splitting, are the same block and when the size of the parentCand is smaller than a threshold.
    Type: Grant
    Filed: March 2, 2021
    Date of Patent: May 24, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Semih Esenlik, Han Gao, Jianle Chen, Anand Meher Kotra, Biao Wang
  • Patent number: RE49107
    Abstract: An audio encoder device includes an audio encoder configured for producing an encoded audio bitstream from an audio signal having consecutive audio frames; a dynamic range control encoder configured for producing an encoded dynamic range control bitstream from an a dynamic range control sequence corresponding to the audio signal and having consecutive dynamic range control frames, wherein each dynamic range control frame of the dynamic range control frames has one or more nodes, wherein each node of the one or more nodes has gain information for the audio signal and time information indicating to which point in time the gain information corresponds.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: June 14, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e. V.
    Inventors: Fabian Kuech, Christian Uhle, Michael Kratschmer, Bernhard Neugebauer, Michael Meier, Stephan Schreiner
  • Patent number: RE49109
    Abstract: A method is disclosed that includes: receiving, via a network digital video recorder, a request to record requested content; receiving, via a network digital video recorder at a first time, the requested content in a first format and the requested content in a second format; storing, via the network digital video recorder, the requested content in the first format; storing, via the network digital video recorder, the requested content in the second format; deleting, from network digital video recorder, the requested content in the second format after a predetermined time period; and transcoding, via an on demand transcoder, the requested content in the first format to the requested content in a third format after the predetermined time period.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: June 14, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Kevin S. Wirick, Michael A. Casteloes, Wendell Sun