Interframe Coding (e.g., Difference Or Motion Detection) Patents (Class 382/236)
  • Patent number: 11112796
    Abstract: Systems and methods for predicting object motion and controlling autonomous vehicles are provided. In one example embodiment, a computer implemented method includes obtaining state data indicative of at least a current or a past state of an object that is within a surrounding environment of an autonomous vehicle. The method includes obtaining data associated with a geographic area in which the object is located. The method includes generating a combined data set associated with the object based at least in part on a fusion of the state data and the data associated with the geographic area in which the object is located. The method includes obtaining data indicative of a machine-learned model. The method includes inputting the combined data set into the machine-learned model. The method includes receiving an output from the machine-learned model. The output can be indicative of a plurality of predicted trajectories of the object.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: September 7, 2021
    Assignee: UATC, LLC
    Inventors: Nemanja Djuric, Vladan Radosavljevic, Thi Duong Nguyen, Tsung-Han Lin, Jeff Schneider, Henggang Cui, Fang-Chieh Chou, Tzu-Kuo Huang
  • Patent number: 11102501
    Abstract: A motion vector field coding and decoding method, where the method includes obtaining an original signal of a current motion vector field block, where the current motion vector field block is obtained by dividing a current motion vector field into blocks, and the current motion vector field is a motion vector field corresponding to a video frame at a moment t, obtaining a prediction signal of the current motion vector field block and prediction information of the current motion vector field block, calculating a prediction residual signal of the current motion vector field block according to the prediction signal and the original signal, where the prediction residual signal is used to indicate a residual between the original signal and the prediction signal, and writing the prediction information and the prediction residual signal into a bitstream.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: August 24, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Hong Zhang, Haitao Yang
  • Patent number: 11095895
    Abstract: Techniques related to transform coefficient shaping for video encoding are discussed. Such techniques include applying weighting parameters from one or more perceptually-designed matrices of weighting parameters to blocks of transform coefficients to generate weighted transform coefficients and encoding the weighted transform coefficients into a bitstream. The process may be based on sets of perceptually designed matrices of weighting parameters. Classifier outputs may be used to select from the set of perceptually designed matrices a subset of matrices to work with. The latter may be used in a synthesis procedure to develop the final weighting matrix to be used is shaping the transform coefficients.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: August 17, 2021
    Assignee: Intel Corporation
    Inventors: Nader Mahdi, Chekib Nouira, Hassen Guermazi, Amir Naghdinezhad, Faouzi Kossentini, Foued Ben Amara
  • Patent number: 11082714
    Abstract: The present invention relates to the construction of a search space for determining a motion vector for a current block of a picture in a video sequence. The search space construction is split into two main stages, wherein a first and a second partial search space are respectively determined. Based on an initial estimate of a motion vector, a first search space is first constructed. A first and a second candidate motion vector of the first search space are identified according to a cost function. Based on the first and the second candidate motion vectors, a second search space is constructed. The motion vector for the current block is selected from the candidate motion vectors of the first search space and the second search space.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: August 3, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Anand Meher Kotra, Zhijie Zhao, Han Gao
  • Patent number: 11082713
    Abstract: A method and apparatus of Inter prediction for video coding performed in a video encoder or a video decoder are disclosed. In one method, a GMC (global motion compensation) indication indicating whether global motion compensation is enabled is signalled at the video encoder side or parsed from the video bitstream at the video decoder side. The current processing unit is encoded or decoded using one or more coding modes including a GMC mode if the GMC indication is indicates GMC is enabled. According to another method, if a GMC mode is enabled for a region, a number representing the total number of multiple global motion models allowed is determined for encoding or decoding the processing units in the region using multiple global motion models. In yet another method the GMC and local motion compensation are applied selectively or in a combined fashion.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: August 3, 2021
    Assignee: MEDIATEK INC.
    Inventors: Shan Liu, Xiaozhong Xu
  • Patent number: 11070839
    Abstract: A further coding efficiency increase is achieved by, in hybrid video coding, additionally predicting the residual signal of a current frame by motion-compensated prediction using a reference residual signal of a previous frame. In other words, in order to further reduce the energy of the final residual signal, i.e. the one finally transmitted, and thus increase the coding efficiency, it is proposed to additionally predict the residual signal by motion-compensated prediction using the reconstructed residual signals of previously coded frames.
    Type: Grant
    Filed: May 4, 2012
    Date of Patent: July 20, 2021
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Benjamin Bross, Thomas Wiegand, Heiko Schwarz
  • Patent number: 11055869
    Abstract: The present disclosure discloses a method, apparatus and system for assisting security inspection, and relates to the field of security inspection. The method includes: acquiring registration information of an inspected object; acquiring a standard scanned image corresponding to the registration information; displaying the standard scanned image in an AR manner to determine whether the inspected object is a suspicious object through comparing the standard scanned image with an actual scanned image, the actual scanned image comprising an image of the inspected object.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: July 6, 2021
    Inventors: Bicheng Liu, Haoran Zhang, Guangming Xu, Qi Wang, Qiangqiang Zhu, Yuan Wo
  • Patent number: 11049290
    Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: June 29, 2021
    Assignee: Adobe Inc.
    Inventors: Gwendal Simon, Viswanathan Swaminathan, Nathan Carr, Stefano Petrangeli
  • Patent number: 11051035
    Abstract: An example method for coding video data includes determining, for a current block of a current picture of video data, the current block coded using an intra block copy (IBC) mode, whether a motion vector (MV) for identifying a prediction block for the current block is a legal MV. The example method further includes, responsive to determining that the MV is not a legal MV, reconstructing samples of the current block using an alternative processing method.
    Type: Grant
    Filed: January 14, 2020
    Date of Patent: June 29, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Yu Han, Wei-Jung Chien, Marta Karczewicz
  • Patent number: 11042754
    Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: June 22, 2021
    Assignee: Google LLC
    Inventors: Yi Shen, Xiangrong Chen, Min-hsuan Tsai, Yun Shi, Tianpeng Jin, Zheng Sun, Weilong Yang, Jingbin Wang
  • Patent number: 11039164
    Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: corrects a base motion vector using a correction value for correcting the base motion vector in a predetermined direction; and encodes a current partition to be encoded in an image of a video, using the base motion vector corrected. The correction value is specified by a first parameter and a second parameter, the first parameter indicating a table to be selected from among a plurality of tables each including values, the second parameter indicating one of the values included in the table to be selected indicated by the first parameter. In each of the plurality of tables, a smaller value among the values is assigned a smaller index. Each of the plurality of tables includes a different minimum value among the values.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: June 15, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Jing Ya Li, Chong Soon Lim, Ru Ling Liao, Hai Wei Sun, Han Boon Teo, Kiyofumi Abe, Tadamasa Toma, Takahiro Nishi
  • Patent number: 11030774
    Abstract: A system, comprising a computer that includes a processor and a memory, the memory storing instructions executable by the processor to determine an object location prediction based on a video data stream, wherein the object location prediction is based on processing cropped TEDA data with a neural network. The processor can be further programmed to download the object location prediction to a vehicle based on a location of the vehicle.
    Type: Grant
    Filed: March 19, 2019
    Date of Patent: June 8, 2021
    Assignee: FORD GLOBAL TECHNOLOGIES, LLC
    Inventors: Mostafa Parchami, Gintaras Vincent Puskorius, Dinesh Palanisamy
  • Patent number: 11032541
    Abstract: Aspects of the disclosure provide methods and apparatuses for video coding. In some examples, an apparatus includes processing circuitry. The processing circuitry determines first and second reference motion vectors for decoding a current block based on coding information of at least one previously decoded block, offsets a first component to obtain a shifted first component, and offsets a second component to obtain a shifted second component. The processing circuitry generates a third component, on the first coordinate axis, of a first averaged reference motion vector by adding the shifted first component and the shifted second component, and constructs a list of reference motion vectors incorporating the first and second reference motion vectors and the first averaged reference motion vector. The processing circuitry also determines a motion vector predictor using the list of reference motion vectors, and decodes the current block for output based on the determined motion vector predictor.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: June 8, 2021
    Assignee: Tencent America LLC
    Inventors: Meng Xu, Xiang Li, Shan Liu
  • Patent number: 11025901
    Abstract: According to one embodiment of the present invention, a video information encoding method comprises: a step of predicting information of the current coding unit to generate prediction information; and a step of determining whether the information of the current coding unit coincides with the prediction information. If the information of the current coding unit coincides with the prediction information, a flag indicating that the information of the current coding unit coincides with the prediction information is encoded and transmitted. If the information of the current coding unit does not coincide with the prediction information, a flag indicating that the information of the current coding unit does not coincide with the prediction information is encoded and transmitted and the information of the current coding unit is encoded and transmitted.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: June 1, 2021
    Assignees: Electronics and Telecommunications Research Institute, University-Industry Cooperation Group of Kyung Hee University
    Inventors: Se Yoon Jeong, Hui Yong Kim, Sung Chang Lim, Jin Ho Lee, Ha Hyun Lee, Jong Ho Kim, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn, Gwang Hoon Park, Kyung Yong Kim, Han Soo Lee, Tae Ryong Kim
  • Patent number: 11025946
    Abstract: A method of video decoding in a decoder is described. A coded video bit stream is received. The coded video bit stream includes a block. An integer value p1 of a first motion vector component and an integer value p2 of a second motion vector component are received. The integer value p1 is associated with a corner of the block and the integer value p2 is associated with another corner of the block. The first motion vector component and the second motion vector component are of a same type of motion vector component. A motion vector predictor of the block is interpolated from the integer value p1 and the integer value p2 based on a lookup table and one or more of operations that only include addition, subtraction, and multiplication. A sample of the block is reconstructed based on the interpolated motion vector predictor of the block.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: June 1, 2021
    Assignee: Tencent America LLC
    Inventors: Jing Ye, Shan Liu, Stephan Wenger
  • Patent number: 11012706
    Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: selects a first table to be used for a current partition to be encoded in an image of a video, from among tables that are used to correct a base motion vector in a predetermined direction using a correction value specified by an index, the tables including correction values having varying differences between indexes; writes a parameter indicating a first index to be selected from among indexes included in the first table; and encodes the current partition using the base motion vector corrected using a correction value specified by the first index.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: May 18, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Jing Ya Li, Chong Soon Lim, Sughosh Pavan Shashidhar, Ru Ling Liao, Hai Wei Sun, Han Boon Teo, Kiyofumi Abe, Tadamasa Toma, Takahiro Nishi
  • Patent number: 10990923
    Abstract: Objects in a facility, such as users or totes, may be tracked as the object moves within the facility. An object representation of the object may be detected using image data. Apparent motion of the object representation may also be detected based on changes within the image data over time, which can help determine movement data for the object representation. However, the identity of the object representation may not be known. Using data from motion sensors in a device, movement data for the device can be generated. Thereafter, the movement data determined using the image data and the movement data determined using the data from the motion sensors in the device are compared for a possible match. If a match is found, an identifier of the device may then be associated with the object representation in the image data for tracking purposes.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: April 27, 2021
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Somasundaram Niranjayan, Nathan Pius O'Neill
  • Patent number: 10986271
    Abstract: In general, the subject matter can be embodied in methods, systems, and program products for identifying, by a computing system and using first and second frames of a video, a transformation that indicates movement of a camera with respect to the frames. The computing system generates a modified transformation so that the transformation is less representative of recent movement. The computing system uses the transformation and the modified transformation to generate a second transformation. The computing system identifies an anticipated distortion that would be present in a stabilized version of the second frame. The computing system determines an amount by which to reduce a stabilizing effect. The computing system applies the second transformation to the second frame to stabilize the second frame, where the stabilizing effect has been reduced based on the determined amount by which to reduce the stabilizing effect.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: April 20, 2021
    Assignee: Google LLC
    Inventors: Wei Hong, Rodrigo Carceroni
  • Patent number: 10964033
    Abstract: A visual tracker may track an object by identifying the object in a frame, and the visual tracker by identify the object in the frame within a search region. The search region may be provided by a motion modeling system that independently models the motion of the object and models the motion of the camera. For example, an object motion model of the motion modeling system may first model the motion of the object, assuming the camera is not in motion, in order to identify the expected position of the object. A camera motion model of the motion modeling system may then update the expected position of the object, obtained from the object motion model, based on the motion of the camera.
    Type: Grant
    Filed: August 7, 2018
    Date of Patent: March 30, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Amirhossein Habibian, Daniel Hendricus Franciscus Dijkman, Antonio Leonardo Rodriguez Lopez, Yue Hei Ng, Koen Erik Adriaan Van De Sande, Cornelis Gerardus Maria Snoek
  • Patent number: 10939138
    Abstract: A quantized subset of set of image data is obtained. One or more iterations of inverse quantization are performed on the quantized subset until a de-quantized subset is produced that meets specified criteria. A block of an image frame is determined based at least in part on the de-quantized subset. The block is stored in a region of the memory allocated for storage of the block. A set of blocks that includes the block is output from the memory.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: March 2, 2021
    Assignee: Vulcan Inc.
    Inventor: Michael Persiantsev
  • Patent number: 10931963
    Abstract: Aspects of the disclosure provide methods and a decoder device for video decoding. In some embodiments, the decoder device for video decoding includes processing circuitry. The processing circuitry selects a motion vector of a neighboring sub-block that is a neighbor of a current block under reconstruction. The current block is in a coded picture that is a part of a coded video bitstream. The processing circuitry determines, from the motion vector, motion vector predictors for a plurality of sub-blocks included in the current block. The neighboring sub-block and the plurality of sub-blocks are in a first one of a single row and a single column of the coded picture.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: February 23, 2021
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Shan Liu, Stephan Wenger
  • Patent number: 10931946
    Abstract: When carrying out an average prediction, an intra predictor carries out a filtering process on target pixels of the intra prediction located at an upper end and a left end of the block, the filtering process using an intermediate prediction value, which is an average value of adjacent pixels of the block, and at least one adjacent pixel of the target pixel. The intra predictor also sets a filter coefficient to ¾, associated with the intermediate prediction value for a target pixel at the left end of the block other than the target pixel at an upper left corner of the block, and sets a filter coefficient to ¼, associated with the adjacent pixel adjacent to the left side of the target pixel at the left end of the block. As a result, prediction errors locally occurring can be reduced, and the image quality can be improved.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: February 23, 2021
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Akira Minezawa, Kazuo Sugimoto, Shunichi Sekiguchi
  • Patent number: 10911772
    Abstract: The present invention relates to an image processing device and method, which realize improvement in encoding efficiency for color difference signals and reduction in address calculations for memory access. In a case where a block size of orthogonal transform is 4×4, and a macroblock of luminance signals is configured of four 4×4 pixel blocks appended with 0 through 1, the four luminance signal blocks are corresponded with one color difference signal 4×4 block appended with C. At this time, there exist four motion vector information of mv0, mv1, mv2, and mv3, as to the four luminance signal blocks. The motion vector information mvc of the one color difference signal 4×4 block is calculated by averaging processing using these four motion vector information. The present invention can be applied to an image encoding device which performed encoding based on the H.264/AVC format, for example.
    Type: Grant
    Filed: March 7, 2018
    Date of Patent: February 2, 2021
    Assignee: Velos Media, LLC
    Inventor: Kazushi Sato
  • Patent number: 10893283
    Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: January 12, 2021
    Assignee: Google LLC
    Inventors: Jing Chen, Marco Paniconi, Michael Horowitz
  • Patent number: 10885690
    Abstract: An image processing apparatus includes a memory that stores instructions, and a processor in communication with the memory. The processor executes the instructions to set a plurality of image sets according to a predetermined rule using a plurality of images obtained by continuous photography, to generate a first conversion coefficient corresponding to a moving amount of an object between images in each of the plurality of image sets, and to generate a second conversion coefficient used for an alignment process of a base image and a correction target image other than the base image by using a plurality of first conversion coefficients. The base image and the correction target image are included in the plurality of images.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: January 5, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hironori Kaida
  • Patent number: 10868850
    Abstract: A method and an apparatus of providing content using a web-based virtual desktop protocol are provided. The method of providing content by the apparatus of using a web-based virtual desktop protocol includes monitoring a network status of a client, adjusting encoding quality of content based on the network status of the client, and providing the content of the adjusted encoding quality to the client, wherein the content of the adjusted encoding quality is applied through a web browser of the client.
    Type: Grant
    Filed: December 15, 2016
    Date of Patent: December 15, 2020
    Assignee: UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY
    Inventors: Eui Nam Huh, Ja Hun Ku
  • Patent number: 10848782
    Abstract: Aspects of the disclosure provide methods and apparatuses for video coding. In some examples, an apparatus includes processing circuitry that stores reconstructed samples of a reconstructed block in a memory. When a current sub-block in a current block is to be reconstructed using intra block copy (IBC) based on a reference sub-block in the reconstructed block, the processing circuitry determines whether the reconstructed samples of the reference sub-block stored in the memory are indicated as overwritten based on a position of the current sub-block, generates reconstructed samples of the current sub-block based on the reconstructed samples of the reference sub-block when the reconstructed samples of the reference sub-block stored in the memory are determined to be indicated as not overwritten, and overwrites the reconstructed samples of a collocated sub-block in the reconstructed block stored in the memory with the generated reconstructed samples of the current sub-block.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: November 24, 2020
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 10848770
    Abstract: An information processing apparatus includes a memory and a processor which changes a frame rate in a period of moving picture data to a first set value of the frame rate, codes respective pictures in the period to obtain a code amount according to the first set value, calculates a cumulative value of a code amount of each kind of pictures different in applicable coding processing regarding the respective pictures included in the period, calculates a ratio of the cumulative value, estimates a change tendency of a difficulty level of coding of respective pictures in a next period after the period based on transition of the frame rate and transition of the ratio of the cumulative value, and obtains a second set value of the frame rate and a third set value of a bit rate applied to the next period according to the change tendency of the difficulty level.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: November 24, 2020
    Assignee: FUJITSU LIMITED
    Inventor: Tomonori Kubota
  • Patent number: 10848771
    Abstract: An apparatus and a method for encoding a video signal. A segment of a reference frame and an extension region generated from another segment are used for encoding a current frame by inter-prediction. An apparatus and a method for decoding are also disclosed.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: November 24, 2020
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Johannes Sauer, Mathias Wien
  • Patent number: 10848764
    Abstract: There is provided a terminal device capable of efficiently performing communication in a communication system in which a base station device and the terminal device communicate with each other. The terminal device that communicates with the base station device by using a plurality of aggregated cells recognizes that a serving cell is stopped in a first state, recognizes that the serving cell is started in a second state, and switches from the first state to the second state based on a received PDCCH.
    Type: Grant
    Filed: October 8, 2019
    Date of Patent: November 24, 2020
    Assignee: Velos Media, LLC
    Inventors: Tomohiro Ikai, Takeshi Tsukuba
  • Patent number: 10832424
    Abstract: A displacement field relating positions of pixels between at least two images having an initial displacement field is adjusted. Each pixel of the first image and the second image is associated with a label. A first pixel in the first image maps to a second pixel in the second image based on a vector of the initial displacement field. A set of third pixels includes the second pixel and a plurality of adjacent pixels to the second pixel, the third pixels being associated with labels and a candidate shift vector with respect to the second pixel. A covariance score is determined for each of the third pixels, the covariance score defining a statistical dependence between the first label of the first pixel and each of the third labels. An adjustment shift vector is then determined based on the covariance scores and the candidate shift vectors of the third pixels.
    Type: Grant
    Filed: November 22, 2017
    Date of Patent: November 10, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Peter Alleine Fletcher, Andrew Docherty, Tatiana Dudina
  • Patent number: 10817996
    Abstract: A method of combining content from multiple frames with overlapping field of views is described. The method comprises identifying corresponding blocks between a first frame and a second frame of an image; and determining whether to replace at least a portion of the first frame with a corresponding portion of the second frame based on whether there is a match between the first frame and the second frame.
    Type: Grant
    Filed: July 16, 2018
    Date of Patent: October 27, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ibrahim E. Pekkucuksen, Hamid Rahim Sheikh, John E. Glotzbach, Ruiwen Zhen
  • Patent number: 10805617
    Abstract: A method for encoding a video sequence is provided that includes signaling in the compressed bit stream that a subset of a plurality of partitioning modes is used for inter-prediction of a portion of the video sequence, using only the subset of partitioning modes for prediction of the portion of the video sequence, and entropy encoding partitioning mode syntax elements corresponding to the portion of the video sequence, wherein at least one partitioning mode syntax element is binarized according to a pre-determined binarization corresponding to the subset of partitioning modes, wherein the pre-determined binarization differs from a pre-determined binarization for the least one partitioning mode syntax element that would be used if the plurality of partitioning modes is used for inter-prediction.
    Type: Grant
    Filed: January 21, 2013
    Date of Patent: October 13, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Minhua Zhou
  • Patent number: 10805611
    Abstract: A method and apparatus for video encoding or decoding used by a video encoder or decoder respectively. In one method, input data associated with a video sequence are received. A current sequence header for a current picture is determined. Whether the current sequence header corresponds to a first sequence header or a second sequence header is determined. If the current sequence header corresponds to the second sequence header, one or more syntax values of a syntax set associated with the first sequence header are assigned to corresponding one or more syntax values of the syntax set associated with the current sequence header. The current picture is then encoded or decoded according to the current sequence header.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: October 13, 2020
    Assignee: MediaTek Inc.
    Inventors: Min-Hao Chiu, Hsiu-Yi Lin, Chia-yun Cheng, Chih-Ming Wang, Yung-Chang Chang
  • Patent number: 10798407
    Abstract: A method and apparatus for controlling a motion vector buffer for encoding or decoding of a video sequence includes identifying a set of motion vectors associated with an above coding tree unit (CTU), wherein each motion vector is associated with a P×Q grid, and the set of motion vectors is associated with an N×M grid. A motion vector is determined based on the set of motion vectors. The motion vector, in the motion vector buffer, is accessed based on a candidate block including a position associated with the N×M grid. A current CU can search from each 4×4 position for a current block. When the search range is beyond the current CTU, the motion vector (MV) data from the last row of the above CTU is used.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: October 6, 2020
    Assignee: TENCENT AMERICA LLC
    Inventors: Jing Ye, Xiang Li, Shan Liu, Xiaozhong Xu, Guichun Li
  • Patent number: 10798412
    Abstract: Encoding and decoding architectures for 3D video delivery are described, such as 2D compatible 3D video delivery and frame compatible 3D video delivery. The architectures include pre-processing stages to pre-process the output of a base layer video encoder and/or decoder and input the pre-processed output into an enhancement layer video encoder and/or decoder of one or more enhancement layers. Multiplexing methods of how to combine the base and enhancement layer videos are also described.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: October 6, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Alexandros Tourapis, Peshala V. Pahalawatta, Athanasios Leontaris, Kevin J. Stec, Walter J. Husak
  • Patent number: 10782251
    Abstract: A radiation imaging apparatus includes a pixel array in which a plurality of pixels are arrayed and a processing unit configured to process pixel signals non-destructively read out from the respective pixels. The processing unit performs a first process of obtaining image data of a plurality of frames by repeatedly reading out image data while the pixel array is irradiated with radiation, with a group of pixel signals from the plurality of pixels corresponding to image data of one frame, and a second process of generating data for a radiation image based on data differences between the image data of the plurality of frames.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: September 22, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Sho Sato, Atsushi Iwashita, Kosuke Terui, Yoshiaki Ishii
  • Patent number: 10771816
    Abstract: A method for decoding video includes creating a first list of motion vectors from at least one neighboring block in a current frame of the video and creating a second list of motion vectors from at least one previous block in a temporally earlier frame of the video. A third list of motion vectors is created based upon the first list and the second list. Based upon receiving a motion vector competition control parameter selecting one of the motion vectors from the third list, wherein the second list of motion vectors is further based upon a flooring function.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: September 8, 2020
    Assignee: Velos Media, LLC
    Inventor: Christopher A. Segall
  • Patent number: 10740431
    Abstract: An apparatus and method of five dimensional (5D) video stabilization with camera and gyroscope fusion. According to one embodiment, an apparatus includes a feature matcher configured to receive an image sequence and determine feature pairs in the image sequence; a residual two-dimensional (2D) translation estimator connected to the feature matcher and configured to determine a raw 2D translation path; a residual 2D translation smoother connected to the residual 2D translation estimator and configured to determine a 2D smoothed translation path; a distortion calculator connected to the residual 2D translation estimator and the residual 2D translation smoother and configured to determine a distortion grid; and a distortion compensator connected to the distortion calculator and configured to compensate for distortion in the image sequence.
    Type: Grant
    Filed: June 22, 2018
    Date of Patent: August 11, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Binnan Zhuang, Dongwoon Bai, Jungwon Lee
  • Patent number: 10706110
    Abstract: Described in detail herein are systems and methods a data repository for an Electronic Document Interchange (EDI) system. A data repository management system can receive from a party system, at least one EDI document type, information associated with the third party system, a first set of data requests and a first set of data responses. The data repository management system can be operatively coupled to a data repository including a master self-referential table defining a hierarchy for the data repository. The data repository can further include a child table, a first sub-child table and a second sub-child table. The data repository management system can generate a rows in the master self-relational table, child table, first sub-child table and second sub-child table to store the information associated with the third party system and an associated EDI document.
    Type: Grant
    Filed: June 22, 2018
    Date of Patent: July 7, 2020
    Assignee: Walmart Apollo, LLC
    Inventors: Jason Paul McCrory, Ted Sherrill
  • Patent number: 10701387
    Abstract: A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.
    Type: Grant
    Filed: April 25, 2019
    Date of Patent: June 30, 2020
    Assignee: Imagination Technologies Limited
    Inventor: Steven Fishwick
  • Patent number: 10694181
    Abstract: An example method of filtering a reconstructed block of video data includes obtaining, by one or more processors, reconstructed samples of a current block of the video data; and selectively bilaterally filtering, by the one or more processors, the reconstructed samples of the current block to generate a filtered current block. In this example, selectively bilaterally filtering the reconstructed samples of the current block comprises refraining from bilaterally filtering at least one reconstructed sample of the current block such that the filtered current block includes at least one non-bilaterally filtered sample.
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: June 23, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Li Zhang, Jianle Chen, Wei-Jung Chien, Marta Karczewicz
  • Patent number: 10656657
    Abstract: Systems and methods for predicting object motion and controlling autonomous vehicles are provided. In one example embodiment, a computer implemented method includes obtaining state data indicative of at least a current or a past state of an object that is within a surrounding environment of an autonomous vehicle. The method includes obtaining data associated with a geographic area in which the object is located. The method includes generating a combined data set associated with the object based at least in part on a fusion of the state data and the data associated with the geographic area in which the object is located. The method includes obtaining data indicative of a machine-learned model. The method includes inputting the combined data set into the machine-learned model. The method includes receiving an output from the machine-learned model. The output can be indicative of a predicted trajectory of the object.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: May 19, 2020
    Assignee: UATC, LLC
    Inventors: Nemanja Djuric, Vladan Radosavljevic, Thi Duong Nguyen, Tsung-Han Lin, Jeff Schneider
  • Patent number: 10638093
    Abstract: A wireless field device for use in an industrial process control or monitoring system includes a controller configured to control operation of the wireless field device. Wireless communication circuitry is configured to wirelessly communicate with a remote location. An internal power source powers the wireless field device. An image capture device is coupled to the controller and configured to capture an image of an environment of the wireless field device. The controller is adapted to receive image information from the image capture device and transmit compressed image information to the remote location.
    Type: Grant
    Filed: September 26, 2013
    Date of Patent: April 28, 2020
    Assignee: ROSEMOUNT INC.
    Inventors: Eric Darrell Rotvold, Chad Michael McGuire, Robert J. Karschnia, Robert Martin Beckmann
  • Patent number: 10631005
    Abstract: A system and method for coding a block of video data in block prediction mode for display stream compression (DSC) is disclosed. In one aspect, the method includes determining a candidate block to be used for predicting a current block in a current slice. The candidate block may be within a range of locations defined by one or more block prediction parameters. The method further includes determining, based on the candidate block and the current block, a prediction vector identifying a location of the candidate block with respect to the current block, and coding the current block in block prediction mode at least in part via signaling the prediction vector identifying the location of the candidate block with respect to the current block.
    Type: Grant
    Filed: April 20, 2015
    Date of Patent: April 21, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Natan Haim Jacobson, Vijayaraghavan Thirumalai, Rajan Laxman Joshi, Min Dai
  • Patent number: 10572004
    Abstract: A head mounted display device includes a head mounted display panel, a motion tracker which tracks a movement of the head mounted display panel according to a head movement of a user and outputs sensing data, an image corrector which shifts and outputs entire image data based on the sensing data when the head mounted display panel rotates, a data driver which converts the entire image data output from the image corrector into a data signal and provides the data signal to the head mounted display panel, and a scan driver which provides a scan signal to the head mounted display panel.
    Type: Grant
    Filed: January 3, 2018
    Date of Patent: February 25, 2020
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventors: Seongkyun Kim, Jonggil Kim
  • Patent number: 10553004
    Abstract: An image processing method and an apparatus are provided. The image processing method includes acquiring first image data including a plurality of target pixels, acquiring synthesis information by which a relationship, between each of the plurality of target pixels included in the first image data and at least one background pixel included in different image data to be synthesized with the first image data, is determined, and synthesizing a target pixel of the first image data with the at least one background pixel of second image data, based on the synthesis information according to determination of the second image data. The second image data includes the different image data to be synthesized with the first image data.
    Type: Grant
    Filed: January 12, 2017
    Date of Patent: February 4, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Piotr Henryk Dabrowski
  • Patent number: 10536711
    Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: January 14, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Olli Hallapuro, Kemal Ugur, Jani Lainema
  • Patent number: 10523957
    Abstract: Systems, methods, and instrumentalities are disclosed for encoder and/or decoder optimization using a multi-threaded parallel processing framework. An encoding and/or decoding device may receive a video sequence that includes a plurality of first-temporal level pictures associated with a first temporal level and a plurality of second-temporal level pictures associated with a second temporal level. The encoding and/or decoding device may allocate a first number of parallel processing threads for encoding and/or decoding the first-temporal level pictures and a second number of parallel processing threads for encoding and/or decoding the second-temporal level pictures. The device may perform this allocation based on temporal level priority, for example. The encoding and/or decoding device may encode and/or decode the first-temporal level pictures and the second-temporal level pictures.
    Type: Grant
    Filed: August 10, 2015
    Date of Patent: December 31, 2019
    Assignee: VID SCALE, Inc.
    Inventors: Srinivas Gudumasu, Yuwen He, Yan Ye, Ralph Neff
  • Patent number: RE48035
    Abstract: A motion vector coding unit 117 executes processing including a neighboring block specification step (S100) of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step (Steps S102, S104) of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step (S106, S108) of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step (S110) of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: June 2, 2020
    Assignee: Dolby International AB
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe