Abstract: A method of video processing is provided to include determining, for a conversion between a current video block of a video and a coded representation of the video, a mode of operation of an UMVE mode; and performing the conversion based on the determining, wherein the current video block is coded with a merge mode and motion vector differences in an UMVE mode that comprises a motion vector expression that includes a starting point of motion information, a motion magnitude and a motion direction for the current video block, and wherein one or more fields in the coded representation correspond to the mode of operation, and wherein the one or more fields include: a list size field that indicates a size of a base candidate list used by the UMVE mode, or a table field that signals a distance table or a direction table for the UMVE mode.
Type:
Grant
Filed:
January 21, 2021
Date of Patent:
September 21, 2021
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
Abstract: Examples are provided for apparatus and methods for video encoding and decoding. An encoder apparatus for encoding a picture into a data stream is configured to: subject a transform of a block of the picture to quantization to obtain a quantized transform; determine a zero-quantized portion of the quantized transform; determine at least one noise parameter providing noise information on the transform within the zero-quantized portion; signal the quantized transform and the at least one parameter.
Type:
Grant
Filed:
August 24, 2020
Date of Patent:
September 14, 2021
Assignee:
FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Inventors:
Christian Helmrich, Paul Keydel, Sebastian Bosse
Abstract: A system for transmitting commands and a video stream between a remote controlled machine such as a drone and a ground station comprises a two-way link between the machine and ground station, at least partially implementing a cellular communication network, said two-way link being provided by means of a cellular modem on the machine side and conveying a compressed video stream produced by a camera and a video encoding module, and information belonging to a group comprising movement control commands and flight data or operating characteristics of the remote controlled machine, the system further comprising means for managing the two-way link capable of ensuring said link is maintained, taking into account the variability in topology and performances of the link resulting from the implementation of the cellular communication network. Application to long-range drones.
Abstract: The present principles relates to a method and device 1. A method for encoding a residual block comprising: —obtaining (500) a first coding mode relative to a first 2D transform when coding the residual blocks according a coding mode relative to a first 2D transform is enabled; —obtaining (510) a second coding mode relative to a second 2D transform when coding the residual blocks according to a coding mode relative to a second 2D transform is enabled; and —encoding (530) the residual block according to either said first coding mode or said second coding mode or both; the method is characterized in that enabling or disabling (520) the coding of the residual block according to said second coding mode depends on said first coding mode. The present principles relates also to a method and device for encoding/decoding a picture.
Abstract: A monitoring project is defined interactively through an interface. Resources needed for the project are obtained, configured, arranged, and verified within a target area. Video and audio feeds are captured and analyzed during a project period within the target area and customer interactions and intentions are derived from detected customer behaviors within the feeds. The intentions and behaviors are indexed with aggregated metrics within a data store. The interface provides custom queries, reports, interactive graphics, and real-time notifications from the data store that depict the custom aggregated metrics for the intentions and behaviors of the monitoring project.
Type:
Grant
Filed:
July 29, 2019
Date of Patent:
August 31, 2021
Assignee:
NCR Corporation
Inventors:
Matthew Robert Burris, Jodessiah Sumpter
Abstract: A coding device and a decoding device are configured to include an estimated prediction mode deciding section (122a) including: a reference block selecting section (1223a) for selecting a reference block for use in estimating an intra-prediction mode for a subject block; an estimating number deciding section (1222a) for deciding an estimating number of estimated values to be estimated for the intra-prediction mode; and an estimated prediction mode deriving section (1221a) for estimating, based on a reference block, the estimating number of estimated values of the prediction mode.
Abstract: A processing system analyzes pixel activity levels of blocks of a picture at a plurality of spatial scales and/or dynamic ranges to generate a multi-scale metric that indicates how bit allocation or assignment of a given quantization parameter (QP) will affect the perceptual quality of the block. Blocks that have similar multi-scale metrics are likely to be visually similar and to benefit from similar bit allocations or QPs. Based on the multi-scale metric, an encoder encodes each block of the picture with a QP and/or a number of bits.
Type:
Grant
Filed:
May 31, 2019
Date of Patent:
August 24, 2021
Assignee:
ATI TECHNOLOGIES ULC
Inventors:
Boris Ivanovic, Mehdi Saeedi, Edward G. Callway
Abstract: A method of partitioning a coding unit (CU) into one or more transform units (TUs) for encoding a video sequence using at least one processor includes determining a height of the CU; determining a width of the CU; determining a TU size of each of the one or more TUs based on the height of the CU and the width of the CU; determining one or more TU positions of the one or more TUs based on the height of the CU and the width of the CU; and partitioning the CU into the one or more TUs based on the determined size of the one or more TUs and the one or more positions of the one or more TUs.
Type:
Grant
Filed:
November 25, 2019
Date of Patent:
August 24, 2021
Assignee:
TENCENT AMERICA LLC
Inventors:
Xin Zhao, Liang Zhao, Xiang Li, Shan Liu
Abstract: In this patent, a method and apparatus for improving analysis of a 3D printed object is provided. A first portion of a 3D dataset is selected for 3D printing. The 3D dataset is geo-registered to the 3D printed object. A second portion of the 3D dataset is displayed on a head display unit (HDU). Additional advanced features are discussed herein. An example would be performing 3D printing of a heart from a CT scan and displaying the aorta and inferior vena cave on the HDU geo-registered to the 3D printed heart.
Abstract: Disclosed are an encoding device and a decoding device, which include a CNN-based in-loop filter. The encoding device according to one embodiment comprises: a filtering unit for generating filtering information by filtering a residual image corresponding to a difference between an original image and a prediction image; an inverse filtering unit for generating inverse filtering information by inversely filtering the filtering information; a prediction unit for generating the prediction image on the basis of the original image and reconstruction information; a CNN-based in-loop filter for receiving the inverse filtering information and the prediction image so as to output the reconstruction information; and an encoding unit for performing encoding on the basis of the filtering information and information of the prediction image.
Type:
Grant
Filed:
February 13, 2017
Date of Patent:
August 17, 2021
Assignee:
KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Abstract: Systems and methods are described for capturing images of articles under test and processing the images to automatically detect the failure of a test article. The described methods include optimizing image capture to allow for the use of low cost imaging devices instead of high speed cameras or other expensive equipment. The described methods also include several methods for processing the images to identify the occurrence of a failure event.
Type:
Grant
Filed:
June 11, 2019
Date of Patent:
August 10, 2021
Assignee:
DYNATEK LABS, INC.
Inventors:
Mark Alan Schultz, Donald John Rohde, Christopher Conti
Abstract: A method of video processing is provided to include determining, for a conversion between a current video block of a video and a coded representation of the video, a mode of operation of an UMVE mode; and performing the conversion based on the determining, wherein the current video block is coded with a merge mode and motion vector differences in an UMVE mode that comprises a motion vector expression that includes a starting point of motion information, a motion magnitude and a motion direction for the current video block, and wherein one or more fields in the coded representation correspond to the mode of operation, and wherein the one or more fields include: a list size field that indicates a size of a base candidate list used by the UMVE mode, or a table field that signals a distance table or a direction table for the UMVE mode.
Type:
Grant
Filed:
January 21, 2021
Date of Patent:
August 10, 2021
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
Abstract: Video signal coding and decoding functions can generate lists of potential candidates to use in coding and decoding, for example, predictors. Video signal coding component candidates undergo operations before potential inclusion in candidate lists. The candidates are checked after being modified by the operations to see if other equal candidates are already in the candidate are added to the candidate list. If equal candidates are already in the list, the modified candidates are not added to the list. Operations that can be performed comprise rounding and clipping.
Type:
Grant
Filed:
May 30, 2018
Date of Patent:
August 10, 2021
Assignee:
INTERDIGITAL VC HOLDINGS, INC.
Inventors:
Fabien Racape, Franck Galpin, Antoine Robert
Abstract: A method for decoding a video according to the present invention, may comprise determining whether bi-directional intra prediction is applied to a current block, deriving a reference sample of the current block, and when the bi-directional intra prediction is applied to the current block, based on a first reference sample and a second reference sample specified by an intra prediction mode of the current block, obtaining a prediction sample of the current block.
Abstract: An image display method includes acquiring an aerial image captured during flight of a flying object, acquiring a first image based on the aerial image, acquiring image position information of the flying object corresponding to an image position in a horizontal direction of the flying object in the first image, superimposing related information of the flying object at the image position in the first image to generate a second image, and displaying the second image.
Abstract: Disclosed herein includes a system, a method, and a device for reducing latency and jitter by reserving a transmission duration for a transmit opportunity. A device can compress a first slice of a plurality of slices of a video frame to obtain a size of the first slice after compression. The device can estimate a size of the video frame after compression, according to the size of the first slice after compression. The device can generate a request to send (RTS) to reserve, a transmission channel for a transmission duration corresponding to the size of the video frame after compression. The device can broadcast the RTS to one or more other devices.
Type:
Grant
Filed:
September 9, 2019
Date of Patent:
July 27, 2021
Assignee:
Facebook Technologies, LLC
Inventors:
Behnam Bastani, Xiaoguang Wang, Gang Lu
Abstract: A method of decoding a bitstream by an electronic device is provided. An image frame is received from the bitstream. A block unit is determined from the received image frame. A plurality of model parameters is derived based on motion information of a plurality of neighboring blocks neighboring the block unit. An intermediate block is derived for a sub-block in the block unit based on the plurality of model parameters. A vector formula is determined based on the plurality of model parameters, and at least one vector value is calculated based on the vector formula for at least one sampling position in the sub-block. The at least one vector value is compared with a threshold to determine whether the intermediate block is adjusted based on the vector formula to generate a predicted block. The sub-block is reconstructed based on the predicted block.
Abstract: A method for processing a video includes performing a determination, by a processor, that a first video block is partitioned to include a first prediction portion that is non-rectangular and non-square; adding a first motion vector (MV) prediction candidate associated with the first prediction portion to a motion candidate list associated with the first video block, wherein the first MV prediction candidate is derived from a sub-block MV prediction candidate; and performing further processing of the first video block using the motion candidate list.
Type:
Grant
Filed:
September 24, 2020
Date of Patent:
July 20, 2021
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
Abstract: An in-vehicle device includes a first in-vehicle camera configured to capture a subject in the cabin of a vehicle to create a first captured image, a second in-vehicle camera configured to capture an outside scene to create a second captured image, an image processing unit configured to create, from the first and second captured images, a composite image in which the subject is arranged with the outside scene as a background, and a first communication unit configured to send the composite image.
Abstract: Provided is an encoder which includes circuitry and memory. Using the memory, the circuitry splits an image block into a plurality of partitions, obtains a prediction image for a partition, and encodes the image block using the prediction image. When the partition is not a non-rectangular partition, the circuitry obtains (i) a first prediction image for the partition using a first motion vector for the partition, (ii) a second motion vector for the partition using the first prediction image, and (iii) a second prediction image for the partition as the prediction image using the second motion vector. When the partition is a non-rectangular partition, the circuitry obtains the first prediction image as the prediction image using the first motion vector, without using the second motion vector.
Type:
Grant
Filed:
July 29, 2020
Date of Patent:
June 22, 2021
Assignee:
Panasonic Intellectual Property Corporation of America
Inventors:
Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Ryuichi Kanoh, Chong Soon Lim, Ru Ling Liao, Hai Wei Sun, Sughosh Pavan Shashidhar, Han Boon Teo, Jing Ya Li