Abstract: An example device for decoding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: apply a downsampling convolutional neural network layer to a first color component of a block of video data, the first color component of the block having a first size, wherein applying the downsampling convolutional neural network layer to the first color component generates a downsampled first color component having a second size smaller than the first size; filter a second color component having the second size to form a filtered second color component; concatenate the downsampled first color component with the filtered second color component to form concatenated color components; and filter the concatenated color components to form a filtered concatenated component including a filtered downsampled first color component.

Abstract: Techniques for context-adaptive binary arithmetic coding (CABAC) coding with a reduced number of context coded and/or bypass coded bins are provided. Rather than using only truncated unary binarization for the syntax element representing the delta quantization parameter and context coding all of the resulting bins as in the prior art, a different binarization is used and only part of the resulting bins are context coded, thus reducing the worst case number of context coded bins for this syntax element. Further, binarization techniques for the syntax element representing the remaining actual value of a transform coefficient are provided that restrict the maximum codeword length of this syntax element to 32 bits or less, thus reducing the number of bypass coded bins for this syntax element over the prior art.

Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.

Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure may comprise obtaining a reconstructed picture, determining a target boundary of deblocking filtering in the reconstructed picture, determining a boundary strength for the target boundary, and applying deblocking filtering to the target boundary based on the boundary strength. Based on the target boundary being a transform block boundary and a color component of the reconstructed picture being a chroma component, the boundary strength may be determined based on whether joint CbCr residual coding is performed on at least one of two blocks adjacent to the target boundary, and the joint CbCr residual coding may correspond to encoding residual samples for a chroma Cb component and a chroma Cr component as a single transform block.

Abstract: A backward reshaping mapping table is initially generated as an inverse of a forward reshaping mapping table. The backward reshaping mapping table is updated by replacing the content-mapped luminance codewords with forward reshaped luminance codewords generated by applying a luminance forward mapping to the sampled luminance codewords. The luminance forward mapping is constructed from the forward reshaping mapping table. The backward reshaping mapping table and the luminance forward mapping are used to generate backward reshaping mappings for creating a reconstructed image from a forward reshaped image. The forward reshaped image is encoded, in a video signal, along with image metadata specifying the backward reshaping mappings. A recipient device of the video signal applies the backward reshaping mappings to the forward reshaped image to create the reconstructed image of the second dynamic range.

Abstract: A method for video processing is provided to include: performing a conversion between a current video block of a video and a coded representation of current video block, wherein the conversion uses a coding mode in which the current video block is constructed based on a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner, and wherein information used for the coding mode is signaled in a parameter set that is different from a sequence parameter set (SPS), a video parameter set (VPS), a picture parameter set (PPS), or an adaptation parameter set (APS) used for carrying adaptive loop filtering (ALF) parameters.

Abstract: A system and method for capturing and processing aerial images of structures to assess structural damage is disclosed. The system comprises an aerial system associated with an aerial vehicle, which is in contact with a ground system. The aerial system is used to capture images of selected locations associated with known structures and crop those images around the selected locations. The cropped images are then fed into a damage classifier that automatically classifies the degree of damage done to structures at the selected locations. The system and method may be deployed to quickly assess damage of structures in a disaster area.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. For example, the processing circuitry generates first reconstructed samples of a block, and applies a filter to multiple color components of the first reconstructed samples of the block to determine offsets to be applied to one or more color components. Then, the processing circuitry generates second reconstructed samples of the block based on the offsets for the one or more color components and the first reconstructed samples of the block.

Abstract: A decoder includes circuitry configured to receive a bitstream, extract a header including a list of reference frames available for motion compensation, such as global motion compensation, determine, using the header, a motion model for a current block, the motion relative to a reference frame contained in the list of reference frames, and decode the current block using the motion model. Related apparatus, systems, techniques and articles are also described.

Abstract: A method for video bitstream processing includes generating, using a first video block derived from a third video block of a first component and having a first size, a prediction block for a second video block of a video related to a second component, where the first component is different from the second component, and where the second video block has a second size that is different from the first size. The method also includes performing, using the prediction block, a conversion between the second video block and a bitstream representation of the video according to a two-step cross-component prediction mode (TSCPM).

Abstract: A picture decoding method, performed by a decoding apparatus according to the present disclosure, comprises the steps of: when an intra-prediction mode of a chroma block is a cross-component linear model (CCLM) mode, deriving neighboring chroma reference samples with respect to the chroma block; deriving neighboring luma reference samples of a luma block corresponding to the chroma block and luma samples in the luma block; deriving down-sampled neighboring luma reference samples and downsampled luma samples by down sampling the neighboring luma reference samples and the luma samples, respectively; deriving a linear model parameter on the basis of the down-sampled neighboring luma reference samples and the neighboring chroma reference samples; generating prediction samples with respect to the chroma block on the basis of the linear model parameter and the down-sampled luma samples of the luma block; and reconstructing the chroma block on the basis of the prediction samples with respect to the chroma block.

Abstract: A method includes receiving a reference frame, determining, for a current block, a scaling constant; scaling a block of the reference frame according to the scaling constant, the block of the reference frame corresponding to the current block, and reconstructing pixel data of the current block and using the scaled block of the reference frame. Related apparatus, systems, techniques and articles are also described.

Abstract: A method of processing a first image in a first plurality of images, wherein the first image is divided into a plurality of pixel blocks, is proposed, which comprises, for a current block of the first image: selecting, in a set of a plurality of predefined interpolation filters, an interpolation filter based on a prediction of an interpolation filter determined by a supervised learning algorithm to which data related to the current block is input; and using the selected interpolation filter for calculating fractional pixel values in a second image of the plurality of images for a temporal prediction of pixels of the current block based on a reference block correlated to the current block in the second image, wherein the second image is distinct from the first image and was previously encoded according to an image encoding sequence for encoding the images of the plurality of images.

Abstract: A system and method are presented for combining visual recordings from a camera, audio recordings from a microphone, and behavioral data recordings from behavioral sensors, during a panel discussion. Cameras and other sensors can be assigned to specific individuals or can be used to create recordings from multiple individuals simultaneously. Separate recordings are combined and time synchronized, and portions of the synchronized data are then associated with the specific individuals in the panel discussion. Interactions between participants are determined by examining the individually assigned portions of the time synchronized recordings. Events are identified in the interactions and then recorded as separate event data associated with individuals.

Abstract: This invention provides an image encoding apparatus operable to encode RAW image data obtained from a capturing sensor that has a color filter array in which a plurality of filters for each of three primary colors and a plurality of filters for a specific color for luminance are arranged in an N×N pixel region, where the image encoding apparatus comprises a conversion unit which converts the RAW image data into a plurality of planes each configured by a single color component; and an encoding unit which encodes each of the planes, wherein the conversion unit, for each component representing the three primary colors, by referencing pixel values of the same component in the N×N pixel region, generates a plane configured by a low-frequency component data and a plane configured by a high-frequency component.

Abstract: Aspects of the disclosure provide a method, an apparatus, and non-transitory computer-readable storage medium for video decoding. The apparatus includes processing circuitry that is configured to decode a supplemental enhancement information (SEI) message that indicates independent region output information. The independent region output information indicates an independent region that is independently decodable in a current picture. The processing circuitry determines the independent region in the current picture based on offset information and dimension information of the independent region in the independent region output information. The processing circuitry decodes the determined independent region irrespective of whether the entire current picture is decoded. The processing circuitry outputs the decoded independent region based on a position indicated by the offset information and a size indicated by the dimension information of the independent region.

Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Abstract: According to an aspect of the disclosure, a method of video decoding performed in a video decoder is provided. In the method, syntax information of a coding unit (CU) is decoded from a coded video bitstream. The syntax information is signaled in a picture header (PH) and includes chroma quantization parameter (QP) offsets in a PH level. The chroma QP offsets include at least one of a Cb offset, a Cr offset, and a CbCr offset. Further, quantization parameters for the CU are determined based on the chroma QP offsets in the PH level and a quantization parameter range offset of the CU.

Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.

Abstract: A micromachined ultrasonic transducer (MUT). The MUT includes: a substrate; a membrane suspending from the substrate; a bottom electrode disposed on the membrane; a piezoelectric layer disposed on the bottom electrode and an asymmetric top electrode is disposed on the piezoelectric layer. The areal density distribution of the asymmetric electrode along an axis has a plurality of local maxima, wherein locations of the plurality of local maxima coincide with locations where a plurality of anti-nodal points at a vibrational resonance frequency is located.