Abstract: A method of processing a first image in a first plurality of images, wherein the first image is divided into a plurality of pixel blocks, is proposed, which comprises, for a current block of the first image: selecting, in a set of a plurality of predefined interpolation filters, an interpolation filter based on a prediction of an interpolation filter determined by a supervised learning algorithm to which data related to the current block is input; and using the selected interpolation filter for calculating fractional pixel values in a second image of the plurality of images for a temporal prediction of pixels of the current block based on a reference block correlated to the current block in the second image, wherein the second image is distinct from the first image and was previously encoded according to an image encoding sequence for encoding the images of the plurality of images.

Abstract: A system and method are presented for combining visual recordings from a camera, audio recordings from a microphone, and behavioral data recordings from behavioral sensors, during a panel discussion. Cameras and other sensors can be assigned to specific individuals or can be used to create recordings from multiple individuals simultaneously. Separate recordings are combined and time synchronized, and portions of the synchronized data are then associated with the specific individuals in the panel discussion. Interactions between participants are determined by examining the individually assigned portions of the time synchronized recordings. Events are identified in the interactions and then recorded as separate event data associated with individuals.

Abstract: This invention provides an image encoding apparatus operable to encode RAW image data obtained from a capturing sensor that has a color filter array in which a plurality of filters for each of three primary colors and a plurality of filters for a specific color for luminance are arranged in an N×N pixel region, where the image encoding apparatus comprises a conversion unit which converts the RAW image data into a plurality of planes each configured by a single color component; and an encoding unit which encodes each of the planes, wherein the conversion unit, for each component representing the three primary colors, by referencing pixel values of the same component in the N×N pixel region, generates a plane configured by a low-frequency component data and a plane configured by a high-frequency component.

Abstract: Aspects of the disclosure provide a method, an apparatus, and non-transitory computer-readable storage medium for video decoding. The apparatus includes processing circuitry that is configured to decode a supplemental enhancement information (SEI) message that indicates independent region output information. The independent region output information indicates an independent region that is independently decodable in a current picture. The processing circuitry determines the independent region in the current picture based on offset information and dimension information of the independent region in the independent region output information. The processing circuitry decodes the determined independent region irrespective of whether the entire current picture is decoded. The processing circuitry outputs the decoded independent region based on a position indicated by the offset information and a size indicated by the dimension information of the independent region.

Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Abstract: According to an aspect of the disclosure, a method of video decoding performed in a video decoder is provided. In the method, syntax information of a coding unit (CU) is decoded from a coded video bitstream. The syntax information is signaled in a picture header (PH) and includes chroma quantization parameter (QP) offsets in a PH level. The chroma QP offsets include at least one of a Cb offset, a Cr offset, and a CbCr offset. Further, quantization parameters for the CU are determined based on the chroma QP offsets in the PH level and a quantization parameter range offset of the CU.

Abstract: An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.

Abstract: A micromachined ultrasonic transducer (MUT). The MUT includes: a substrate; a membrane suspending from the substrate; a bottom electrode disposed on the membrane; a piezoelectric layer disposed on the bottom electrode and an asymmetric top electrode is disposed on the piezoelectric layer. The areal density distribution of the asymmetric electrode along an axis has a plurality of local maxima, wherein locations of the plurality of local maxima coincide with locations where a plurality of anti-nodal points at a vibrational resonance frequency is located.

Abstract: Innovations in signaling of reference picture list (“RPL”) modification information. For example, a video encoder evaluates a condition that depends at least in part on a variable indicating a number of total reference pictures. Depending on the results of the evaluation, the encoder signals in a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. A video decoder evaluates the condition and, depending on results of the evaluation, parses from a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. The condition can be evaluated as part of processing for an RPL modification structure that includes the flag, or as part of processing for a slice header. The encoder and decoder can also evaluate other conditions that affect syntax elements for list entries of the RPL modification information.

Abstract: The image decoding method includes determining a context for use in a current block to be processed, from among a plurality of contexts, wherein in the determining: the context is determined under a condition that control parameters of a left block and an upper block are used, when the signal type is a first type; and the context is determined under a third condition that the control parameter of the upper block is not used and a hierarchical depth of a data unit to which the control parameter of the current block belongs is used, when the signal type is a third type, and the third type is one or more of (i) “merge_flag”, (ii) “ref_idx_I0” or “ref_idx_I1”, (iii) “inter_pred_flag”, (iv) “mvd_I0” or “mvd_I1”, (v) “intra_chroma_pred_mode”, (vi) “cbf_luma”, and (vii) “cbf_cb” or “cbf_cr”.

Abstract: Innovations in signaling of reference picture list (“RPL”) modification information. For example, a video encoder evaluates a condition that depends at least in part on a variable indicating a number of total reference pictures. Depending on the results of the evaluation, the encoder signals in a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. A video decoder evaluates the condition and, depending on results of the evaluation, parses from a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. The condition can be evaluated as part of processing for an RPL modification structure that includes the flag, or as part of processing for a slice header. The encoder and decoder can also evaluate other conditions that affect syntax elements for list entries of the RPL modification information.

Abstract: Innovations in signaling of reference picture list (“RPL”) modification information. For example, a video encoder evaluates a condition that depends at least in part on a variable indicating a number of total reference pictures. Depending on the results of the evaluation, the encoder signals in a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. A video decoder evaluates the condition and, depending on results of the evaluation, parses from a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. The condition can be evaluated as part of processing for an RPL modification structure that includes the flag, or as part of processing for a slice header. The encoder and decoder can also evaluate other conditions that affect syntax elements for list entries of the RPL modification information.

Abstract: Method and apparatus for constrained de-blocking filter are disclosed. One method receives input data related to a current block in a current picture at a video encoder side or a video bitstream determines a block boundary of the current block and sub-block boundaries inside the current block, wherein the current block is partitioned into a plurality of sub-blocks using sub-block mode prediction. The method then applies de-blocking process to a reconstructed current block corresponding to the current block to result in a current filtered-reconstructed block, wherein said applying the de-blocking process to the current block comprises applying the de-blocking process to the sub-block boundaries inside the current filtered-reconstructed block, and generates a filtered decoded picture including the current filtered-reconstructed block.

Abstract: Techniques for selectively transforming one or more coding units when coding video content are described herein. The techniques may include determining whether or not to transform a particular coding unit. The determination may be based on a difference in pixel values of the particular coding unit and/or one or more predefined rate-distortion constraints. When it is determined to not perform a transform, the particular coding unit may be coded without transforming the particular coding unit.

Abstract: Aspects of the disclosure provide methods, apparatuses, and a non-transitory computer-readable storage medium for video encoding and video decoding. An apparatus for video decoding can include processing circuitry. The processing circuitry is configured to decode neural network update information in a coded bitstream for at least one neural network in the video decoder. The at least one neural network is configured with a set of pretrained parameters, and the neural network update information indicates a first modification parameter. The processing circuitry is configured to update the set of pretrained parameters in the at least one neural network in the video decoder based on the first modification parameter. The processing circuitry is configured to decode an encoded image based on the updated at least one neural network.

Abstract: A method is provided to better detect a scene change to provide a prediction to an encoder to enable more efficient encoding. The method uses a Motion Compensated Temporal Filter (MCTF) that provides motion estimation and is located prior to an encoder. The MCTF provides a Motion Compensated Residual (MCR) used to detect the scene change transition. When a scene is relatively stable, the MCR score is also relatively stable. However, when a scene transition is in process, the MCR score behavior changes, Algorithmically, the MCR score is used by comparing the sliding mean of the MCR score to the sliding median. This comparison highlights the transition points. In the case of a scene cut, the MCR score exhibits a distinct spike. In the case of a fade or dissolve, the MCR score exhibits a transitional period of degradation followed by recovery. By implementing the above detection using the MCR, the location of the I-pictures in the downstream encoding process can be accurately determined for the encoder.

Abstract: Aspects of the disclosure provide methods and apparatuses for filtering in video encoding/decoding. In some examples, an apparatus for video filtering includes processing circuitry. The processing circuitry determines a first offset value for applying a non linear mapping based filter based on first reconstructed samples at a first node in a loop filter chain. Then, the processing circuitry applies the first offset value to an intermediate reconstructed sample at a second node along the loop filter chain to generate a second reconstructed sample.

Abstract: A device may be configured to apply adaptive loop filters according to one or more of the techniques described herein.

Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry decodes, from a coded video bitstream, a first syntax element indicating whether a first component in the coded video bitstream is coded based on a second component in the coded video bitstream. The processing circuitry determines whether to decode one or more second syntax elements for a chroma related coding tool based on the first syntax element. The chroma related coding tool is a luma mapping with chroma scaling coding tool or a cross-component adaptive loop filter. The one or more second syntax elements are decoded when the first syntax element indicates that the first component is coded based on the second component. The one or more second syntax elements are not decoded when the first syntax element indicates that the first component is not coded based on the second component.

Abstract: Methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example video processing method includes performing a conversion between a video picture of a video and a bitstream of the video. A first syntax element in a first video unit level specifying a deblocking parameter offset for ? divided by 2 applied to a chroma component for one or more slices in a first video unit and a second syntax element in the first video unit level specifying a deblocking parameter offset for tC divided by 2 applied to the chroma component for the one or more slices in the first video unit are determined according to a rule in response to the first syntax element and the second syntax element not included in the bitstream.