Abstract: Methods and apparatus for intra prediction in video encoding and decoding using a composite reference array are described. In one exemplary embodiment, the composite reference array is formed from two or more reference arrays of a plurality of reference arrays. The composite reference array can be formed by projecting along a prediction direction, one or more of the plurality of reference arrays onto a reference array closest to the block of the video data being encoded or decoded. The filter coefficients for the interpolation filter are then determined based on the locations of the predictors on different reference arrays. Interpolating reference samples from different reference arrays, the predictor value for a target sample can be obtained.

Abstract: An encoder includes circuitry configured to receive a video frame, partition the video frame into a plurality of blocks, determine a respective spatial activity measure for each block in the plurality of blocks and using a transform matrix, encode the video frame using the spatial activity measure. Related apparatus, systems, techniques and articles are also described.

Abstract: Disclosed in the implementations of the present disclosure are a mapping method, an encoder, a decoder, and a computer storage medium. The method may include: determining an intra prediction mode used at the time of encoding or decoding a current block; mapping, if the intra prediction mode is a MIP mode, the MIP mode to a first non-MIP mode; and mapping, if the intra prediction mode is a non-MIP mode, the non-MIP mode to a second MIP mode.

Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus may comprise deriving a reconstructed block for a current block, deriving a target boundary for the reconstructed block, determining a filter length of a deblocking filter to be applied for the target boundary, and applying the deblocking filter for the target boundary based on the determined filter length. The filter length may be determined based on at least one of a width or height of a transform block adjacent to the target boundary.

Abstract: A method of partitioning a video coding block for JVET, comprising representing a JVET coding tree unit as a root node in a quadtree plus binary tree (QTBT) structure that can have a quadtree branching from the root node and binary trees branching from each of the quadtree's leaf nodes using asymmetric binary partitioning to split a coding unit represented by a quadtree leaf node into two child coding units of unequal size, representing the two child coding units as leaf nodes in a binary tree branching from the quadtree leaf node and coding the child coding units represented by leaf nodes of the binary tree with JVET, wherein further partitioning of child coding units split from quadtree leaf nodes via asymmetric binary partitioning is disallowed.

Abstract: Provided are methods for enhanced semantic labeling in mapping with a semantic labeling system, which can include receiving, from a LiDAR sensor of a vehicle, LiDAR point cloud information including at least one raw point feature for a point, receiving, from a camera of the vehicle, image data associated with an image captured using the camera, generating at least one rich point feature for the point based on the image data, predicting, using a LiDAR segmentation neural network and based on the at least one raw point feature and the at least one rich point feature, a point-level semantic label for the point, and providing the point-level semantic label to a mapping engine to generate a map based on the point-level semantic label Systems and computer program products are also provided.

Abstract: A method of filtering a sample value of a picture is provided, with an integer t that is less than k and with an integer j in the range of 1 to m: generating, with an integer i in the range of 1 to k?t?1, a filtered sample value by applying a filter to the value of the sample p(i,j), wherein the filter is supported by a set of filter support samples, the set of filter support samples does not comprise any samples p(i?,j?) with row index i? greater than k?t?1, and/or generating, with an integer i in the range of k?t to k, a filtered sample value by applying a filter to the value of the sample p(i,j), the filter is supported by a set of filter support samples, wherein the set of filter support samples does not comprise any samples p(i?,j?) with row index i? less than k?t.

Abstract: The disclosure relates to a method of decoding implemented by a decoding device, comprising: obtaining a value of a reference line index for a current block; constructing a most probable mode, MPM, list for the current block; obtaining a value of intra-prediction mode index for the current block; when the value of the reference line index is not equal to 0, obtaining an intra prediction mode of the current block according to the MPM list for the current block and the value of the intra-prediction mode index for the current block, wherein the value of the intra-prediction mode index indicates a position that corresponds to the intra prediction mode of the current block among angular intra-prediction modes in the MPM list. The disclosure also relates to a coding apparatus and a non-transitory machine-readable medium.

Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video coded using a combined inter and intra prediction (CIIP) coding technique and a bitstream representation of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.

Abstract: A method of partitioning a video coding block for JVET, comprising representing a JVET coding tree unit as a root node in a quadtree plus binary tree (QTBT) structure that can have a quadtree branching from the root node and binary trees branching from each of the quadtree's leaf nodes using asymmetric binary partitioning to split a coding unit represented by a quadtree leaf node into two child coding units of unequal size, representing the two child coding units as leaf nodes in a binary tree branching from the quadtree leaf node and coding the child coding units represented by leaf nodes of the binary tree with JVET, wherein further partitioning of child coding units split from quadtree leaf nodes via asymmetric binary partitioning is disallowed.

Abstract: An optical system includes an illumination module configured to illuminate a sample object with at least one angle-variable illumination geometry. The optical system includes an imaging optical unit configured to produce an imaged representation of the sample object that is illuminated with the at least one angle-variable illumination geometry on a detector. The optical system includes the detector, which is configured to capture at least one image of the sample object based on the imaged representation. The optical system includes a controller configured to determine a result image based on a transfer function and the at least one image. A method includes illuminating a sample object with at least one angle-variable illumination geometry, imaging the sample object on a detector, based on the imaged representation, capturing at least one image of the sample object, and, based on a transfer function and the at least one image, determining a result image.

Abstract: In a depth image compressing section of an image processing device, a depth image operation section generates a depth image by operation using photographed stereo images. A difference image obtaining section generates a difference image between an actually measured depth image and the computed depth image. In a depth image decompressing section of a content processing device, a depth image operation section generates a depth image by operation using the transmitted stereo images. A difference image adding section restores a depth image by adding the computed depth image to the transmitted difference image.

Abstract: Disclosed in the implementations of the present disclosure are a mapping method, an encoder, a decoder, and a computer storage medium. The method may include: determining an intra prediction mode used at the time of encoding or decoding a current block; mapping, if the intra prediction mode is a MIP mode, the MIP mode to a first non-MIP mode; and mapping, if the intra prediction mode is a non-MIP mode, the non-MIP mode to a second MIP mode.

Abstract: An apparatus includes a sensor configured to capture an image of an affected part, and a processor configured to obtain information about a size of the affected part in the captured image, and control timing to capture an image of the affected part or control timing to prompt a user to perform an imaging operation based on the information about the size of the affected part.

Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video coded using a combined inter and intra prediction (CIIP) coding technique and a bitstream representation of the video, an intra-prediction mode of the current block independently from an intra-prediction mode of a neighboring block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. An apparatus for video decoding includes processing circuitry that decodes prediction information for a current block in a current picture that is a part of a coded video sequence. The prediction information indicates a specific inter prediction mode, a position dependent prediction combination (PDPC) process, and a coded residual for the current block. The processing circuitry determines at least one of (i) a partition of the current block to which a transform process is to be applied and (ii) a transform type of the transform process for the current block based on the prediction information. The processing circuitry performs the transform process on the coded residual to generate a decoded residual. The processing circuitry reconstructs the current block based on the decoded residual.

Abstract: A video decoder can be configured to receive, for a first chroma component of a block of the video data, information for first residual samples that correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component; determine intermediate reconstructed samples based on the first residual samples; receive, for a second chroma component of the block of video data, information for second residual samples that correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples; reconstruct the first chroma block based on the first residual samples and the first prediction block; reconstruct the second chroma block based on the second residual samples and the intermediate reconstructed samples; and output decoded video data comprising the reconstructed first chroma block and the reconstructed second chroma block.

Abstract: A video coding device may be configured to periodically select the frame packing configuration (e.g., face layout and/or face rotations parameters) associated with a RAS, The device may receive a plurality of pictures, which may each comprise a plurality of faces. The pictures may be grouped Into a plurality of RASs. The device may select a frame packing configuration with the lowest cost for a first RAS. For example, the cost of a frame packing configuration may be determined based on the first picture of the first RAS. The device may select a frame packing configuration for a second RAS. The frame packing configuration for the first RAS may be different than the frame packing configuration for the second RAS. The frame packing configuration for the first RAS and the frame packing configuration for the second RAS may be signaled in the video bitstream.

Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry decodes coded information of a chroma coding block (CB) from a coded video bitstream. The coded information indicates that a cross-component filter is applied to the chroma CB and indicates a chroma subsampling format and a chroma sample type. The processing circuitry determines a filter shape of the cross-component filter based on at least one of the chroma subsampling format and the chroma sample type. The processing circuitry generates a first intermediate CB by applying a loop filter to the chroma CB and generates a second intermediate CB by applying the cross-component filter having the determined filter shape to the corresponding luma CB. The processing circuitry determines a filtered chroma CB based on the first intermediate CB and the second intermediate CB.

Abstract: Techniques are disclosed for adding time data to scan lines of an image frame. In some examples, an image sensor may perform a rolling shutter image capture to produce the scan lines. Data captured by another sensor may be associated with at least a portion of a scan line based at least in part on the time data added to the scan line in some examples. Furthermore, techniques are disclosed for synchronizing data capture by multiple sensors. For example, a rolling shutter image capture performed by an image sensor may be synchronized with a data capture performed by another sensor.