Abstract: A method for determining similarity of adjacent rows of an image, the method includes: obtaining feature value of corresponding sub-pixel of each row of image data in a frame of image data; compressing obtained feature values of the corresponding sub-pixels of each row of image data to obtain compressed feature values of the corresponding sub-pixels of each row of image data; subtracting compressed feature values of corresponding sub-pixels of two adjacent rows of image data in the frame of image data, and summing absolute values of multiple differences obtained from subtracting; and determining similarity of the two adjacent rows of image data in the frame of image data according to the summed value. The present application further provides a display device.

Abstract: In one example, a processing system including at least one processor may obtain a predicted viewport of a mobile computing device for an immersive visual stream, identify a first plurality of blocks of a frame of the immersive visual stream that are associated with the predicted viewport, encode the first plurality of blocks at a first encoding quality level, and encode a second plurality of blocks of the frame at a second encoding quality level, where the second encoding quality level is associated with a lesser visual quality as compared to the first encoding quality level and where the second plurality of blocks are outside of the predicted viewport. The processing system may then transmit the frame having the first plurality of blocks encoded at the first encoding quality level and the second plurality of blocks encoded at the second encoding quality level to the mobile computing device.

Abstract: Techniques are described herein for video coding, including compression of bitstream indexes for neural network based video coding and/or parallel entropy coding. One example includes obtaining a sequence of video data, identifying positions in the sequence of video data associated with entry points for individually entropy codable parcels of a parallel entropy codable sequence of video data, and generating the parallel entropy codable sequence of video data. An index is then generated for the parallel entropy codable sequence of video data, the index identifying the individually entropy codable parcels within the parallel entropy codable sequence of video data.

Abstract: Described is picture segmentation through columns and slices in video encoding and decoding. A video picture is divided into a plurality of columns, each column covering only a part of the video picture in a horizontal dimension. All coded tree blocks (“CTBs”) belonging to a slice may belong to one or more columns. The columns may be used to break the same or different prediction or in-loop filtering mechanisms of the video coding, and the CTB scan order used for encoding and/or decoding may be local to a column. Column widths may be indicated in a parameter set and/or may be adjusted at the slice level. At the decoder, column width may be parsed from the bitstream, and slice decoding may occur in one or more columns.

Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes generating, for a conversion between a current video block of a video and a coded representation of the current video block, a most probable mode (MPM) list based on a rule, where the rule is based on whether a neighboring video block of the current video block is coded with a matrix based intra prediction (MIP) mode, and performing the conversion between the current video block and the coded representation of the current video block using the MPM list, where the conversion applies a non-MIP mode to the current video block, and where the non-MIP mode is different from the MIP mode.

Abstract: In one example, an apparatus is disclosed for coding coefficients associated with a block of video data during a video coding process, the apparatus comprising a video coder configured to code information that identifies a scanning order associated with the block, wherein to code the information that identifies the scanning order associated with the block, the video coder is configured to determine a most probable scanning order for the block, and code an indication of whether the scanning order associated with the block is the most probable scanning order. In another example, to code the information that identifies the scanning order associated with the block, the video coder is further configured to, in the event the scanning order associated with the block is not the most probable scanning order, code an indication of the scanning order associated with the block.

Abstract: In an example a method of processing video data includes determining a first palette for a first block of video data that is located in a first row of blocks, generating a predictor palette for constructing at least one second palette of at least one second block of video data in the first row of blocks coded, reinitializing the predictor palette for determining a third palette of a third block of video data that is located in a second row of blocks, wherein re-initializing the predictor palette comprises re-initializing the predictor palette based on the one or more palette entries of the first palette or an initial predictor palette generated after coding the first block, determining the third palette of the third block based on the re-initialized predictor palette, and coding the third block using the third palette.

Abstract: Devices, systems and methods for encoding and decoding digital video are described. In a representative aspect, a method for video processing includes maintaining one or more tables of intra prediction mode candidates based on one or more previous video blocks of a video and performing a conversion between a current video block of the video and a bitstream representation of the video using the one or more tables of intra prediction mode candidates.

Abstract: A context modeling method and apparatus of a split flag are provided. The method includes: obtaining a height and a width of a current node, a height of a first leaf node in a first direction, and a width of a second leaf node in a second direction; determining whether the current node meets a first preset condition and a second preset condition, where the first preset condition includes the height of the current node is greater than the height of the first leaf node, and the second preset condition includes the width of the current node is greater than the width of the second leaf node; and determining a context model of a split flag of the current node based on whether the first and second preset conditions are met.

Abstract: A method and apparatus for deriving motion compensated prediction for boundary pixels in a video coding system are disclosed. Embodiments of the present invention determine a current motion vector (MV) and one or more neighboring MVs corresponding to an above MV, a left MV, or both the above MV and the left MV. A first predictor for a current boundary pixel in a boundary region of the current CU is generated by applying motion compensation based on the current MV and a first reference picture pointed by the current MV. One or more second predictors for the current boundary pixel are generated by applying the motion compensation based on the neighboring MVs and reference pictures pointed by the neighboring MVs. A current boundary pixel predictor for the current boundary pixel is then generated using a weighted sum of the first predictor and the second predictors according to weighting factors.

Abstract: A method of processing a video signal based on inter prediction includes constructing a first merge candidate list of a current block using a spatial merge candidate and temporal merge candidate of the current block, constructing a second merge candidate list by adding a history-based merge candidate indicating motion information of a block coded prior to the current block to the first merge candidate list, obtaining a merge index indicating a merge candidate applied to the current block within the second merge candidate list, and generating a prediction block of the current block using motion information of a merge candidate indicated by the merge index. The history-based merge candidate may be added to the first merge candidate list if the history-based merge candidate has motion information not overlapping motion information of a pre-defined merge candidate among merge candidates included in the first merge candidate list.

Abstract: The present disclosure relates to a method for decoding a video signal based on adaptive multiple transforms (AMT). The method includes: obtaining an AMT index from the video signal, where the AMT index indicates any one of a plurality of transform combinations in a transform configuration group, and the transform configuration group includes discrete sine transform type 7 (DST7) and discrete cosine transform type 8 (DCT8): deriving a transform combination corresponding to the AMT index, where the transform combination includes a horizontal transform and a vertical transform, and at least one of the DST-7 or the DCT-8: performing an inverse transform on a current block on the basis of the transform combination; and restoring the video signal by using the inversely transformed current block. The AMT represents a transform scheme that is performed based on a transform combination adaptively selected from a plurality of transform combinations.

Abstract: Techniques for decoding video data include determining a picture quantization parameter (QP) value of the picture of video data, determining an intermediate chroma QP offset value for a chroma QP value based on the picture QP value and a first function based on video characteristics of the picture of video data, determining the chroma QP value with a second function of the intermediate chroma QP offset value, and decoding the picture of video data using the chroma QP value.

Abstract: An apparatus includes processing circuitry for video decoding. The processing circuitry locates luma units of a luma coding unit that are co-located with chroma units of a chroma coding unit, and then determines a popularity of an intra block copy mode in the luma units. Further, the processing circuitry determines a block vector for a chroma unit in the chroma coding unit when the popularity meets a requirement, and reconstructs at least one sample of the chroma unit according to the block vector.

Abstract: A system and method for image stream synchronization for an FIR camera. The method includes applying an initial correction to a received image stream; splitting the corrected image stream into a first image stream and at least a second image stream; enhancing the first image stream by at least one image enhancing process; buffering the second image stream until a synchronization signal is received; and synchronizing the first image stream and second image stream, such that the output of the enhanced first image stream and the buffered second image stream match.

Abstract: Disclosed herein are representative embodiments of generating representative motion information that can be used during processing of a video frame. In one exemplary embodiment disclosed herein, a reference frame comprising a group of blocks is processed, and motion information for the group of blocks is compressed at least by buffering representative motion-vector information and representative reference-frame index information for the group of blocks. The representative reference-frame index information comprises reference-frame index information of a representative block of the group of blocks, and the representative reference-frame index information represents reference-frame index information for the group of blocks during processing of a current frame.

Abstract: An active sensor for performing active measurements of a scene is presented. The active sensor includes at least one transmitter configured to emit light pulses toward at least one target object in the scene, wherein the at least one target object is recognized in an image acquired by a passive sensor; at least one receiver configured to detect light pulses reflected from the at least one target object; a controller configured to control an energy level, a direction, and a timing of each light pulse emitted by the transmitter, wherein the controller is further configured to control at least the direction for detecting each of the reflected light pulses; and a distance measurement circuit configured to measure a distance to each of the at least one target object based on the emitted light pulses and the detected light pulses.

Abstract: Embodiments described herein provide examples of a real-time visual object tracking system. In one aspect, an unmanned aerial vehicle (UAV) capable of performing real-time visual tracking of a moving object includes: a processor; a memory coupled to the processor; and a camera to capture a video of the moving object. This UAV additionally includes a visual tracking module to: receive a first video image and a first location of the object; receive a second video image following the first video image; place a first search window in the first video image and a second search window in the second video image centered on a second location in the second video image having the same coordinates as the first location; compute a correlation between an image patch within the first search window and an image patch within the second search window; and determine an updated location of the object in the second video image.

Abstract: A method of measuring braking deceleration of an elevator based on a video of a motion of a hoisting machine taken by a mobile device, the motion of the hoisting machine including a motion of a brake and a motion of a traction sheave, the method including capturing the video, processing the video, and calculating a braking deceleration of the elevator based on the processed video.

Abstract: A light source (11) of a disguising mask detecting device (1) emits light at a person who is a subject. A camera (12) acquires images in multiple different wavelength ranges of reflected light of the light emitted at the person. A face detector (172) detects a face region of the person from the images acquired by the camera (12). A determiner (173) determines that the person is wearing a disguising mask when luminances of the face region in the images satisfy specific relations different from relations exhibited by skin.