Abstract: A video processing method includes determining, according to a rule, whether to apply a scaling matrix based on whether a secondary transform matrix is applied to a portion of a video block of a video, wherein the scaling matrix is used to scale at least some coefficients of the video block, and wherein the secondary transform matrix is used to transform at least some residual coefficients of the portion of the video block during the conversion; and performing a conversion between the video block of the video and a bitstream representation of the video using the selected scaling matrix.

Abstract: New intra planar modes are introduced for predicting digital video data. As part of the new intra planar modes, various methods are offered for predicting a first sample within a prediction unit, where the first sample is needed for referencing to when processing the new intra planar modes. And once the first sample is successfully predicted, the new intra planar modes are able to predict a sample of video data within the prediction unit by processing a bi-linear interpolation of four previously reconstructed reference samples.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry decodes prediction information of a current block in a current picture from a coded video bitstream. The prediction information is indicative of an affine model in a merge mode. The processing circuitry obtains, from a buffer, motion information of bottom locations in a neighboring block that is adjacent of the current block in the current picture, and determines parameters of the affine model that is used to transform between the block and a reference block in a reference picture based on the motion information of the bottom locations in the neighboring block. Further, the processing circuitry reconstructs samples of the current block based on the affine model.

Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.

Abstract: Provided is a picture encoding device that divides a picture into blocks and performs encoding for each of the divided blocks. A primary signal block divider divides a primary signal of the picture into rectangles having a predetermined size, and generates a primary signal block. A secondary signal block divider divides a secondary signal of the picture into rectangles having a predetermined size, and generates a secondary signal block. A primary signal predictor predicts a primary signal, and a secondary signal predictor predicts a secondary signal. The secondary signal predictor can perform inter prediction of predicting a secondary signal from an encoded primary signal, and the inter prediction is restricted based on at least one of a size of the primary signal block and a size of the secondary signal block.

Abstract: An image decoding method according to the present document comprises the steps of: acquiring prediction-related information and residual-related information for a current block; deriving transform coefficients for the current block on the basis of the residual-related information; and generating residual samples of the current block on the basis of the transform coefficients, wherein the residual-related information includes low-frequency non-separable transform (LFNST) index information indicating information relating to non-separable transform for a low-frequency transform coefficient of the current block on the basis of a matrix-based intra prediction (MIP) flag.

Abstract: This disclosure relates to video coding and more particularly to techniques for performing entropy coding. According to an aspect of an invention, a parity level flag specifying a parity of a transform coefficient level at a scanning position is decoded if a value of a second absolute level greater flag is equal to a first value.

Abstract: Methods and systems for controlling a surgical microscope. Moveable optics of the surgical microscope are controlled using two sets of control parameters, to reduce jitter and image instability. Shifts in the image due to changes in temperature or due to the use of optical filter can also be compensated. Misalignment between the mechanical axis and the optical axis of the surgical microscope can also be corrected.

Abstract: An example method includes determining, without receiving explicit signaling, whether motion compensation for a current block of a current picture of video data is to be performed using a four-parameter affine motion model (AMM) defined by two motion vectors (MVs) or using a six-parameter AMM defined by three MVs; deriving values of predictors for MVs of the AMM of the current block; decoding a representation of differences between the values of the MVs of the AMM for the current block and the values of the predictors; determining the values of the MVs of the AMM for the current block from the values of the predictors and the decoded differences; determining, based on the determined values of the MVs of the AMM for the current block of video data, a predictor block of video data; and reconstructing the current block based on the predictor block.

Abstract: Various implementations for video encoding and decoding are presented involving determining, for a block being encoded or decoded in a picture, a coefficient group mode for coding at least one coefficient of a set of transform coefficients of the image block; encoding or decoding the set of transform coefficients of the image block responsive to the coefficient group mode. The coefficient group mode can be determined from at least one of image block size, number of non-zero transform coefficients inside the image block, position of a transform coefficient inside the image block, decoded syntax element, wherein the coefficient group mode can specify whether a coefficient group significance flag is coded/decoded, indicating that at least one coefficient is non-zero inside a coefficient group and/or specify at least one size of the coefficient group.

Abstract: Some embodiments provide a method for subdividing an interval during entropy coding for a bitstream representing a set of video pictures. The method performs a bit-shifting operation on a probability estimator value. The method computes a sub-interval value by multiplying a range value representing the interval by the bit-shifted probability estimator value. The method uses the sub-interval value to update the interval.

Abstract: Systems and techniques are described for data encoding using a machine learning approach to generate a distortion prediction {circumflex over (D)} and a predicted bit rate {circumflex over (R)}, and to use {circumflex over (D)} and {circumflex over (R)} to perform rate-distortion optimization (RDO). For example, a video encoder can generate the distortion prediction {circumflex over (D)} and the bit rate residual prediction based on outputs of the one or more neural networks in response to the one or more neural networks receiving a residual portion of a block of a video frame as input. The video encoder can determine bit rate metadata prediction based on metadata associated with a mode of compression, and determine {circumflex over (R)} to be the sum of and . The video encoder can determine a rate-distortion cost prediction ? as a function of {circumflex over (D)} and {circumflex over (R)}, and can determine a prediction mode for compressing the block based on ?.

Abstract: Disclosed is a method for photographing a panoramic image including the steps of recognizing movement of a corresponding photographing apparatus by comparing a current real-time input image with a previous image through a motion estimation mechanism with exposure compensation, determining a time to photograph each next picture by determining whether movement in a photography direction reaches a preset threshold value, and photographing each next picture by manual or automatic operation at the determined time.

Abstract: According to some implementations, a n medical interventional imaging device for monitoring an interventional procedure is described. The medical interventional imaging device includes a temporary data buffer configured to temporarily store medical interventional fluoroscopic image data, a signal processor configured to detect if an abnormal state occurs during an intervention and to record an instant at which the abnormal state has occurred, and a permanent data storage configured to permanently store at least a part of the medical interventional fluoroscopic image data stored temporarily before and/or at the recorded instant if the abnormal state is detected.

Abstract: The encoder includes processing circuitry, and memory. Using the memory, the processing circuitry: generates a predicted image of an input image that is a current image to be encoded, based on generated data output from a generator network in response to a reference image being input to the generator network, the generator network being a neural network; calculates a prediction error by subtracting the predicted image from the input image; and generates an encoded image by at least transforming the prediction error.

Abstract: Systems, methods, and devices for fluorescence imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp providing offset control for data generated by the pixel array and a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 770 nm to about 790 nm; or electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.

Abstract: A video decoding method according to this document includes constructing a most probable mode (MPM) list by deriving MPM candidates for a current block based on a neighboring block adjacent to the current block, deriving an intra prediction mode for the current block based on the MPM list, generating predicted samples by performing prediction for the current block based on the intra prediction mode, and generating a reconstructed picture for the current block based on the predicted samples.

Abstract: An image decoding method, according to the present document, may comprise the steps of: deriving transform coefficients for a current block on the basis of residual information; determining whether a significant coefficient is present in a second region excluding a first region in the top-left end of the current block; parsing a LFNST index from a bitstream if the significant coefficient is not present in the second region; deriving modified transform coefficients by applying a LFNST matrix, derived on the basis of the LFNST index, to transform coefficients of the first region; and deriving residual samples of the current block on the basis of an inverse primary transform of the modified transform coefficients.

Abstract: An image decoding method according to the present document comprises the steps of: deriving a quantized transform coefficient for a current block on the basis of BDPCM; deriving a transform coefficient by performing dequantization on the quantized transform coefficient; and deriving a residual sample on the basis of the transform coefficient, wherein, when the BDPCM is applied to the current block, inverse non-separable transform is not applied to the transform coefficient.

Abstract: Quantization matrix can be used to adjust quantization of transform coefficients at different frequencies. In one embodiment, a single fixed parametric model, such as a polynomial is used to represent a quantization matrix. Modulation of bit cost and complexity is achieved by specifying only the n first polynomial coefficients, the remaining ones being implicitly set to zero or other default values. One form of the single fixed polynomial is a fully developed polynomial in (x, y), where x, y indicate the coordinates of a given coefficient in a quantization matrix, with terms ordered by increasing exponent. Since higher exponents are the last ones, reducing the number of polynomial coefficients reduces the degree of the polynomial, hence its complexity. The polynomial coefficients can be symmetrical in x and y, and thus reducing the number of polynomial coefficients that need to be signaled in the bitstream.