Abstract: A head-mounted display device includes a see-though display providing both eyes of a user with a view of a physical object, a processor, and a non-volatile storage device holding instructions executable by the processor to: display an image that corresponds to the physical object to a first eye of the user at an offset to the physical object; display blocking light to a second eye of the user; in response to alignment user input, move a position of the image relative to the physical object; in response to completion user input, determine the inter-pupillary distance of the user; and calibrate the head-mounted display device based on the inter-pupillary distance.

Abstract: Devices, systems and methods for digital video coding, which includes simplified cross-component prediction, are provided. In a representative aspect, a method for video coding includes receiving a bitstream representation of a current block of video data including at least one luma component and at least one chroma component, predicting, using a linear model, a first set of samples of the at least one chroma component based on a second set of samples that is selected by sub-sampling samples of the at least one luma component, and processing, based on the first and second sets of samples, the bitstream representation to generate the current block. In another representative aspect, the second set of samples are neighboring samples of the current block and are used for an intra prediction mode of the at least one luma component.

Abstract: A prediction method, apparatus, and a computer storage medium for decoding, the method includes: acquiring reference samples adjacent to at least one side of a decoding block; determining a reference point from the at least one side and determining reference sample positions to be selected corresponding to the at least one side according to a preset number of samples; selecting reference samples corresponding to the reference sample positions to be selected from the reference samples based on the reference sample positions to be selected; and performing prediction decoding on the decoding block based on the selected reference samples.

Abstract: The method relates to harmonization between affine mode and other inter coding tools mode. The method for video processing includes acquiring, during a conversion between a current block and a bitstream representation of the current block, an indication of the current block, where the indication indicates whether a merged affine model of the current block should be modified, and performing, at least based on the indication, the conversion between the current block and the bitstream representation of the current block.

Abstract: To facilitate control of an AR HMD, a camera unit in a camera sensor system generates RGB/IR images and the system also extrapolates images for times in the future based on light intensity change signals from an event detection sensor (EDS) for HMD pose tracking, hand tracking, and eye tracking. The times in the future are provided by an HMD application which defines the future times, and the RGB/IR images and extrapolated images are sent back to the application. In this way, the camera sensor system enables improved performance tracking (equivalent to using very high-speed camera) at lower bandwidth and power consumption.

Abstract: An apparatus comprises a mount body by which the apparatus is secured to a structure. A camera assembly includes an image sensor adapted to capture images within its field of view. A lighting assembly houses one or more light sources including a directional light source. A control-board assembly, fixed to the mount body, houses control boards including one or more processors configured to acquire information about an object, to associate a location within the field of view of the image sensor with the object, to point light emitted by the directional light source at the location associated with the object by rotating the lighting assembly and turning the laser assembly, and, based on an image acquired from the camera assembly, to detect change within the field of view of the image sensor corresponding to placement or removal of the object.

Abstract: The controller is configured to receive a request that causes transferring of a reference pixel block of a video, wherein the video is being encoded using the reference pixel block. The controller is configured to determine whether the reference pixel block has at least a portion that is outside a frame of the video. In response to the determination of the reference pixel block having at least a portion outside the frame of the video, the controller is configured to cause a portion of the reference pixel block of the video inside the frame of the video to be fetched from a memory storage and stored in a cache storage, pad a remaining missing portion of the reference pixel block of the video outside the frame of the video with padding pixel data to form the reference pixel block, and transfer the reference pixel block in response to the request.

Abstract: A method for decoding a data stream representative of an image split into blocks. The method includes: for a current block, determining whether the size of the current block is less than or equal to a threshold, and if so, decoding information indicating a coding mode of the block among first and second coding modes, and reconstructing the current block according to the indicated coding mode, and otherwise reconstructing according to the first coding mode. According to the first coding mode, the current block is reconstructed using an inverse transform of a transformed prediction residue decoded for the current block, and according to the second coding mode the current block is reconstructed, for each pixel, by obtaining a prediction of the pixel from another previously decoded pixel belonging to the current block or to a previously decoded block, and reconstructing the pixel from the prediction and a decoded prediction residue.

Abstract: An apparatus includes processing circuitry configured to decode coding information of a current block from a coded video bitstream. The coding information can indicate that a first prediction mode of the current block is one of a plurality screen content coding (SCC) tools. The processing circuitry can determine whether at least one loop filter associated with the current block is disabled based on at least one of the first prediction mode of the current block and a first quantization parameter (QP) of the current block. In response to the at least one loop filter being determined as disabled, the processing circuitry can reconstruct the current block without the at least one loop filter.

Abstract: A video decoder receives data from a bitstream for a block of pixels to be decoded as a current block of a current picture of a video. The video decoder receives from the bitstream first and second signaled indices for the current block. The video decoder determines first and second merge indices from the first and second signaled indices. The video decoder uses the first and second merge indices to select first and second motion candidates, respectively. The video decoder generates a set of prediction samples in ALWIP mode and performs an inverse secondary transform and an inverse primary transform to generate a set of residual samples of the current block. Enabling or selection of secondary transform and/or primary transform depends on size, width, and/or height for the current block. The video decoder reconstructs the current block by using the set of residual samples and the set of prediction samples.

Abstract: A method and apparatus for video coding. In some examples, an apparatus includes receiving circuitry and processing circuitry. The processing circuitry decodes prediction information of a block in a current picture from a coded video bitstream. The prediction information includes an index for prediction offset associated with an affine model in an inter prediction mode. The affine model is used to transform between the block and a reference block in a reference picture that has been reconstructed. Further, the processing circuitry determines parameters of the affine model based on the index and a pre-defined mapping of indexes and offset values, and reconstructs at least a sample of the block according to the affine model.

Abstract: An example method includes coding, by a video coder and via a coded video bitstream, a syntax element that specifies whether the coded video bitstream includes a plurality of syntax elements that specify parameters of a temporal motion vector prediction (TMVP) candidate derivation process; where the syntax element specifies that the coded video bitstream includes the plurality of syntax elements: coding, by the video coder, the plurality of syntax elements via the coded video bitstream; and deriving, by the video coder and based on parameters specified by the plurality of syntax elements, a TMVP candidate for a current block of a current picture of video data; generating, for the current block, a list of motion vector candidates, the list including the derived TMVP candidate; and predicting, based on the list of motion vector candidates, the current block.

Abstract: Devices, systems and methods for constructing low-complexity non-adjacent merge candidates. In a representative aspect, a method for video processing includes receiving a current block of video data, selecting, based on a rule, a first non-adjacent block that is not adjacent to the current block, constructing a first merge candidate comprising motion information based on the first non-adjacent block, identifying a second non-adjacent block that is not adjacent to the current block and different from the first non-adjacent block, based on determining that the second non-adjacent block fails to satisfy the rule, refraining adding a second merge candidate derived from the second non-adjacent block, constructing a merge candidate list based on the first non-adjacent block, and decoding the current block based on the merge candidate list.

Abstract: A video processing method includes maintaining one or more motion candidate tables; performing a conversion between a current video block of a video and a coded representation of the current video block using multiple video processing operations in a sequence using a motion candidate table; and updating the motion candidate table due to completion of a particular processing operation.

Abstract: A video decoding method includes: deriving an L0 motion vector and an L1 motion vector for a current block; deriving a refined L0 motion vector and a refined L1 motion vector, by applying DMVR to the current block based on DMVR flag information; deriving L0 prediction samples of the current block based on the refined L0 motion vector and L1 prediction samples of the current block based on the refined L1 motion vector; deriving prediction samples for the current block based on the L0 prediction samples and the L1 prediction samples, by applying BDOF to the current block based on BDOF flag information; and generating reconstruction samples for the current block based on the prediction samples, in which the DMVR flag information is derived based on a predetermined DMVR application condition, and the BDOF flag information is derived based on a predetermined BDOF application condition.

Abstract: An example video codec includes memory configured to store the video data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine that a current mode of coding a current block of the video data is a single tree partitioning mode. Based on the current mode being the single tree partitioning mode, the one or more processors are configured to refrain from determining whether there is a non-DC coefficient for a chroma component of a transform unit (TU) for the current block and refrain from coding a low-frequency non-separable transformation (LFNST) index in response to the refraining of the determination of whether there is the non-DC coefficient. The one or more processors are configured to code the current block in the single partitioning mode with LFNST disabled.

Abstract: An image information decoding method performed by means of a decoding device according to the present invention comprises the steps of: decoding a non-separable secondary transform (NSST) index from a bitstream if NSST is applied to a target block; decoding information relating to transform coefficients with respect to the target block from the bitstream on the basis of the decoded NSST index; and deriving the transform coefficients with respect to the target block on the basis of the decoded information relating to the transform coefficients, wherein the NSST index is decoded prior to the information relating to the transform coefficients with respect to the target block.

Abstract: A system comprises a memory storage configured to store at least a portion of a frame of a video and a hardware motion estimation search processing unit configured to perform at least a portion of a motion estimation search for the video for a plurality of different block sizes. The hardware motion estimation search processing unit is configured to perform the motion estimation search using a plurality of source sub-blocks of a first block size to determine a first type of comparison evaluation values for the first block size. A combination of values included in the first type of comparison evaluation values is utilized to determine at least one second type of comparison evaluation values for a second block size, wherein the second block size is larger than the first block size.

Abstract: A video decoder and method for supporting a prediction mode for predicting blocks of a video is configured to predict each of the blocks by extrapolating a neighborhood of the respective block into the block along a direction which varies across the respective block.

Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.