Abstract: In one example, a head mounted display system includes at least one memory; and at least one processor to execute instructions to: detect a first position and a first view direction of a head of a user based on sensor data generated by at least one of an accelerometer, at least one camera, or a gyroscope at a first point in time; determine a latency associated with a time to cause an image to be presented on the display; determine a predicted position and a predicted view direction of the head of the user at a second point in time based on the latency; render, prior to the second point in time, the image for presentation on the display based on the predicted position and the predicted view direction of the head of the user; and cause the display to present the rendered image.

Abstract: An example method includes predicting, based on a plurality of color components of a block of video data coded using joint coding of chroma residuals (JCCR), a sign of a coefficient of a plurality of coefficients of a joint residual block of the block of video data; generating, for each respective color component of the plurality of color components and based on the plurality of coefficients of the joint residual block, coefficients of a respective residual block of a plurality of residual blocks; and reconstructing, based on the plurality of residual blocks, the block of video data.

Abstract: In image encoding, to raise the degree of concentration of coefficient energy (concentrate the transform coefficients at low frequencies), there is disclosed the application of a secondary transform different from a primary transform to the transform coefficients after the primary transform. Since the transform coefficients after multiple transforms are applied may be transformed to a different domain than the frequency domain with respect to the original image characteristics, bandwidth control using a scaling list for the frequency domain (quantization matrix) is affected. It is an object to provide a mechanism enabling bandwidth control using a scaling list.

Abstract: A device capable of compressing video data includes a memory configured to store a luma new filter value, a chroma new filter value, a cross component Cb new filter value, and a cross component Cr new filter value. The device may also include one or more processors, coupled to the memory, configured to set a joint constraint on the luma new filter value, the chroma new filter value, the cross component Cb new filter value, and the cross component Cr new filter value, such that each of the luma new filter value, the chroma new filter value, the cross component Cb new filter value, and the cross component Cr new filter value are not disabled in a unit associated with an adaptation parameter set having a first adaptation parameter set identification (APS ID).

Abstract: An intra-prediction method includes: determining, by an intra-prediction apparatus, a directional intra-prediction mode for a rectangular video coding block from an extended set of directional intra-prediction modes, wherein the extended set of directional intra-prediction modes includes extended directional intra-prediction modes and conventional directional intra-prediction modes and determining, by the intra-prediction apparatus, a plurality of available reference samples based on a direction of the directional intra-prediction mode. The method further includes: intra-predicting, by the intra-prediction apparatus, pixel values of pixels of the rectangular video coding block based on the plurality of available reference samples.

Abstract: A display device includes a first display layer including display elements disposed on an object; a power supply that supplies a power signal to the display elements; and a signal controller having an encoder that encodes first image data into second image data and that supplies it to the display elements. Each display element includes a base member; a pixel a driving circuit unit having a decoder that decodes the second image data into the first image data and that provides a pixel driving signal to the pixel; a first antenna unit that receives the power signal and that provides the power signal to the driving circuit unit; a second antenna unit that receives the second image data and that provides the second image data to the decoder; and a third antenna unit that transmits and receives an addressing signal for detecting a relative position between the display elements.

Abstract: An apparatus includes a processor that is configured to select a palette entry in the palette for coding a value of a pixel of the image block; obtain respective palette indexes of neighboring pixels of the pixel; select, using the respective palette indexes, an entropy code for coding an index of the palette entry; and code the palette entry using the entropy code. A method includes obtaining respective palette indexes of neighboring pixels of a pixel of the image block; selecting an entropy code using the respective palette indexes; decoding, from a encoded bitstream, an index of a palette entry; and setting a value of the pixel using the palette entry.

Abstract: Systems, methods, and non-transitory computer-readable media can identify a virtual character being presented to a user within a real-time immersive environment. A first animation to be applied to the virtual character is determined. A nonverbal communication animation to be applied to the virtual character simultaneously with the first animation is determined. The virtual character is animated in real-time based on the first animation and the nonverbal communication animation.

Abstract: A decoding method is disclosed. First, context for a syntax element associated with a current transform coefficient of a block of a picture is determined. The context is determined based on the area of said block, on the position of the current transform coefficient within the block and on the number of non-zero neighboring transform coefficients in a local template. Second, the syntax element is decoded based at least on the determined context. Advantageously, the local template depends on the shape of said block.

Abstract: The present invention relates to efficient signaling of an intra prediction mode for predicting a current block in intra prediction coding. According to an aspect of the present invention, a video encoding apparatus divides dozens of intra modes into groups, selects a group to which an actual intra mode of the current block to be encoded belongs, and signals a value corresponding to the group. The video decoding apparatus acquires information on the group to which the actual intra mode of the current block belongs from a bit-stream and then evaluates intra modes belonging to the group to select a final intra mode.

Abstract: The present invention relates to efficient signaling of an intra prediction mode for predicting a current block in intra prediction coding. According to an aspect of the present invention, a video encoding apparatus divides dozens of intra modes into groups, selects a group to which an actual intra mode of the current block to be encoded belongs, and signals a value corresponding to the group. The video decoding apparatus acquires information on the group to which the actual intra mode of the current block belongs from a bit-stream and then evaluates intra modes belonging to the group to select a final intra mode.

Abstract: A method includes capturing video frames of a video item to be transmitted as a livestream and delivering the video frames to a queue for an encoder of a user device. The method further includes determining that a subset of the video frames have been discarded. The discarding indicates that the subset of the video frames did not enter the encoder. The method further includes determining a frequency of discarded video frames. Responsive to the frequency exceeding a threshold frequency, the method includes reducing quality of the video item transmitted as the livestream based on the frequency by reducing one or more of frame rate of the user device, resolution of the user device, or encoder bitrate of the encoder.

Abstract: A method for video processing is described. The method comprises: making a decision, for a conversion between a current video block of a video picture of a video and a coded representation of the video, regarding a size of a reference region of the video picture from which reference samples are used for predicting the current video block, based on a size of a virtual pipeline data unit (VPDU), a size of a coding tree block (CTB), or a size of a coding tree unit (CTU); and performing the conversion based on the decision.

Abstract: The disclosure relates to a method including applying a first format modification to an audio and video input content in a first format to output a content complying with a second format, information about the first format modification being associated to the output content. The disclosure also relates to a method including obtaining an audio and video input content complying with an input format and information about a first format modification applied to the input content and determining a second format modification to apply to the input content by taking account of the first format modification. It also relates to corresponding signal, devices, electronic assembly, system, computer readable program products and storage media.

Abstract: The technology is directed towards image compression and decompression, including for 3D images. A sender device obtains lower resolution sub-images of an original image, captured from different angles. The sender device uses different neural network candidate level data and groups of candidate sub-images to determine selected neural network level data and sub-images that when combined, reconstruct the original image that satisfies a function of quality loss data, for sending to a receiver device. The receiver device receives the neural network level data, the group of sub-images and the reconstruction data, and reconstructs a three-dimensional representation of the original image using the neural network level and the group of sub-images arranged based on the reconstruction data.

Abstract: Devices, systems and methods for video processing are described. An exemplary method for video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, that a neighboring block of the current block that is coded in a palette mode is processed as an intra-coded block having a default mode during a construction of a list of most probable modes (MPM) candidates of the current block in case the neighboring block is located above or left of the current block. The method also includes performing the conversion based on the determining.

Abstract: An image encoding/decoding method and device are provided. An image decoding method performed by an image decoding device according to the present disclosure may comprise the steps of: determining a prediction mode of the current block on the basis of prediction information obtained from a bitstream; on the basis of the prediction mode of the current block, obtaining a flag indicating whether a color space transform is applied to a residual sample of the current block; determining a quantization parameter of the current block on the basis of the flag; and determining a transform coefficient of the current block on the basis of the quantization parameter.

Abstract: Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.

Abstract: An image transmission device (100) includes a compression unit (16) to generate first compression images (5) which are obtained by irreversibly compressing divided images, and to generate second compression images (6) which are obtained by reversibly compressing each of the first compression images (5), a decompression unit (17) to decompress each of the first compression images (5) as decompression images (7), a division sum image generation unit (12) to generate a division sum image (imgSUM), an error sum image generation unit (13) to generate an error sum image (?imgSUM), a judgment unit (14) to generate judgment data (Dj), and a transmission unit (15) to transmit the second compression images (6), the division sum image (imgSUM), the error sum image (?imgSUM) and the judgment data (Dj).

Abstract: A video coder is configured to form, in a symmetric motion vector difference mode, a List 0 (L0) base vector using a L0 Advanced Motion Vector Prediction (AMVP) candidate list and a List 1 (L1) base vector using a L1 AMVP candidate list; determine a refined L0 motion vector and a refined L1 motion vector by performing a decoder-side motion vector refinement process that refines the L0 base vector and the L1 base vector; and use the refined L0 motion vector and the refined L1 motion vector to determine a prediction block for a current block of a current picture of the video data.

Abstract: A method for visual media processing, including: computing, during a conversion between a current video block of visual media data and a bitstream representation of the current video block, a cross-component linear model (CCLM) and/or a chroma residual scaling (CRS) factor for the current video block based, at least in part, on neighboring samples of a corresponding luma block which covers a top-left sample of a collocated luma block associated with the current video block, wherein one or more characteristics of the current video block are used for identifying the corresponding luma block.

Abstract: The embodiments of the disclosure disclose a method for determining a prediction direction, a decoder and a computer storage medium. The method is implemented by a decoder. The method includes that: a Direct Mode (DM) in a chroma intra prediction mode of a block to be decoded is acquired (S101); and an index number of a prediction direction in a DM derived mode is determined based on an offset N and an index number M of a prediction direction in the DM to determine the DM derived mode (S102).

Abstract: An image decoding method performed by a decoding apparatus according to the present disclosure includes receiving a bitstream including residual information; deriving quantized transform coefficients for a current block based on the residual information included in the bitstream; deriving residual samples for the current block based on the quantized transform coefficients; and generating a reconstructed picture based on the residual samples for the current block.

Abstract: A method for decoding an image by a decoding apparatus comprises the steps of: obtaining merge with motion vector difference (MMVD) flag information of a current block from a bit stream; determining whether or not the current block is a current picture referencing (CPR) coding block; if the current block is a CPR coding block, deriving base motion information; deriving motion information of the current block on the basis of the base motion information; generating prediction samples of the current block on the basis of the motion information; and generating reconstruction samples of the current block on the basis of the prediction samples, wherein the MMVD flag information indicates whether or not motion information is derived when the MMVD is applied to the current block, and the CPR coding block is a block coded by using a current picture including the current block as a reference picture.

Abstract: Provided are an encoding method and apparatus, and a decoding method and apparatus for adaptively selecting a context model used to entropy-encode and entropy-decode a syntax element, based on various shapes of coding units. The image decoding method includes: determining a context model based on block shape information including at least one of a shape, direction, width, ratio of width and height, or size of a coding unit; obtaining, from a bitstream based on the context model, information about a split shape mode for splitting the coding unit; and determining a split shape mode of the coding unit, based on the information about the split shape mode.

Abstract: A video decoding method performed by a video decoding device according to the present document may comprise the steps of: acquiring image information from a bitstream, the image information including a picture header associated with the current picture including a plurality of slices; parsing, from the picture header, at least one of a first flag indicating whether information necessary for an inter-prediction operation for a decoding process is present in the picture header, or a second flag indicating whether information necessary for an intra-prediction operation for the decoding process is present in the picture header; generating prediction samples by performing at least one of intra-prediction or inter-prediction for the slices in the current picture on the basis of at least one of the first flag or the second flag; and generating reconstructed samples on the basis of the prediction samples.

Abstract: In some embodiments, a decoder may receive, from a bit stream for a block vector, an indication of a block vector predictor and a block vector difference. A sign of a directional component of the block vector difference may be determined based on: a directional component of the block vector, and a directional component of the block vector predictor. The decoder may decode the block vector based on the block vector predictor and the block vector difference. The decoder may generate an intra block compensated prediction of a block based on the block vector. The decoder may decode the block based on the intra block compensated prediction of the block and a prediction residual of the block.

Abstract: An encoding device comprises: a transformer/quantizer configured to perform a transform process and a quantization process on a residual signal that represents a difference between an encoding-target block and a prediction block obtained by predicting the encoding-target block; an inverse quantizer/inverse transformer configured to restore the residual signal by performing an inverse quantization process and an inverse transform process on transform coefficients obtained by the transformer/quantizer; a combiner configured to reconstruct the encoding-target block by combining the restored residual signal and the prediction block; a deblocking filter configured to perform a filter process on a boundary between two blocks including the reconstructed block and a block adjacent to the reconstructed block; and a filter controller configured to control the deblocking filter, based on a type of the transform process applied with respect to the two blocks.

Abstract: An example method of video processing includes determining, for a conversion between a current picture of a video and a bitstream of the video, a scaling ratio based on a first window in the current picture and a second window in a reference picture associated with the current picture; resampling the reference picture by using the determined scaling ratio; and performing the conversion based on the result of the resampling, wherein a dimension of the first window is W×H and a dimension of the second window is W?×H?, where W, H, W? and H? are integers, and wherein W, H, W? and H? satisfy a constraint.

Abstract: Methods and apparatus for loop-filter processing of reconstructed video are disclosed. According to this method, if a loop-filter is disallowed for a target boundary, the target loop filter is disabled at top, bottom, left and right of the target boundary. According to another method, CC-ALF (cross-component adaptive loop filter) shape is changed across a virtual boundary. According to yet another method, CC-ALF and luma ALF handle unavailable samples in a same way.

Abstract: Systems, methods, and non-transitory computer-readable media can identify a virtual character being presented to a user within a real-time immersive environment. A first animation to be applied to the virtual character is determined. A nonverbal communication animation to be applied to the virtual character simultaneously with the first animation is determined. The virtual character is animated in real-time based on the first animation and the nonverbal communication animation.

Abstract: The present invention is related to processing a video signal. A method for decoding a video according to the present invention may comprise checking a merge coding unit which is generated by merging a plurality of coding units neighboring each other based on an encoded syntax element, and decoding the checked merge coding unit, wherein a same motion vector is shared in the merge coding unit.

Abstract: The present disclosure provides methods, apparatus and non-transitory computer readable medium for processing video data. According to certain disclosed embodiments, a method includes: determining a set of parameters from a plurality of sets of parameters wherein the set of parameters includes a scaling factor; determining a predicted sample value of a first chroma component based on the set of the parameters, a reconstructed sample value of a luma component and a reconstructed sample value of a second chroma component; and signaling an index associated with the set of parameters in a bitstream.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry determines an area with sample values available in a reference sample memory for use in a reconstruction of a current block. Further, the processing circuitry updates a history based list for storing locations of previously reconstructed samples of a single value string mode. The locations are limited within the area. Then, the processing circuitry reconstructs, based on the history based list, a string of the single value string mode within the current block.

Abstract: In some embodiments, a method receives a current encoding stream of a video. A first measurement for a reference encoding stream is selected to measure a quality of the reference encoding stream. The method compares a second measurement of the current encoding stream to the first measurement of the reference encoding stream and outputs whether the current encoding stream is validated based on the comparing.

Abstract: Implementations of the disclosed subject matter provide methods of transmitting, from a first user device, an authorization to one or more other user devices to receive one or more images captured by a first sensor of a mobile robot device, where the first user device controls the mobile robot device. The first user device may receive acknowledgement from the one or more other user devices to receive the one or more images captured by the first sensor of the mobile robot device. The mobile robot device may transmit, to the first user device and the one or more other user devices based on the acknowledgement, the one or more first images captured by the first sensor of the mobile robot as the mobile robot device moves within the area based on at least one first control operation received from the first user device.

Abstract: A method includes maintaining a set of parameters or weights derived through online learning for a neural net; transmitting an update of the parameters or weights to a decoder; deriving a first prediction block based on an output of the neural net using the parameters or weights; deriving a first encoded prediction error block through encoding a difference of the first prediction block and a first input block; encoding the first encoded prediction error block into a bitstream; deriving a reconstructed prediction error block based on the first encoded prediction error block; deriving a second prediction block based on an output of the neural net using the parameters or weights and the reconstructed prediction error block; deriving a second encoded prediction error block through encoding a difference of the second prediction block and a second input block; and encoding the second encoded prediction error block into a bitstream.

Abstract: A video coding mechanism is disclosed. The mechanism includes receiving a bitstream including a first slice of a coded image. The coded image is associated with a picture parameter set (PPS) in the bitstream. The first slice is associated with a slice header in the bitstream. A list of identifiers (IDs) is parsed from the PPS. A first ID is parsed from the slice header of the first slice. The first ID matches one of the IDs in the list of IDs in the PPS. A list of tiles coded in the first slice is determined based on the first ID. The first slice is determined to generate a reconstructed sub-image of the coded image.

Abstract: A method, computer program, and computer system is provided for decoding point cloud data. Data corresponding to a point cloud is received. A number of contexts associated with the received data is reduced based on occupancy data corresponding to one or more parent nodes and one or more child nodes within the received data. The data corresponding to the point cloud is decoded based on the reduced number of contexts.

Abstract: Methods, devices and systems for intra-block coding based decoding or encoding of video while using block vector signaling and/or merge candidates are disclosed. An example method for video processing includes performing a conversion between a video region of a video and a bitstream representation of the video, wherein the bitstream representation selectively includes motion vector difference (MVD) related syntax elements for an intra block copy (IBC) advanced motion vector prediction (AMVP) mode based on a maximum number of a first type of IBC candidates used during the conversion of the video region, wherein, when an IBC mode is applied, samples of the video region are predicted from other samples in a video picture corresponding to the video region.

Abstract: Devices, systems and methods for video processing are described. An exemplary method for video processing includes determining, for a block of a video, a quantization parameter associated with the block, coding the block of the video into a bitstream representation of the video as a palette coded block in part based on a modified value of the quantization parameter, and signaling coded information related to the quantization parameter in the bitstream representation.

Abstract: Devices, systems and methods for adaptive loop filtering are described. In an exemplary aspect, a method for video processing includes performing, for a current video block of a video, a filtering process that uses filter coefficients and comprises two or more operations with at least one intermediate result, applying a clipping operation to the at least one intermediate result, and performing, based on the at least one intermediate result, a conversion between the current video block and a bitstream representation of the video, wherein the at least one intermediate result is based on a weighted sum of the filter coefficients and differences between a current sample of the current video block and neighboring samples of the current sample.

Abstract: To reduce latency in streaming media a playlist requested from a content delivery network may be modified to have modified segmentation. After receiving the playlist from the content delivery network, the location of one or more I-frames in each segment in the playlist may be determined and these locations may be used to generate the modified playlist. The modified playlist may then be sent to a client device. Media segments may be modified in accordance with the modified segmentation of the modified playlist to generate modified media segments that can be sent to the client device.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that determines directionality information of a restoration filter unit included in a video frame based on at least one of a constrained directional enhancement filter (CDEF) process or an intra prediction mode. The processing circuitry determines one of a plurality of sets of filter parameters of a restoration filter process based on the directionality information of the restoration filter unit. The processing circuitry performs the restoration filter process on the restoration filter unit based on the one of the plurality of sets of filter parameters. The processing circuitry reconstructs the video frame based on the filtered restoration filter unit.

Abstract: Methods are provided for inter-prediction candidate index coding independent of the construction of the corresponding inter-prediction candidate list, i.e., a merging candidate list or an advanced motion vector predictor list. A maximum allowed number of inter-prediction candidates for an inter-prediction candidate list is used for encoding the inter-prediction candidate index in an encoded bit stream. The maximum allowed number may be pre-determined or may be selected by the encoder and encoded in the bit stream. A decoder may then decode the index using the maximum allowed number of inter-prediction candidates independent of the construction of the corresponding inter-prediction candidate list.

Abstract: Disclosed are a method for decoding a video signal and an apparatus therefor. Specifically, a method for decoding an image based on an inter-prediction mode may include: configuring a merge candidate list by using motion information of a spatial candidate and a temporal candidate adjacent to a current block; parsing a first syntax element indicating a particular candidate applied to inter-prediction of the current block among a predefined number of candidates in the merge candidate list; deriving a refined candidate by adding a motion vector offset to a motion vector of a candidate indicated by the first syntax element; and generating a prediction block of the current block by using the motion information of the refined candidate.

Abstract: A method of adaptive point cloud attribute coding is performed by at least one processor and includes determining a centroid of k candidate points of a point cloud, k being a predetermined sampling rate of all points of the point cloud, and selecting one of the k candidate points that is closest to the centroid. The method further includes determining a first levels-of-detail (LoD) layer comprising the one of the k candidate points, and a second LoD layer without the one of the k candidate points, and performing coding of attributes of the all points, based on the first LoD layer and the second LoD layer.

Abstract: Methods, systems and devices for signaling the usage of adaptive loop filtering in image and video coding are described. An example method of video processing includes determining, for a conversion between a current region of a video and a bitstream representation of the video, whether a luma adaptive loop filter is used during the conversion and whether luma adaptive loop filter coefficients are included in the bitstream representation, wherein a single syntax element in the bitstream representation is indicative of use of the luma adaptive loop filter and signaling of the luma adaptive loop filter coefficients, and performing, based on the determining, the conversion.

Abstract: A video signal processing method comprises the steps of: receiving information for prediction of a current block; determining whether or not a merge mode is applied to the current block on the basis of the information for prediction; when a merge mode is applied to the current block, obtaining a first syntax element indicating whether or not a combined prediction is applied to the current block, wherein the combined prediction indicates a prediction mode that combines inter-prediction and intra-prediction; generating an inter-prediction block and an intra-prediction block of the current block when the first syntax element indicates that the combined prediction is applied to the current block; and generating a combined prediction block of the current block by weighted-summing the inter-prediction block and the intra-prediction block.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes prediction information for a current block in a current coded picture that is a part of a coded video sequence. The prediction information indicates a first prediction mode used for the current block. The processing circuitry determines whether a neighboring block that neighbors the current block and is reconstructed prior to the current block uses the first prediction mode. Then the processing circuitry inserts prediction information from the neighboring block into a predictor list for the first prediction mode in response to the determination that the neighboring block uses the first prediction mode. Finally the processing circuitry reconstructs the current block in accordance with the predictor list for the first prediction mode.