Abstract: In order to provide an image processing system that can generate appealing content, an image capturing system 100 generates stereoscopic form digital contents 200 including a first image that is a main camera image, and a second image that is a virtual viewpoint image, and associates the first image and the second image with a first plane 201 and a second plane 202 that configure the digital contents 200.

Abstract: Mathematical relationships between the scene geometry, camera parameters, and viewing environment are used to control stereography to obtain various results influencing the viewer's perception of 3D imagery. The methods may include setting a horizontal shift, convergence distance, and camera interaxial parameter to achieve various effects. The methods may be implemented in a computer-implemented tool for interactively modifying scene parameters during a 2D-to-3D conversion process, which may then trigger the re-rendering of the 3D content on the fly.

Abstract: A stereoscopic imager system, comprising: a sensor array comprising a first plurality of photosensors and a second plurality of photosensors spaced apart from the first plurality of photosensors by a gap, the first plurality of photosensors and the second plurality of photosensors being configured to detect ambient light in a scene; a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and a system controller coupled to the sensor array and the moving component.

Abstract: Examples are disclosed that relate to motion blur corrections for time-of-flight (ToF) depth imaging. One example provides a depth camera comprising a ToF image sensor, a logic machine, and a storage machine storing instructions executable by the logic machine to receive depth image data from the ToF image sensor, the depth image data comprising phase data and active brightness (AB) data, determine a first two-dimensional (2D) AB image corresponding to a first modulation frequency, and determine a second 2D AB image corresponding to a second modulation frequency. The instructions are further executable to determine a 2D translation based upon a comparison between the first 2D AB image and the second 2D AB image, determine corrected phase data based on the 2D translation to form corrected phase data, perform phase unwrapping on the corrected phase data to obtain a three-dimensional (3D) depth image, and output the 3D depth image.

Abstract: A system is configurable to, over a frame capture time period, selectively activate an illuminator to alternately emit light from the illuminator and refrain from emitting light from the illuminator. The system is configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each image sensor pixel of an image sensor array to enable photon detection. The plurality of sequential shutter operations generates, for each image sensor pixel of the image sensor array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations. The system is configurable to, based on a first set of binary counts of the plurality of binary counts, generate an ambient light image. The system is configurable to, based on a second set of binary counts of the plurality of binary counts, generate an illuminated image.

Abstract: A 3D display device includes a display panel, a barrier, a detector, and a controller. The display panel displays a parallax image including a first image and a second image having parallax with respect to the first image. The barrier defines a traveling direction of image light of the parallax image to generate parallax between first and second eyes of a user. The detector captures an image of a face of the user viewing the parallax image. The controller generates a first reference image by combining the first and second images different from each other based on an index defining an arrangement of the first and second images to be displayed on the display panel, causes the display panel to display the first reference image, and adjusts the index based on the image of the face of the user captured by the detector onto which the reference image is projected.

Abstract: The present disclosure relates to an information processing apparatus capable of exhibiting appropriate performance with a simpler configuration. Provided is an information processing apparatus including: a projection unit that projects visible light onto a surface in a real space; a sensor that detects a position of the visible light projected onto the surface in the real space; a display unit having optical transparency; and a control unit that controls the projection unit, the sensor, and the display unit, in which relative positions of the projection unit, the sensor, and the display unit are fixed, and the control unit displays a target image for correcting a deviation from the position of the visible light on the display unit. The present disclosure can be applied to, for example, an HMD.

Abstract: In one embodiment, a system receives pixel data from a pair of regions of an image generated by an imaging device, the pair of regions includes a first region and a second region, where the first region includes a first plurality of pixels and the second region includes a second plurality of pixels. The system determines a plurality of pixel pairs, where a pixel pair includes a first pixel from the first plurality of pixels and a second pixel from the second plurality of pixels. The system calculates a plurality of contrasts based on the plurality of pixel pairs. The system determines a contrast distribution based on the plurality of contrasts. The system calculates a value representative of a capability of the imaging device to detect contrast based on the contrast distribution. The system determines a reduction in contrast detectability of the imaging device based on the value.

Abstract: A video decoding method according to this document includes deriving a first candidate intra prediction mode based on a first neighboring block located on a left side of a current block, deriving a second candidate intra prediction mode based on a second neighboring block located on an upper side of the current block, constructing a most probable mode (MPM) list for the current block based on the first candidate intra prediction mode and the second candidate intra prediction mode, deriving an intra prediction mode for the current block based on the MPM list, generating predicted samples by performing prediction for the current block based on the intra prediction mode, and generating a reconstructed picture for the current block based on the predicted samples.

Abstract: An image decoding method performed by a decoding device according to the present document comprises the steps of: obtaining image information including an output layer set (OLS) decoded picture buffer (DPB) parameter index for a target OLS and DPB parameter information; deriving DPB parameter information for the target OLS on the basis of the OLS DPB parameter index; performing a picture management process on pictures of a DPB on the basis of the DPB parameter information for the target OLS; configuring a reference picture list for a current picture on the basis of the pictures of the DPB; and performing an inter prediction on a block in the current picture on the basis of the reference picture list.

Abstract: A video decoding method according to this document includes constructing a most probable mode (MPM) list by deriving MPM candidates for a current block based on a neighboring block adjacent to the current block, deriving an intra prediction mode for the current block based on the MPM list, generating predicted samples by performing prediction for the current block based on the intra prediction mode, and generating a reconstructed picture for the current block based on the predicted samples.

Abstract: A method of video processing includes determining, for a conversion between a video component of a video comprising a current video block and a bitstream representation of the video, that a first coding tool is used based on a rule for the current video block; and performing the conversion according to the determining, wherein the first coding tool includes transforming a representation of a visual signal between two color spaces, and where the rule specifies that a first quantization parameter (QP) offset for a luma channel of the current video block is equal to K1 and a second QP offset for a first chroma channel of the current video block is K1+O, where K1 and O are integers.

Abstract: A point cloud data transmission method according to embodiments may comprise the steps of: acquiring point cloud data; encoding geometry information including the positions of points of the point cloud data by applying inter-prediction or intra-prediction; encoding attribute information including attribute values of the points of the point cloud data on the basis of the geometry information by applying the inter-prediction or intra-prediction; and transmitting the encoded geometry information, the encoded attribute information, and signaling information.

Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus may comprise determining a current block by splitting an image, identifying whether a palette mode is applied for the current block based on a palette mode flag obtained from a bitstream, obtaining palette mode encoding information of the current block from the bitstream based on a tree type of the current block and whether the palette mode is applied for the current block, and obtaining chroma component prediction information of the current block from the bitstream based on the palette mode being not applied for the current block.

Abstract: Several systems and methods for intra-prediction estimation of video pictures are disclosed. In an embodiment, the method includes accessing four ‘N×N’ pixel blocks comprising luma-related pixels. The four ‘N×N’ pixel blocks collectively configure a ‘2N×2N’ pixel block. A first pre-determined number of candidate luma intra-prediction modes is accessed for each of the four ‘N×N’ pixel blocks. A presence of one or more luma intra-prediction modes that are common among the candidate luma intra-prediction modes of at least two of the four ‘N×N’ pixel blocks is identified. The method further includes performing, based on the identification, one of (1) selecting a principal luma intra-prediction mode for the ‘2N×2N’ pixel block and (2) limiting a partitioning size to a ‘N×N’ pixel block size for a portion of the video picture corresponding to the ‘2N×2N’ pixel block.

Abstract: An example method of video processing includes applying, in a conversion between a video comprising multiple components and a bitstream representation of the video, a deblocking filter to video blocks of the multiple components. A deblocking filter strength for the deblocking filter of each of the multiple components is determined according to a rule that specifies to use a different manner for determining the deblocking filter strength for the video blocks of each of the multiple components.

Abstract: At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a plurality of different motion prediction modes for a current block are obtained. The current block is encoded or decoded based on a combination of the plurality of different motion prediction modes with corresponding weights for a plurality of sub-blocks of the current block, wherein the combination with the corresponding weights comprising an inter prediction mode and an intra prediction mode.

Abstract: The various implementations described herein include methods and systems for coding video. In one aspect, a method includes determining whether multiple transform units are within the video block in accordance with a determination that the inter-prediction mode is enabled; and in accordance with a determination that multiple transform units are within the video block: determining a transform unit of the multiple transform units to apply a secondary transform based on a relative location of the transform unit within the video block, applying the secondary transform to the transform unit, and reconstructing/processing the video block based at least on the secondary transform.

Abstract: The present disclosure is related to systems and methods for transformation based on an intra block copy (IBC) mode. The method includes obtaining a set of candidate transformation results by performing a set of candidate transformation modes on a first block in an image. The set of candidate transformation modes include at least one of a first transformation mode, a secondary transformation mode, or a sub-block transformation mode. The method includes determining a target transformation mode for the first block based on the set of candidate transformation results.

Abstract: A method for inverse quantization of a current block of a picture is provided. The method is performed by a decoder, and the picture comprises a luminance component and a chrominance component, where the luminance component and the chrominance component are partitioned into multiple blocks. The method includes obtaining one or more existing quantization parameter (QP) values from a received bitstream, wherein the one or more existing QP values are associated with a current block in the chrominance component; determining a QP value for the current block in the chrominance component based on the one or more existing QP values; performing inverse quantization on the current block in the chrominance component using the determined QP value.

Abstract: An image encoding/decoding method and apparatus are provided. The image decoding method performed by the image decoding apparatus, according to the present disclosure, may comprise the steps of: determining whether a color space transformation is applied to residual samples of a current block; determining quantization parameter of the current block on the basis of whether the color space transformation is applied; and determining a transformation coefficient of the current block on the basis of the quantization parameter. The step of determining the quantization parameter may be performed by limiting the range of an effective value of the quantization parameter such that a value of the quantization parameter has a value less than or equal to a predetermined upper value and greater than or equal to a predetermined lower value.

Abstract: A method of decoding of a picture from a video bitstream is disclosed. The video bitstream includes a slice header of a current slice and data representing the current slice. The method comprises: obtaining a parameter used to derive a number of tiles in the current slice from the slice header when a slice address of the current slice is not an address of a last tile in the picture where the current slice located; and reconstructing the current slice using the number of tiles in the current slice and the data representing the current slice.

Abstract: A method performed by at least one processor of a video decoder includes receiving a coded video bitstream including at least one picture and one or more syntax elements encoded in accordance with multi-hypothesis arithmetic coding. The method further includes decoding each syntax element from the one or more syntax elements based on the multi-hypothesis arithmetic coding. The method further includes selecting a probability update rate from a plurality of probability update rates based on a predetermined condition, the plurality of probability update rates including a first probability update rate that is higher than a second probability update rate. The method further includes updating at least one probability model utilized in the multi-hypothesis arithmetic coding based on the selected probability update rate. The method further includes decoding at least one block in the at least one picture based on the decoded one or more syntax elements.

Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for video encoding. An encoder may receive a video input. The encoder may obtain a quantization parameter based on the video input. The encoder may derive a rice parameter based on at least one predefined threshold, a coding bit-depth, and the quantization parameter. The encoder may entropy encode a video bitstream based on the rice parameter.

Abstract: An affine motion estimation (ME) is performed on a current block to determine affine parameters of the current block in a pre-analysis stage. The affine ME is performed based on at least one of (i) a down-scaled current picture and one or more down-scaled reference pictures of the down-scaled current picture, (ii) a simplified configuration, or (iii) a fixed block size of the current block being equal to or larger than a threshold. The affine parameters of the current block determined in the pre-analysis stage are stored. Affine parameters of the current block are determined based on the affine parameters stored in the pre-analysis stage. The current block is reconstructed based on the determined affine parameters of the current block.

Abstract: An image processing method includes receiving coded image data of a video clip transmitted by an encoder, and decoding the coded image data to obtain a first video frame, key points in the first video frame, and key points in a second video frame not included in the coded image data received from the encoder. The key points represent positions of an object in the first and second video frames. The method further includes generating transforming information of motion of the object according to the key points in the first video frame and the key points in the second video frame, and reconstructing the second video frame according to the first video frame and the transforming information.

Abstract: A method comprising: receiving at least one bitstream comprising encoded video data and a message corresponding to said encoded video data and decoding said message, said message comprising for each coding tool of a plurality of coding tools used for encoding the video data, information representative of an energy consumed by a device in charge of decoding and/or displaying the encoded video data induced by said coding tool and information representative of an impact of said coding tool on a quality of the encoded video data after decoding; using the information comprised in the decoded message to select at least one coding tool of the plurality of coding tools to deactivate or modify; and, decoding the encoded video data by using a decoding process wherein the selected coding tools are deactivated or modified.

Abstract: An intra prediction method and a device using the intra prediction method are provided. The intra prediction method includes the steps of: deriving a current prediction mode as a prediction mode of a current block; constructing neighboring samples of the current block with available reference samples; filtering the available reference samples; and generating predicted samples of the current block on the basis of the filtered available reference samples,. The filtering step includes performing the filtering using the available reference sample located in the prediction direction of the current prediction mode and a predetermined number of available reference samples neighboring to the prediction direction of the current prediction mode.

Abstract: An example method includes the steps of receiving an encoded video packet including a packet header and generating a modified packet header. The modified packet header is generated by setting a first value in the packet header to indicate zero reference frames, and by setting a second value in the packet header designating an i-frame as unused for reference. The i-frame is decoded in response to the modified packet header to extract the i-frame without caching the i-frame in a decoded picture buffer. A thumbnail image is generated and includes an image from the i-frame. The thumbnail image is stored directly in memory.

Abstract: Methods, systems, and apparatuses for improved adaptation logic and content streaming are described herein. Adaptation logic may allow a client device to request differing representations of content based on at least one service metric related to requesting and/or outputting the content. The client device may receive an indication when at least one frame of the content is encoded using an adaptive resolution change. The client device may determine the at least one service metric based on the indication.

Abstract: The present disclosure is related to a method and an apparatus for generating residual signals using reference between components. The video encoding/decoding apparatus and method derive residual signals of a chroma component of a current block. In deriving the residual signals of the chroma component, the video encoding/decoding apparatus and method use the residual signals of a previously reconstructed block without transmitting residual signals of part of the chroma component of the current block.

Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus may comprise obtaining palette information and palette index prediction information of a current block from a bitstream, based on a palette mode applying for the current block, constructing a palette predictor for the current block based on the palette information and constructing a palette table for the current block based on the palette predictor, generating a palette index map for the current block based on the palette index prediction information, and decoding the current block based on the palette table and the palette index map. The palette predictor may be selectively updated based on a split structure of the current block.

Abstract: The present disclosure relates to an image processing device and method that allow reduction in coding efficiency to be suppressed. A pixel value of a chroma component is predicted by linear prediction from a pixel value of a reference image of a luma component whose pixel location is changed by using a filter, and a prediction image of the chroma component is generated. A chroma component of encoded data in which an image is encoded is decoded by using the generated prediction image. The filter is selected on a basis of information regarding a pixel location of the chroma component and information regarding a color format. The present disclosure is applicable, for example, to an image processing device, an image encoding device, an image decoding device, or the like.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media to enhance texture image delivery and processing at a client device. For example, the disclosed systems can utilize a server-side compression combination that includes, in sequential order, a first compression pass, a decompression pass, and a second compression pass. By applying this compression combination to a texture image at the server-side, the disclosed systems can leverage both GPU-friendly and network-friendly image formats. For example, at a client device, the disclosed system can instruct the client device to execute a combination of decompression-compression passes on a GPU-network-friendly image delivered over a network connection to the client device.

Abstract: The present disclosure relates to an information processing device and method capable of inhibiting an increase in a load on reproduction processing. Scalable decoding information is generated on the basis of a depth of a slice in the G-PCC content and a dependency relation between slices and is stored in the metadata area of the content file that stores the G-PCC content. Further, on the basis of the scalable decoding information stored in the metadata area of the content file, any slice of the G-PCC content is extracted from the content file and is decoded. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.

Abstract: An imaging device includes an imager; a first-type encoder; a connector unit; an information acquiring unit for acquiring information on an encoder operation mode from a second-type encoder connected to the connector unit; and a selecting unit for selecting an encoder for a record purpose and an encoder for a distribution purpose, wherein the information on the encoder operation mode contains a low-delay mode and an image quality priority mode in which an image quality is given higher priority but an encoding delay is longer than those in the low-delay mode, and the selecting unit is configured to: select, when the information on the encoder operation mode indicates the image quality priority mode, the second-type encoder for the record purpose; and select, when the information on the encoder operation mode indicates the low-delay mode, the first-type encoder for the record purpose and the second-type encoder for the distribution purpose.

Abstract: In some aspects, the disclosure is directed to methods and systems for reducing memory utilization and increasing efficiency during affine merge mode for versatile video coding by utilizing motion vectors stored in a motion data line buffer for a prediction unit of a second coding tree unit neighboring a first coding tree unit to derive control point motion vectors for the first coding tree unit.

Abstract: A decoding method is disclosed. First, context for a syntax clement associated with a current transform coefficient of a block of a picture is determined. The context is determined based on the area of said block, on the position of the current transform coefficient within the block and on the number of non-zero neighboring transform coefficients in a local template. Second, the syntax element is decoded based at least on the determined context. Advantageously, the local template depends on the shape of said block.

Abstract: A method for decoding a video according to the present invention may comprise: decoding information indicating whether a non-zero transform coefficient exists in a current block, when the information indicates that the non-zero transform coefficient exists in the current block, determining a scanning order of the current block, and decoding a transform coefficient included in the current block according to the determined scanning order.

Abstract: At least one of a vector candidate derivation unit and a merge candidate derivation unit derives a motion vector of each of multiple sub-blocks contained in a decoding target block by referring to motion vectors at multiple control points including two points at an interval which is longer than one side of the target block, and a prediction image generation unit refers to the motion vector of each sub-block to generate a prediction image.

Abstract: Video coding in accordance with an inter-intra prediction model may include coding an inter-prediction motion vector for a current block of a current frame, obtaining spatial block-context pixels oriented relative to the current block, generating an inter-prediction block, generating a corresponding set of reference block-context pixels oriented relative to the inter-prediction block, identifying inter-intra prediction parameters that correspond with minimizing error between the spatial block-context pixels and the reference block-context pixels, generating a prediction block for the current block by, for a current pixel of the current block, obtaining an inter-prediction pixel, determining a predictor for the current pixel using a combination of the inter-prediction pixel and the inter-intra prediction parameters, and including the predictor in the prediction block.

Abstract: A video encoding or decoding apparatus and method perform existing inter prediction on a current block to generate a motion vector and predicted samples. The video encoding or decoding apparatus and method generate enhanced predicted samples for the current block using a deep learning-based video prediction network (VPN) on the basis of the motion vector, the reference samples, the predicted samples, and the like to improve encoding efficiency.

Abstract: Method, apparatus and systems are disclosed. In one embodiment, a method of decoding includes obtaining a sub-block based motion prediction signal for a current block of the video; obtaining one or more spatial gradients of the sub-block based motion prediction signal or one or more motion vector difference values; obtaining a refinement signal for the current block based on the one or more obtained spatial gradients or the one or more obtained motion vector difference values; obtaining a refined motion prediction signal for the current block based on the sub-block based motion prediction signal and the refinement signal; and decoding the current block based on the refined motion prediction signal.

Abstract: The present disclosure is related to a video encoding/decoding method and an apparatus using selective transmission of subblock partitioning information. The video encoding/decoding method and apparatus selectively encode and decode the splitting direction of a subblock to reduce the overhead of signal transmission for using subblock partitioning while effectively performing intra prediction per subblock basis.

Abstract: An image decoding method according to the present invention may comprise determining an intra prediction mode of a current block, deriving reference samples of the current block, and obtaining a prediction sample of the current block using at least one of the reference samples.

Abstract: A method of video processing is described. The method includes: determining, based on a coding mode of a current video block of a video, whether a position dependent intra prediction combination (PDPC) method is used for coding the current video block based on a first rule, and performing a conversion between the current video block and a coded representation of the video according to the determining, wherein the PDPC method combines neighboring samples with a prediction signal of the current video block to generate a refined prediction signal of the current video block.

Abstract: The present invention provides a method and a device for deriving an inter-view motion merging candidate. A method for deriving an inter-view motion merging candidate, according to an embodiment of the present invention, can comprise the steps of: on the basis of encoding information of an inter-view reference block derived by means of a variation vector of a current block, determining whether or not inter-view motion merging of the current block is possible; and, if inter-view motion merging of the current block is not possible, generating an inter-view motion merging candidate of the current block by using encoding information of an adjacent block that is spatially adjacent to the inter-view reference block.

Abstract: The present disclosure is related to an intra prediction method and an apparatus using block copy based on geometric transform. The intra prediction method and apparatus derive a reference block vector at each vertex of a current block and perform a geometric transform on the reference block vectors to generate reference blocks of various shapes that are not constrained to rectangular shapes. The intra prediction method and apparatus calculate a sub-block-vector for each pixel or group of pixels of the current block using the reference block vectors.

Abstract: An image encoding/decoding method and apparatus for signaling GCI and a method of transmitting a bitstream are provided. An image decoding method according to the present disclosure may comprise obtaining first information specifying whether to constrain application of a predetermined coding tool, obtaining second information specifying whether to apply the predetermined coding tool, and reconstructing a current picture based on the second information. A value of the second information may be determined based on a value of the first information, and the predetermined coding tool may comprise at least one of weighted prediction, explicit signaling of a scaling list for a transform coefficient or disabling of in-loop filtering at a virtual boundary.

Abstract: An image encoding/decoding method and apparatus for signaling a VPS and a recording medium storing a bitstream are provided. An image decoding method may comprise obtaining first information indicating whether each output layer set (OLS) specified by a video parameter set (VPS) includes only one layer, obtaining second information indicating the number of decoded picture buffer (DPB) parameter syntax structures in the VPS, based on the first information, obtaining the DPB parameter syntax structures in the VPS based on the second information, and managing a DPB based on the DPB parameter syntax structures.