Abstract: A transmission device including circuitry is provided. The circuitry is configured to process transmission image data to obtain first image data for acquisition of image data of a first frame rate and a first resolution, second image data for acquisition of image data of a second frame rate and the first resolution based on the first image data, third image data for acquisition of image data of the first frame rate and a second resolution based on the first image data, and fourth image data for acquisition of image data of the second frame rate and the second resolution based on the first, second, and third image data. The circuitry is configured to transmit a description and a video stream. The description indicates a first representation corresponding to the base layer and a second representation corresponding to the enhancement layer.

Abstract: An encoder includes circuitry and memory coupled to the circuitry. In operation, the circuitry: encodes information for deriving a parameter into a header of a bitstream; filters reconstructed samples in a first image using a filtering process, to generate a second image; determines whether the parameter has a predefined value; encodes a third image using the second image when the parameter has the predefined value; and encodes the third image using the first image when the parameter does not have the predefined value.

Abstract: Devices, systems and methods for digital video coding, which includes simplified cross-component prediction, are provided. In a representative aspect, a method for video coding includes receiving a bitstream representation of a current block of video data including at least one luma component and at least one chroma component, predicting, using a linear model, a first set of samples of the at least one chroma component based on a second set of samples that is selected by sub-sampling samples of the at least one luma component, and processing, based on the first and second sets of samples, the bitstream representation to generate the current block. In another representative aspect, the second set of samples are neighboring samples of the current block and are used for an intra prediction mode of the at least one luma component.

Abstract: The present technology relates to an imaging device, an imaging method, and a program capable of setting a resolution based on a distance to a subject. A control unit which changes a resolution of a captured image on the basis of distance information, corresponding to the captured image, regarding a detected distance to a subject included in the image is included. The control unit changes a resolution of a portion of a region of the captured image on the basis of the distance information. The portion of the region is a region distant from another region. The control unit changes the resolution of the portion of the region such that the portion of the region becomes higher than a resolution of another region.

Abstract: A display device according to an embodiment includes a plurality of display panels arranged adjacent to each other and each display panel including first pixels in the display panel and second pixels in the display panel and adjacent to a boundary area of the display panels, and a luminance correction unit configured to generate a correction grayscale value for the second pixel. The luminance correction unit includes an image mapping unit configured to map a captured luminance image to a unit pixel image, a de-blurring unit configured to perform a de-blurring operation on the mapped unit pixel image to calculate a correction luminance value for the second pixel, and a correction unit configured to calculate a correction grayscale value for the second pixel corresponding to the calculated correction luminance value of the second pixel.

Abstract: A computer-readable recording medium storing a program that causes a computer to execute a process, the process includes specifying occurrence frequencies of respective gradation values with regard to pixels included in image data and represented by gradation values of a predetermined bit count; extracting a predetermined number of gradation values from a gradation value having a high occurrence frequency in a descending order; generating correspondence information for performing bit conversion of the extracted gradation values into coded values of a bit count in accordance with the predetermined number; and encoding the image data by performing bit conversion of first pixels having any one of the predetermined number of gradation values among the pixels based on the correspondence information, and performing bit conversion of second pixels having any one of gradation values other than the predetermined number of gradation values among the pixels.

Abstract: A processor-implemented method of generating a three-dimensional (3D) volumetric video with an overlay representing visibility counts per pixel of a texture atlas, associated with a viewer telemetry data is provided. The method includes (i) capturing the viewer telemetry data, (ii) determining a visibility of each pixel in the texture atlas associated with a 3D content based on the viewer telemetry data, (iii) generating at least one visibility counts per pixel of the texture atlas based on the visibility of each pixel in the texture atlas, and (iv) generating one of: the 3D volumetric video with the overlay of at least one heat map associated with the viewer telemetry data, using the at least one visibility counts per pixel and a curated selection of the 3D volumetric content based on the viewer telemetry data, using the visibility counts per pixel.

Abstract: Disclosed is an image processing apparatus that includes one or more processors; and a memory storing instructions, which when executed by the one or more processors, cause the one or more processors to: generate distribution data indicating a frequency distribution of horizontal distance values of a range image based on the range image having pixel values according to distance of an object in a plurality of captured images; detect an object based on the distribution data with respect to a range image; predict a predicted position of the object in a current frame based on the distribution data with respect to range images of a plurality of previous frames; and integrate a plurality of objects detected by the detector based on the predicted position to track an integrated object in subsequent frames.

Abstract: Certain embodiments involve generating recolored collages. For example, a method includes receiving a first image from and a second image. The method also includes grouping color hues within the first image into a first color hue cluster, and grouping color hues within the second image into a second color hue cluster. Further, the method includes determining that a first hue center of the first color hue cluster is within a distance range of a second hue center of the second color hue cluster. Additionally, the method includes generating a first recolored image by recoloring pixels of the first image having color hues outside the first color hue cluster and generating a second recolored image by recoloring pixels of the second image having color hues outside the second color hue cluster. Moreover, the method includes outputting a recolored collage including the first recolored image and the second recolored image.

Abstract: A macro block size determining unit 1 determines the size of each macro block on a frame-by-frame basis. A macro block dividing unit 2 divides an inputted image into macro blocks each having the size determined by the macro block size determining unit 1. A macro block coding unit 3 determines a coding mode for each of the macro blocks divided by the macro block dividing unit 2, and codes pixel values in each of the macro blocks in the determined coding mode.

Abstract: Systems and methods for reducing, with minimal loss, optical sensor data to be conveyed to another system for processing. An eye tracking device, such as a head-mounted display (HMD), includes a sensor and circuitry. The sensor generates image data of an eye. The circuitry receives the image data, and assigns pixels of the image data to a feature region of the eye by comparing pixel values of the pixels to a threshold value. A feature region refers to an eye region of interest for eye tracking, such as a pupil or glint. The circuitry generates encoded image data by apply an encoding algorithm, such as a run-length encoding algorithm or contour encoding algorithm, to the image data for the pixels of the feature region. The circuitry transmits the encoded image data, having a smaller data size than the image data received from the sensor, for gaze contingent content rendering.

Abstract: A multi-branch neural network generates segmentation data for a received image. The received image is provided to a high-level branch and a low-level branch. Based on the received image, the high-level branch generates a feature map of high-level image features, and the low-level branch generates a feature map of low-level image features. The high-level feature map and the low-level feature map are combined to generate a combined feature map. The combined feature map is provided to a boundary refinement module that includes a dense-connection neural network, which generates segmentation data for the received image, based on the combined feature map.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus includes processing circuitry for video decoding. The processing circuitry decodes prediction information for a first block in a current picture from a coded video bitstream. The prediction information is indicative of an inter prediction mode that determines a first motion vector for the first block from a motion vector predictor. The processing circuitry then constructs, in responses to the inter prediction mode, a candidate list of candidate motion vector predictors with an exclusion from a second block that requires an operation to finalize a second motion vector for the second block in a motion vector derivation. Then, the processing circuitry determines, based on the candidate list, the first motion vector for the first block, and reconstructs the first block according to the first motion vector for the first block.

Abstract: The present disclosure relates to a frame grabber, an image processing system, and an image processing method. A frame grabber according to an embodiment of the inventive concept includes a plurality of decoders, a plurality of image controllers, a plurality of memories, a synchronization controller, and a synchronization memory. The plurality of decoders generate a plurality of image data by decoding a plurality of image signals. The plurality of image controllers generate a plurality of pixel data and a plurality of frame information data on the basis of the plurality of image data. The plurality of memories store the plurality of pixel data. The synchronization controller receives the plurality of frame information data, and generates synchronization data on the basis of the plurality of frame information data. The synchronization memory stores the frame information data and the synchronization data.

Abstract: The present invention relates to specification of a tile capable of being independently processed to process a certain area at high speed in encoding and decoding of tiles resulting from division of an image in hierarchical coding of the image. An image encoding apparatus that performs the hierarchical coding of an input image with multiple layers includes an acquiring unit and an encoding unit. The acquiring unit acquires a first image generated from the input image and a second image having resolution different from that of the first image. In the encoding of a first area in the first image acquired by the acquiring unit, the encoding unit performs the encoding using a second area existing at the relatively same position as that of the first area in the first image in the second image as a reference image.

Abstract: A 3D model can be modeled using “pattern-instance” representation, wherein an instance component may be represented as transformation (for example, rotation, translation, and scaling) of a pattern. Quantization errors may be introduced when encoding rotation information, causing different vertex coordinate errors at different 5 vertices of an instance. To efficiently compensate the vertex coordinate errors, the encoder decides a quantization parameter for compensating a vertex coordinate error. The quantization parameter is signaled in the bitstream as a quantization index. The quantization index, a quantization table the indicates a mapping between quantization indices and quantization parameters, and vertex coordinate errors are 10 encoded into a bitstream. The quantization table may be built based on statistical data. At the decoder, the vertex coordinate error is decoded based on a quantization parameter, which is determined from a received quantization index.

Abstract: The present invention relates to an inter-layer prediction method, and an encoder and a decoder using the same, the inter-layer prediction method including specifying a reference block in a reference layer and predicting a current block in a current layer using information on the reference block, wherein the specifying of the reference block includes specifying the reference block on the basis of a reference position which is a position in the reference layer corresponding to a current position in the current layer for specifying the current block.

Abstract: A video decoding method using an inter prediction, includes: reconstructing a first differential motion vector and a second differential motion vector of a current block by decoding encoded data; deriving a first predicted motion vector and a second predicted motion vector of the current block from one or more neighboring blocks of the current block; generating a first motion vector of the current block by adding the first candidate motion vector to the first differential motion vector, and a second motion vector of the current block by adding the second candidate motion vector to the second differential motion vector; generating a predicted block of the current block by using the first and second motion vectors; reconstructing a residual block by decoding residual signals included in the encoded data; and adding each pixel value of the predicted block to a corresponding pixel value of the residual block.

Abstract: A picture coding apparatus includes a motion vector estimation unit and a motion compensation unit. The motion vector estimation unit selects one method for deriving a motion vector of a block to be motion-compensated, depending on a motion vector of a block located in a corner of a decoded macroblock from among a group of blocks that compose the decoded macroblock corresponding to the current macroblock to be coded and determines the motion vector derived by the selected method for derivation to be a candidate of the motion vector of the current macroblock to be coded. The motion compensation unit generates a predictive image of the block to be motion-compensated based on the estimated motion vector.

Abstract: A picture coding apparatus includes a motion vector estimation unit and a motion compensation unit. The motion vector estimation unit selects one method for deriving a motion vector of a block to be motion-compensated, depending on a motion vector of a block located in a corner of a decoded macroblock from among a group of blocks that compose the decoded macroblock corresponding to the current macroblock to be coded and determines the motion vector derived by the selected method for derivation to be a candidate of the motion vector of the current macroblock to be coded. The motion compensation unit generates a predictive image of the block to be motion-compensated based on the estimated motion vector.

Abstract: Changes in image exposure setting may be compensated by creating a table of aggregate differences between corresponding pixels in two images and applying the table of aggregate differences to a portion of one of the two images. The images may be in any color space for visible light, or images not of visible light, such as infrared or depth images. In various configurations, the differences may be aggregated by averaging the differences for pixels of a certain value in one of the two images.

Abstract: Methods and arrangements involving portable devices, such as smartphones and tablet computers, are disclosed. One particular arrangement concerns a software program that is launched following detection of audio content performed by a first musical artist. A phone can be provided with plural such software programs, tailored to respond to different types of detected content. Another aspect of the disclosed technology enables a creator of content to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. A great variety of other features and arrangements are also detailed.

Abstract: A picture coding apparatus includes a motion vector estimation unit and a motion compensation unit. The motion vector estimation unit selects one method for deriving a motion vector of a block to be motion-compensated, depending on a motion vector of a block located in a corner of a decoded macroblock from among a group of blocks that compose the decoded macroblock corresponding to the current macroblock to be coded and determines the motion vector derived by the selected method for derivation to be a candidate of the motion vector of the current macroblock to be coded. The motion compensation unit generates a predictive image of the block to be motion-compensated based on the estimated motion vector.

Abstract: A method for padding interlaced texture information on a reference VOP to perform a motion estimation detects whether said each texture macroblock of the reference VOP is a boundary block or not. After the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof by using a horizontal repetitive padding, a transparent row padding and a transparent field padding sequentially, an undefined adjacent block is expanded based on the extrapolated boundary block.

Abstract: A method for padding interlaced texture information on a reference VOP to perform a motion estimation detects whether said each texture macroblock of the reference VOP is a boundary block or not. After the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof by using a horizontal repetitive padding, a transparent row padding and a transparent field padding sequentially, an undefined adjacent block is expanded based on the extrapolated boundary block.

Abstract: A method and concomitant apparatus for compressing, multiplexing and, in optional embodiments, encrypting, transporting, decrypting, decompressing and presenting high quality video information in a manner that substantially preserves the fidelity of the video information in a system utilizing standard quality circuits to implement high quality compression, transport and decompression.

Abstract: A method for padding interlaced texture information on a reference VOP to perform a motion estimation detects whether said each texture macroblock of the reference VOP is a boundary block or not. After the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof by using a horizontal repetitive padding, a transparent row padding and a transparent field padding sequentially, an undefined adjacent block is expanded based on the extrapolated boundary block.

Abstract: A method for padding interlaced texture information on a reference VOP to perform a motion estimation detects whether said each texture macroblock of the reference VOP is a boundary block or not. After the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof by using a horizontal repetitive padding, a transparent row padding and a transparent field padding sequentially, an undefined adjacent block is expanded based on the extrapolated boundary block.

Abstract: A method for padding interlaced texture information on a reference VOP to perform a motion estimation detects whether said each texture macroblock of the reference VOP is a boundary block or not. After the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof by using a horizontal repetitive padding, a transparent row padding and a transparent field padding sequentially, an undefined adjacent block is expanded based on the extrapolated boundary block.

Abstract: A method for padding interlaced texture information on a reference VOP to perform a motion estimation detects whether said each texture macroblock of the reference VOP is a boundary block or not. After the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof by using a horizontal repetitive padding, a transparent row padding and a transparent field padding sequentially, an undefined adjacent block is expanded based on the extrapolated boundary block.

Abstract: A method and apparatus for preserving the dynamic range of a relatively high dynamic range information stream, illustratively a high resolution video signal, subjected to a relatively low dynamic range encoding and/or transport process(es). A relatively high dynamic range information stream is subjected to a segmentation and remapping process whereby each segment is remapped to the relatively low dynamic range appropriate to the encoding and/or transport process(es) utilized. An auxiliary information stream includes segment and associated remapping information such that the initial, relatively high dynamic range information stream may be recovered in a post-encoding (i.e. decoding) or post-transport (i.e., receiving) process.