Abstract: There is provided an information processing apparatus and a method that allow for suppression of a decrease in encoding efficiency. Correlation information is generated that results from encoding of voxel data resulting from quantization of point cloud data with use of correlation of a distribution pattern of values of the voxel data; the generated correlation information is encoded; and a bit stream including the correlation information is generated. The present disclosure is applicable to an information processing apparatus, an image processing apparatus, an electronic device, an information processing method, a program, or the like, for example.

Abstract: An eye tracking device includes at least one light source configured to irradiate detection light for eye tracking to at least one eyeball of a subject; at least one imager configured to capture image of the at least one eyeball; a position detecting unit configured to detect a position of a pupil center of the at least one eyeball and a position of a corneal reflex center of the at least one eyeball from the captured image; a gaze determining unit configured to determine whether the subject is gazing at a target position based on the position of the pupil center and the position of the corneal reflex center; and a calibration unit configured to perform calibration for the eye tracking based on the captured image when the gaze determining unit determines that the target position is gazed at by the subject.

Abstract: This disclosure describes ways in which to incorporate bit depth information for determining one or more deblocking control parameters. A method of processing video data may include determining one or more initial deblocking control parameters based on a stored parameter and a bit depth of samples of a current block of the video data, determining an adjustment value by which to adjust the one or more initial deblocking control parameters based on the bit depth of the samples of the current block, determining one or more deblocking control parameters based on the adjustment value and the one or more initial deblock control parameters, and deblock filtering one or more samples of the current block based on the determined one or more deblocking control parameters.

Abstract: Devices, systems and methods for asymmetric weighted bi-predictive merging in video coding are described. In a representative aspect, a method for decoding video data includes determining that a current video block of the video data is predicted from an asymmetric bi-predictive merge candidate, wherein different weights are used for a first reference block and a second reference block, and making, based on the determination, a determination between enabling and disabling a coding tool for the current video block. In a case that the current video block is predicted from an asymmetric bi-predictive merge candidate, the coding tool is not applied to the current video block.

Abstract: Disclosed is an image decoding method using the correlation between color components to perform into prediction of chrominance components. Here, the image decoding method using the correlation between color components to perform intra prediction of chrominance components comprises the steps of: checking image data and a prediction mode in a bitstream; generating a prediction block according to a reconstructed prediction mode; determining compensation settings according to the size of a current block and the reconstructed prediction mode; compensating the prediction block according to the determined compensation settings; and reconstructing the current block by adding reconstructed image data to the prediction block.

Abstract: A video transmission method includes obtaining a target video data segment, obtaining t reference data sets, encoding the target video data segment using each reference data set to obtain t encoded data blocks that are in a one-to-one correspondence with the t reference data sets, where any k encoded data blocks in the t encoded data blocks and k reference data sets that are in the t reference data sets and that are in a one-to-one correspondence with the any k encoded data blocks can construct an equation set matrix, and data of a solution matrix of the equation set matrix is data of the target video data segment, and sending t first reference data groups to a video decoding device using n front-end servers, where each first reference data group includes one encoded data block and a corresponding reference data set.

Abstract: The present disclosure provides picture encoding and decoding methods, picture encoding and decoding devices as well as a decoder and an encoder. The picture decoding method includes: parsing a video bitstream to obtain candidate reshaping parameters from a picture-layer and/or slice-layer data unit of the video bitstream, and determining a reshaping parameter used for reshaping a reconstructed picture according to the obtained candidate reshaping parameters; and reshaping the reconstructed picture by using the reshaping parameter. The reconstructed picture is a picture obtained by decoding the video bitstream before performing the reshaping.

Abstract: A system and method for tracking an object within a surgical field are described. A system may include a lighting component to illuminate a surgical field, and a camera device to capture an image of a tracked device within the surgical field. The system may include a rotational component configured to rotate with respect to the lighting component. The camera device may couple to the rotational component to rotate with respect to the lighting component, such as in response to an obstruction of a tracked object being detected.

Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.

Abstract: An image processing apparatus includes: an image obtaining unit configured to obtain images based on image capturing by a plurality of cameras capturing an imaging area in a plurality of directions; an information obtaining unit configured to obtain viewpoint information that indicates a virtual viewpoint; and a generation unit configured to generate a virtual viewpoint image based on the images obtained by the image obtaining unit and the viewpoint information obtained by the information obtaining unit, so that in the virtual viewpoint image, transparency of an object at a position that shields an object of interest determined among a plurality of objects positioned in the imaging area is higher than transparency of an object at a position that does not shield the object of interest.

Abstract: A camera monitor system includes: a capturing device; a displaying device; a detecting device detecting at least one of a state of an engine switch of a vehicle, a state of an engine, a state of a gear shift, an open/closed state of a door, and a seated state of a driver; and a control device controlling consumed power by the capturing device and the displaying device on the basis of at least one type of detection output of the detecting device. The control device controls at least one of the capturing device and the displaying device to a low power consumption state when a specified time elapses since the detection output of the detecting device is changed.

Abstract: A method for encoding at least one matrix of image views obtained from data acquired by a plenoptic camera is disclosed. Image views of the matrix of image views are partitioned into blocks. For a given image view of the at least one matrix of views, the method includes obtaining at least one block to be encoded and a matching block, wherein a difference between the at least one block to be encoded and the matching block fulfills a block matching criterion; determining a residual block regarding the at least one block to be encoded and the matching block, the determining using modified pixels of the at least one block to be encoded and modified pixels of the matching block according to flux variation parameters associated with a pixel sensor of the plenoptic camera; and encoding the residual block.

Abstract: An endoscope includes an image pickup device inserted into a through hole in a housing, in which the image pickup device includes an optical unit including a distal end lens and optical members, and an image pickup unit, the distal end lens is fixed to a distal end portion of the through hole, the optical members are held by a lens frame, the lens frame being inserted into the through hole, and a part of the lens frame being bonded to the through hole, and the image pickup unit includes a unit frame fixed to the lens frame, a front portion of the unit frame being inserted into the through hole and being bonded to the through hole, and an outer surface of a rear portion of the unit frame including stoppers to which a jig is to be fixed, the rear portion not being inserted into the through hole.

Abstract: An image capturing device, image capturing system, and image processing method, each of which: obtains a video image of an object; converts a wide-angle video image to generate a low-definition, wide-angle image; applies projection transformation to a part of the wide-angle video image to generate a high-definition, narrow-angle video image in different projection; combines each frame of the low-definition, wide-angle video image and a corresponding frame of the high-definition, narrow-angle video image, into one frame data while reducing a resolution of each video image, to generate a combined video image; transmits the combined video image for display at a communication terminal; in response to a request from the communication terminal, applies projection transformation to a part of a frame of the wide-angle video image to generate an ultra-high-definition, narrow-angle still image in different projection; and transmits the ultra-high-definition, narrow-angle still image for display at the communication ter

Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).

Abstract: The multi sample prediction method of the present invention comprises the steps of: determining a sample group consisting of a plurality of samples inside a decoding target block; determining a representative position corresponding to the sample group, inside the decoding target block; determining a representative prediction value for the sample group, on the basis of the determined representative position; and determining the determined representative prediction value as the final prediction value for each of the plurality of samples making up the sample group. The present invention enhances efficiency in encoding/decoding and reduces complexity thereof.

Abstract: An imaging and display device for a vehicle includes: a display unit configured to display a captured image which is obtained through image capturing by an imaging unit that images a rear side of the vehicle; and a control unit configured to perform view angle switching control of switching an angle of view of the captured image displayed on the display unit to a wider angle than a current angle of view when a predetermined wide-angle condition is satisfied as a distance between an object on the rear side of the vehicle and the vehicle decreases and switching the angle of view to an original angle of view when a predetermined return condition for returning to the original angle of view is satisfied.

Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a first coded tile or sub-picture track and a second coded tile or sub-picture track are obtained. The first and second coded tile or sub-picture tracks represent a different spatial part of an input video sequence and have the same width and height in pixels. An indication of a first group of tile or sub-picture tracks that are alternatives for extraction is provided. The first group of tile or sub-picture tracks comprise the first and second coded tile or sub-picture tracks. An extractor track comprising a sample corresponding to a coded picture is created. The sample comprises an extractor, the extractor comprises a sample constructor comprising a reference to the first group of tile or sub-picture tracks.

Abstract: A communication vehicle system or platform that provides for the integration of multiple audio, visual, telecommunications, thermal, radiological, chemical and biological data detection and/or communication devices. The communication vehicle can be configured for providing mobile communications and surveillance in an environment in which the surrounding communications and/or power infrastructure has been damaged or is non-existent. For example, the vehicle can be deployed to the scene of a disaster or emergency. Accordingly, the mobility of the preferred communication vehicle can enhance and extend the reach of any emergency operations center. Other possible applications include law enforcement surveillance; tactical military command and control; weather and storm chasing; homeland security search and rescue; forward deployment monitoring, news agencies and border patrol.

Abstract: Embedded Codec (EBC) circuitry for image block coding based on pixel-domain pre-processing operations on image block is provided. The EBC circuitry includes memory that stores a first image block and encoder circuitry that computes a first sum of absolute differences (SAD) from a first prediction block of row-wise residual values and a second SAD from a second prediction block of column-wise residual values in pixel-domain. The encoder circuitry selects a residual prediction type from a set of residual prediction types as an optimal residual prediction type and a set of quantization parameters as optimal quantization parameters for each of a first encoding mode and a second encoding mode. The encoder circuitry generates a set of bit-streams of encoded first image block in the first encoding mode and the second encoding mode, respectively, based on the selected residual prediction type and the selected set of quantization parameters.