Abstract: An image processing device and an image processing method for generating a celestial sphere image are provided such that the pixels near the poles of the sphere are kept from increasing in density when the image is mapped to the sphere surface. An encoder encodes, with respect to an omnidirectional image generated by equidistant cylindrical projection to include a top image, a middle image, and a bottom image in a vertical direction, the middle image into an encoded stream at a high resolution, and the top image and the bottom image into encoded streams at a resolution lower than the high resolution in systems including image display systems.

Abstract: The present disclosure relates to a generation device and a generation method, and a reproduction device and a reproduction method enabled to provide a mapping that is applicable to an arbitrary mapping method and in which high resolution is set in a viewing direction. The generation device includes a normalization unit that converts a first vector that maps a 360-degree image onto a predetermined 3D model into a second vector of a 3D model of a unit sphere. The present disclosure can be applied to, for example, a generation device that generates a 360-degree image from captured images in six directions, and generates an encoded stream in which high resolution is set in a predetermined direction of the 360-degree image, and the like.

Abstract: There is provided an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image of an omnidirectional image and a depth image in which a pixel value of each of pixels is given by a value indicative of a distance of a straight line from a viewpoint of the texture image to an imaging object at each of the pixels and a second layer image including a texture image in an occlusion region at a viewpoint of the first layer image and a depth image corresponding to the texture image in the occlusion region. Applicable to home server generation of a display image of a predetermined viewpoint from an omnidirectional image.

Abstract: The present disclosure relates to an image processing apparatus and an image processing method which make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A drawing section generates a texture image of a predetermined viewpoint using a texture image obtained by perspectively projecting, to a perspective projection face perpendicular to a sight line direction heading from each of two viewpoints which are opposed to each other across a center of a polygon, toward the center of the polygon, a rear face of the polygon and a depth image corresponding to the texture image of each of the viewpoints. The present disclosure can be applied, for example, to a display apparatus and the like.

Abstract: There is provided an encoder that enables an image of a field-of-view range of a user to be displayed immediately. The encoder encodes, for a pair of opposite surfaces among a plurality of surfaces of a model for an omnidirectional image, a first composite image obtained by combining an omnidirectional image of a first surface of a high resolution and an omnidirectional image of a second surface of a resolution lower than the high resolution and a second composite image obtained by combining an omnidirectional image of the second surface of the high resolution and an omnidirectional image of the first surface of a low resolution. For example, the present disclosure can be applied to an image display system or the like.

Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: The present disclosure relates to a file generation device, a file generation method, a reproducing device, and a reproducing method capable of identifying images used for generating an omnidirectional image. An MPD file generation section sets identification information for identifying captured images used for generating an omnidirectional image generated by mapping the captured images onto a 3D model. The present disclosure is applicable to a file generation device or the like generating segment files of an omnidirectional image delivered using, for example, MPEG-DASH (Moving Picture Experts Group phase-Dynamic Adaptive Streaming over HTTP).

Abstract: A sound source setting section and a listening setting section are each configured to have a parameter setting section, a display section, and an arrangement relocation section on a placing surface of a placing table in real space, the arrangement relocation section allowing the source setting and listening sections to relocate on the placing surface. A reflecting member to which a reflecting characteristic is assigned is configured to be placeable on the placing table. A mixing process section performs a mixing process and also generates an image at the position, in a virtual space, of the sound source setting section relative to the listening setting section, the image having a texture indicative of a sound source assigned to the sound source setting section. Sound mixing with respect to a free listening point is thus performed easily.

Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image at a first viewpoint and a second layer image including a texture image and a depth image at a second viewpoint different from the first viewpoint in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied, for example, to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.

Abstract: There is provided a generation apparatus, a generation method, a reproduction apparatus, and a reproduction method by which a display image generated by use of an omnidirectional image is made approximately uniform in image quality in all visual line directions. A down-conversion part down-converts an omnidirectional image. A perspective projection part generates multiple images by projecting on multiple two-dimensional planes the omnidirectional image mapped onto a 3D model. This disclosure may be applied, for example, to generation apparatuses that generate an omnidirectional image from captured images in six directions so as to generate low- and high-resolution streams of the omnidirectional image.

Abstract: There is provided an image processing apparatus and an image processing method that can follow a fast movement of a virtual point to change a high-precision image. A position correction unit corrects a three-dimensional position of a point of a boundary of an occlusion area among a plurality of points, the three-dimensional position being included in three-dimensional data including three-dimensional positions and color information of the plurality of points, the three-dimensional data being generated from color image data and depth image data from a predetermined viewpoint. The present disclosure can be applied to, for example, an image processing apparatus or the like that generates color image data from a virtual viewpoint on the basis of color image data and depth image data from a predetermined viewpoint.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method which are capable of recognizing the continuity of ends of an image. A file generating apparatus sets continuity information representing the continuity of ends of an entire celestial sphere image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH (Moving Picture Experts Group phase-Dynamic Adaptive Streaming over HTTP), for example.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: There is provided an encoder that enables an image of a field-of-view range of a user to be displayed immediately. The encoder encodes, for a pair of opposite surfaces among a plurality of surfaces of a model for an omnidirectional image, a first composite image obtained by combining an omnidirectional image of a first surface of a high resolution and an omnidirectional image of a second surface of a resolution lower than the high resolution and a second composite image obtained by combining an omnidirectional image of the second surface of the high resolution and an omnidirectional image of the first surface of a low resolution. For example, the present disclosure can be applied to an image display system or the like.

Abstract: The present disclosure relates to an image processing device and an image processing method for generating a celestial sphere image such that the pixels near the poles of the sphere are kept from increasing in density when the image is mapped to the sphere surface. An encoder encodes, with respect to an omnidirectional image generated by equidistant cylindrical projection to include a top image, a middle image, and a bottom image in a vertical direction, the middle image into an encoded stream at a high resolution, and the top image and the bottom image into encoded streams at a resolution lower than the high resolution. This disclosure is applicable to image display systems, among others.

Abstract: The present disclosure relates to an image processing device and an image processing method for instantaneously displaying an image of a user's field of view. An encoder encodes a celestial sphere image of a cube formed by images of multiple planes generated from omnidirectional images, the encoding being performed plane by plane at a high resolution, to generate a high-resolution encoded stream corresponding to each of the planes. The encoder further encodes, at a low resolution, the celestial sphere image to generate a low-resolution encoded stream. The present disclosure may be applied, for example, to image display systems that generate a celestial sphere image so as to display an image of the user's field of view derived therefrom.

Abstract: The present disclosure relates to an image processing device and a method thereof which enable a high image quality process with higher efficiency. A decoding section outputs, in addition to a decoded image, hierarchical block split information of a CU, a PU, and a TU to an image processing section as motion vector information and image split information that are encoded information included in a bit stream used in decoding. The image processing section specifies a dynamic body area from the decoded image supplied from the decoding section using the hierarchical block split information that is the encoded information from the decoding section, and performs a high image quality process. The present disclosure can be applied to, for example, an image processing device which performs a high image quality process on a decoded image that has been decoded.

Abstract: An image processing apparatus includes a setting section that sets a display region in an image region having a plurality of images lined up therein, on the basis of instruction information, a correction section that corrects the display region which is set by the setting section so as to reduce the number of images included in the display region, and a supply section that selects and supplies bit streams of the images included in the display region which is corrected by the correction section, from respective bit streams of the plurality of images which are encoded independently of each other.

Abstract: Provided is an image processing device including a disparity detector configured to receive a plurality of 3D images and detect disparity of each of the 3D images, a disparity analyzer configured to generate statistical information about disparity of each 3D image using the disparity of each 3D image detected by the disparity detector, and a disparity controller configured to convert the disparity using the statistical information about disparity of each 3D image generated by the disparity analyzer in such a manner that the 3D images are not overlapped so that a range of the disparity is within a predetermined range.