Abstract: The present technology relates to an image processing apparatus and a file generation apparatus that make it possible to appropriately reproduce a BV content. An image processing apparatus includes: a file acquisition unit that acquires a file having a management region where information for management of a 3D object content is stored and a data region where a track in which streams included in the 3D object content are stored is stored, group information for selection, from a plurality of the streams included in the 3D object content, of the stream appropriate for reproduction of the 3D object content being stored in the management region; and a file processor that selects a plurality of the streams to be used for reproduction of the 3D object content on the basis of the group information. The present technology is applicable to a client apparatus.

Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: A device and method capable of performing image following type audio control or image non-following type audio control are implemented. Images in different directions are selectively displayed on the display unit, and an output audio is controlled in accordance with an image display. A data processing unit executes image following type audio control of moving an audio source direction in accordance with movement of the display image of the display unit and image non-following type audio control of not moving the audio source direction in accordance with the movement of an image in units of individual controllable audio elements. The data processing unit acquires audio control information from an MP4 file or a media presentation description (MPD) file and executes either the image following type audio control or the image non-following type audio control in accordance with the acquired audio control information in units of individual controllable audio elements.

Abstract: A current status information communication unit acquires by communication, current status information of a communication partner who is a person shown in a free viewpoint time shift video being reproduced, and a current status information presentation unit presents the current status information of the communication partner to a viewer viewing the free viewpoint time shift video. Furthermore, when the viewer attempts to communicate with the communication partner, the current status information acquisition unit acquires the current status information of the viewer, and the current status information of the viewer is transmitted to the communication partner.

Abstract: There is provided an image processing apparatus and method, a file generation apparatus and method, and a program that enable a suitable occlusion image to be obtained. The image processing apparatus includes an MPD file processing unit configured to select an occlusion image to be acquired, on the basis of information regarding a viewpoint position of the occlusion image included in an MPD file, from among a plurality of the occlusion images indicated by the MPD file. The present technology can be applied to a client device.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method, and a program that can signal region information of a full sphere picture in a more variety of projection formats. The region information expresses a region on a spherical surface by signaling a plurality of vertexes on the spherical surface and by connecting the vertexes by shortest distances on the spherical surface. Alternatively, the region information expresses a region on a spherical surface by signaling surface regions in accordance with a number of surfaces, the surface regions being formed by signaling a plurality of vertexes on the spherical surface and by connecting the vertexes by shortest distances on the spherical surface. The present technology is applicable to a distribution system that performs network distribution of the full sphere picture by MPEG-DASH, for example.

Abstract: In an information processing device including a display unit that is able to selectively display a multi-directional video and a data processing unit that executes video display control, the data processing unit applies a device-correspondent video display scheme recorded in video display control information and executes the video display process. The video display control information defines a type-based display scheme optimum for each type of information processing device executing a video display process. The data processing unit applies the display scheme associated with a type matching the type of the own device and executes the video display process.

Abstract: The present disclosure relates an information processing apparatus, an information processing method, a program, and a communication system that enable smoother communication. A current status information communication unit acquires by communication, current status information of a communication partner who is a person shown in a free viewpoint time shift video being reproduced, and a current status information presentation unit presents the current status information of the communication partner to a viewer viewing the free viewpoint time shift video. Furthermore, when the viewer attempts to communicate with the communication partner, the current status information acquisition unit acquires the current status information of the viewer, and the current status information of the viewer is transmitted to the communication partner. The present technology can be applied to, for example, a communication system capable of communicating via a free viewpoint time shift video.

Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: The present disclosure relates to a file generation device, a file generation method, a reproducing device, and a reproducing method capable of identifying images used for generating an omnidirectional image. An MPD file generation section sets identification information for identifying captured images used for generating an omnidirectional image generated by mapping the captured images onto a 3D model. The present disclosure is applicable to a file generation device or the like generating segment files of an omnidirectional image delivered using, for example, MPEG-DASH (Moving Picture Experts Group phase-Dynamic Adaptive Streaming over HTTP).

Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.

Abstract: Provided is an image encoding device including circuitry configured to generate a file with clean random access (CRA) information, which identifies CRA pictures in the image and which is set in a header region of a file that includes the header region and a data region within which a series of encoded image data associated with actual data of the image is stored, wherein the file is an MP4 format file, wherein the CRA information is sample group information grouping a plurality of CRA pictures, wherein the CRA information includes previous picture information used to identify a previous picture which is previous to each CRA picture in a presentation order and is not encoded normally at a time of random access to the CRA picture, and wherein output of the previous picture from the image encoding device is skipped based on the previous picture information.

Abstract: Captured images acquired by a plurality of imaging units are output to a captured image combining unit, which generates a composite image by joining the captured images in accordance with composite setting information generated by a composite setting information generation unit. A specific region information generation unit generates specific region information indicating the specific region corresponding to a specific imaging region in the composite image. In accordance with the specific region information, the captured image combining unit can easily perform an invalidation or emphasizing process, for example, on the image corresponding to the specific imaging region. The specific region information is also associated with the composite image generated by the captured image combining unit, so that reproduction control on the specific region corresponding to the specific imaging region in the composite image can be performed at the time of reproduction or the like of the composite image.

Abstract: There is provide a file generation apparatus and a file generation method as well as a reproduction apparatus and a reproduction method by which a file in which quality information of a depth-related image at least including a depth image is efficiently stored can be managed. An MPD file generation unit generates an MPD file. The MPD file is a management file that manages a file in which quality information representative of quality of a plurality of depth-related images including at least a depth image is disposed in a form divided in a plurality of tracks or subsamples and the management file in which a correspondence relationship between the respective tracks and associationID that specifies the depth-related images is described. The present disclosure can be applied when a segment file and an MPD file of a video content are distributed, for example, in a method that complies with MPEG-DASH.

Abstract: There is provided a file generation apparatus and a file generation method as well as a reproduction apparatus and a reproduction method by which a file for efficiently storing quality information of a depth-related image at least including a depth image can be generated. A segment file generation unit generates a file in which quality information representative of quality of a depth-related image including at least a depth image is disposed in a form divided for each kind. The present disclosure can be applied to a file generation apparatus of an information processing system or the like by which a segment file and an MPD file of a video content are distributed, for example, in a method that complies with MPEG-DASH.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method, which enable efficient description of depth representation information in an MP4 file. A file generation unit samples and arranges an elementary stream obtained by encoding a depth image including pixel values, which are obtained by quantizing depth information indicating a position of each pixel in a depth direction, as well as groups samples with the same depth representation information regarding the depth image and generates the MP4 file in which the depth representation information of each group is described. The present disclosure can be applied to, for example, a file generation apparatus and the like.

Abstract: Provided is an image decoding device including an acquisition unit configured to acquire clean random access (CRA) information used to identify one or more CRA pictures in an image sequence inserted into a data region from a header region of a file format including the header region and the data region, a control unit configured to specify one CRA picture in the image sequence as a decoding start picture using the CRA information when an instruction of random access is detected, and a decoding unit configured to decode the image sequence from the decoding start picture specified by the control unit.

Abstract: Provided is an image decoding device including an acquisition unit configured to acquire clean random access (CRA) information used to identify one or more CRA pictures in an image sequence inserted into a data region from a header region of a file format including the header region and the data region, a control unit configured to specify one CRA picture in the image sequence as a decoding start picture using the CRA information when an instruction of random access is detected, and a decoding unit configured to decode the image sequence from the decoding start picture specified by the control unit.

Abstract: There is provided an information processing apparatus and an information processing method that can appropriately resume recovery of corrupted data of a file in an ISO Base media file format. A setting unit sets recovery information indicating a state of recovery of corrupted data of a file in compliance with the ISO Base media file format. A recovery unit recovers the corrupted data based on the recovery information set by the setting unit. The present disclosure can be applied to, for example, a reception apparatus or the like that receives and records a file of broadcast data in a format such as an ISO Base media file format.

Abstract: A device and method capable of performing image following type audio control or image non-following type audio control are implemented. Images in different directions are selectively displayed on the display unit, and an output audio is controlled in accordance with an image display. A data processing unit executes image following type audio control of moving an audio source direction in accordance with movement of the display image of the display unit and image non-following type audio control of not moving the audio source direction in accordance with the movement of an image in units of individual controllable audio elements. The data processing unit acquires audio control information from an MP4 file or a media presentation description (MPD) file and executes either the image following type audio control or the image non-following type audio control in accordance with the acquired audio control information in units of individual controllable audio elements.