Abstract: There is provided an image processing apparatus and method, a file generation apparatus and method, and a program that enable a suitable occlusion image to be obtained. The image processing apparatus includes an MPD file processing unit configured to select an occlusion image to be acquired, on the basis of information regarding a viewpoint position of the occlusion image included in an MPD file, from among a plurality of the occlusion images indicated by the MPD file. The present technology can be applied to a client device.

Abstract: The present disclosure relates to an information processing apparatus and method that allows a stream of sub-pictures to be more easily selected. A control file is generated that manages image encoded data for each of a plurality of sub-pictures into which an entire picture is divided and which is then encoded, the control file including region-related information related to a region in the entire picture corresponding to the sub-picture, as information different from arrangement information for each of picture regions, the control file being used for controlling distribution of the image encoded data. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, an image encoding apparatus, a file generating apparatus, a file transmission apparatus, a distribution apparatus, a file reception apparatus, an image decoding apparatus, or a reproduction apparatus.

Abstract: A playback device of the present disclosure includes a processing unit and a control unit. When having acquired identification information, the control unit calculates, on a playback time axis and based on the acquired identification information, a first point-of-time on the playback time axis, the first point-of-time being a point-of-time turning back a current point-of-time on the playback time axis by a first duration-of-time satisfying a first predetermined condition, and newly sets the calculated first point-of-time in the processing unit. The processing unit generates a video in which frames from the first point-of-time are arranged in chronological order, based on at least a part of acquired 6DoF content, a position and an orientation of a set viewpoint, and the first point-of-time newly set by the control unit.

Abstract: The present technology relates a reproduction apparatus, a reproduction method, an information processing apparatus, an information processing method, and a program which can realize reproduction of highly flexible audio data while reflecting the intention of a content creator. A reproduction apparatus according to one aspect of the present technology acquires content including audio data of each of audio objects and rendering parameters of the audio data for each of a plurality of presumed listening positions, renders the audio data on the basis of the rendering parameters for a selected predetermined presumed listening position, and outputs an audio signal. The present technology can be applied to an apparatus that can reproduce object-based audio data.

Abstract: To provide an information processing apparatus, an information processing method, a reproduction processing apparatus, and a reproduction processing method that provide a user with a viewing experience with a high degree of freedom. A data input unit acquires data of a three-dimensional space configured as a single spatial three-dimensional object including a plurality of three-dimensional objects. A preprocessing unit generates three-dimensional object-specifying information for identifying a specific three-dimensional object included in a three-dimensional space. A file generation unit generates a file including data of a three-dimensional space and three-dimensional object-specifying information generated by the preprocessing unit.

Abstract: Provided are an information processing device, an information processing method, a reproduction processing device, and a reproduction processing method that provide a high-quality viewing experience to a user. A metadata generation unit generates transition identification information for identifying a second viewpoint that is a viewpoint position of a second video transitionable from a first video whose viewpoint position is a first viewpoint. A file generation unit generates a file including data of the first video data and the transition identification information.

Abstract: An image processing apparatus according to the present disclosure includes: an acquisition unit that acquires first field-of-view information, which is information for specifying a first field of view of a user in a wide angle-of-view image, and second field-of-view information, which is information for specifying a second field of view, which is a field of view at a destination of a transition from the first field of view; and a generation unit that generates transition field-of-view information, which is information indicating the transition in field of view from the first field of view to the second field of view on the basis of the first field-of-view information and the second field-of-view information.

Abstract: An audio reproduction with a realistic feeling is achieved while suppressing incongruity and discomfort given to a user. The information processing device (1, 2) according to an embodiment includes an acquisition section (11) configured to acquire content data including a plurality of objects; an execution timing decision section (134) configured to decide an execution timing for each of the objects; a rendering processing section (151, 152, 153) configured to render each of the objects on the basis of line-of-sight information of a user that has been input immediately before the execution timing of rendering each of the objects; and an output synthesis section (154) configured to synthesize output data for every object that has been generated by the rendering.

Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.

Abstract: Provided are an information processing apparatus, a reproduction processing apparatus, an information processing method, and a reproduction processing method that can easily provide a viewing experience that meets the needs of a viewer. A data acquiring unit (101) acquires a content including a plurality of component streams. A file generating unit (105) generates content random access point (RAP) information indicating random access points of the content on the basis of random access points of the component streams of the content that has been acquired by the data acquiring unit (101).

Abstract: There is provided an information processing apparatus and an information processing method that enable use of a thumbnail for 3D object still image content. A 3D object is used as original data, and role information that is information indicating that thumbnail data generated from the original data is a thumbnail based on the original data is generated. Then, the role information and encoded data obtained by encoding one frame of the 3D object by a predetermined encoding method are stored in a file having a predetermined file structure. The present technology can be applied to, for example, a data generation apparatus that generates a file that stores encoded data of Point Cloud without time information and its thumbnail.

Abstract: The present technology relates a reproduction apparatus, a reproduction method, an information processing apparatus, an information processing method, and a program which can realize reproduction of highly flexible audio data while reflecting the intention of a content creator. A reproduction apparatus according to one aspect of the present technology acquires content including audio data of each of audio objects and rendering parameters of the audio data for each of a plurality of presumed listening positions, renders the audio data on the basis of the rendering parameters for a selected predetermined presumed listening position, and outputs an audio signal. The present technology can be applied to an apparatus that can reproduce object-based audio data.

Abstract: The present disclosure relates to information processing apparatus and method that allow robustness of content reproduction to be improved. Metadata regarding content is generated, the content expressing a three-dimensional object in a three-dimensional space and enabling a line-of-sight direction and a view-point position to be freely set at a time of reproduction, and the metadata including information enabling a bit rate to be selected at a time of distribution of the content. Metadata that includes, for example, as the above-described information, access information for a control file controlling reproduction of the content, is generated. The present disclosure may be applied to, for example, an image processing apparatus, an image encoding apparatus, or an image decoding apparatus.

Abstract: There is provided an information processing device and an information processing method by which reproduction of a point cloud having no time information can be handled. Metadata that includes reproduction information necessary to reproduce encoded data obtained by encoding one frame of a point cloud by V-PCC or G-PCC and that includes reproduction feasibility information to be used to determine feasibility of reproducing the encoded data is generated. The encoded data and the metadata are stored in a file having a predetermined file structure using the ISOBMFF technology. The present technology is applicable to a data generation device that generates a file into which encoded data of a point cloud having no time information is stored, for example.

Abstract: There is provided a file generation apparatus and a file generation method as well as a reproduction apparatus and a reproduction method by which a file for efficiently storing quality information of a depth-related image at least including a depth image can be generated. A segment file generation unit generates a file in which quality information representative of quality of a depth-related image including at least a depth image is disposed in a form divided for each kind. The present disclosure can be applied to a file generation apparatus of an information processing system or the like by which a segment file and an MPD file of a video content are distributed, for example, in a method that complies with MPEG-DASH.

Abstract: There is provided an information processing apparatus, an information processing method, and a program for enabling clients to perform processing efficiently. From 3D data representing a three-dimensional structure, identification information regarding an individual stream of geometry information indicating a geometry of the three-dimensional structure and identification information regarding an individual stream of attribute information indicating an attribute of the three-dimensional structure are generated. A file is generated that includes generated multiple pieces of the identification information. The file is generated in a sample structure specifying boundaries of the geometry information and the attribute information. The present technology may be applied, for example, to a data generation apparatus for generating data for point cloud distribution and to a data reproduction apparatus for point cloud reproduction.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method that are capable of distributing higher-quality G-PCC streams. When G-PCC streams obtained by encoding Point Cloud data according to G-PCC are generated, there are generated spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which the Point Cloud data is segmented, and grouping information that groups the partial Point Cloud data. The present technology is applicable to a generating apparatus that generates G-PCC streams, for example.

Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method, which enable efficient description of depth representation information in an MP4 file. A file generation unit samples and arranges an elementary stream obtained by encoding a depth image including pixel values, which are obtained by quantizing depth information indicating a position of each pixel in a depth direction, as well as groups samples with the same depth representation information regarding the depth image and generates the MP4 file in which the depth representation information of each group is described. The present disclosure can be applied to, for example, a file generation apparatus and the like.

Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.