Patents by Inventor Mitsuhiro Hirabayashi

Mitsuhiro Hirabayashi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11974028
    Abstract: Provided are an information processing device, an information processing method, a reproduction processing device, and a reproduction processing method that reduce the amount of information and provide a viewer with a high-quality viewing experience. A preprocessing unit individually generates SubSample information used for decoding each of SubSamples, which are a plurality of component streams, in a content stream including the SubSamples. The file generation unit generates a file including the SubSample1 information generated by the preprocessing unit.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: April 30, 2024
    Assignee: Sony Group Corporation
    Inventors: Mitsuhiro Hirabayashi, Ryohei Takahashi
  • Patent number: 11967153
    Abstract: There is provided an information processing apparatus, a reproduction processing apparatus, and an information processing method that improve data transmission efficiency. A preprocessing unit (102) generates, as scene configuration information indicating a configuration of a scene of 6DoF content including a three-dimensional object in a three-dimensional space, dynamic scene configuration information that changes over time and static scene configuration information that does not change over time, the static scene configuration information being scene configuration information different from the dynamic scene configuration information.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: April 23, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Mitsuru Katsumata, Mitsuhiro Hirabayashi, Ryohei Takahashi
  • Publication number: 20240107049
    Abstract: There is provided an information processing device and an information processing method by which reproduction of a point cloud having no time information can be handled. Metadata that includes reproduction information necessary to reproduce encoded data obtained by encoding one frame of a point cloud by V-PCC or G-PCC and that includes reproduction feasibility information to be used to determine feasibility of reproducing the encoded data is generated. The encoded data and the metadata are stored in a file having a predetermined file structure using the ISOBMFF technology. The present technology is applicable to a data generation device that generates a file into which encoded data of a point cloud having no time information is stored, for example.
    Type: Application
    Filed: December 5, 2023
    Publication date: March 28, 2024
    Applicant: SONY GROUP CORPORATION
    Inventors: Mitsuru KATSUMATA, Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Patent number: 11902555
    Abstract: There is provided an information processing device and an information processing method by which reproduction of a point cloud having no time information can be handled. Metadata that includes reproduction information necessary to reproduce encoded data obtained by encoding one frame of a point cloud by V-PCC or G-PCC and that includes reproduction feasibility information to be used to determine feasibility of reproducing the encoded data is generated. The encoded data and the metadata are stored in a file having a predetermined file structure using the ISOBMFF technology. The present technology is applicable to a data generation device that generates a file into which encoded data of a point cloud having no time information is stored, for example.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: February 13, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Mitsuru Katsumata, Ryohei Takahashi, Mitsuhiro Hirabayashi
  • Publication number: 20240046562
    Abstract: The present disclosure relates to an information processing device and method that enable an increase in data amount of scene description to be curbed. A scene description file including track information that designates, as a reference target, some tracks with information for accessing other tracks, from among a plurality of tracks of a file container that manages information regarding data of the 3D object content is generated. Also, data of the 3D object content managed in all the tracks is obtained on the basis of the scene description file including the track information that designates, as a reference target, some tracks with information for accessing other tracks from among the plurality of tracks of the file container and a reference relationship among the tracks. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: December 24, 2021
    Publication date: February 8, 2024
    Applicant: Sony Group Corporation
    Inventors: Yuka KIYAMA, Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Patent number: 11871065
    Abstract: Provided are an information processing apparatus, a reproduction processing apparatus, an information processing method, and a reproduction processing method that can easily provide a viewing experience that meets the needs of a viewer. A data acquiring unit (101) acquires a content including a plurality of component streams. A file generating unit (105) generates content random access point (RAP) information indicating random access points of the content on the basis of random access points of the component streams of the content that has been acquired by the data acquiring unit (101).
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: January 9, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi
  • Publication number: 20230401753
    Abstract: An information processing device and method are capable of inhibiting an increase in the load of a reproduction process. First information about a change in a relationship of a point cloud expressing an object having a three-dimensional shape for three-dimensional spatial regions that are independently decodable is generated, second information about the three-dimensional spatial regions is generated in accordance with the first information, and a file storing a bit stream of encoded data acquired by encoding the point cloud, the first information, and the second information is generated. In addition, the first information stored in the file is referred to, and, in a case in which the relationship described above is static, data of tiles composing the three-dimensional spatial regions constructing a point cloud is extracted on the basis of the second information, and the data is decoded.
    Type: Application
    Filed: December 10, 2021
    Publication date: December 14, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20230388525
    Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.
    Type: Application
    Filed: August 15, 2023
    Publication date: November 30, 2023
    Applicant: SONY CORPORATION
    Inventors: Shinobu HATTORI, Ohji NAKAGAMI, Mitsuhiro HIRABAYASHI
  • Patent number: 11825135
    Abstract: To provide an information processing apparatus, an information processing method, a reproduction processing apparatus, and a reproduction processing method that provide a user with a viewing experience with a high degree of freedom. A data input unit acquires data of a three-dimensional space configured as a single spatial three-dimensional object including a plurality of three-dimensional objects. A preprocessing unit generates three-dimensional object-specifying information for identifying a specific three-dimensional object included in a three-dimensional space. A file generation unit generates a file including data of a three-dimensional space and three-dimensional object-specifying information generated by the preprocessing unit.
    Type: Grant
    Filed: January 29, 2020
    Date of Patent: November 21, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Mitsuru Katsumata, Ryohei Takahashi, Mitsuhiro Hirabayashi
  • Patent number: 11812042
    Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.
    Type: Grant
    Filed: December 27, 2021
    Date of Patent: November 7, 2023
    Assignee: SONY CORPORATION
    Inventors: Shinobu Hattori, Ohji Nakagami, Mitsuhiro Hirabayashi
  • Publication number: 20230334804
    Abstract: The present disclosure relates to an information processing device and method capable of suppressing an increase in processing load when randomly accessing scene descriptions. As update information for updating spatial arrangement information for arranging at least one 3D object in a 3D space, initial value reference difference information that is difference information which uses an initial value of the spatial arrangement information as a reference, or post-update information in which an update to the initial value reference difference information is reflected in the initial value of the spatial arrangement information, is generated. Then, an update file which stores the update information is generated, and the initial value reference difference information or the post-update information is stored in the update file as a random access point. The present disclosure can be applied in, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: October 6, 2021
    Publication date: October 19, 2023
    Applicant: Sony Group Corporation
    Inventors: Yuka KIYAMA, Mitsuhiro HIRABAYASHI, Ryohei TAKAHASHI
  • Patent number: 11785410
    Abstract: The present technology relates a reproduction apparatus, a reproduction method, an information processing apparatus, an information processing method, and a program which can realize reproduction of highly flexible audio data while reflecting the intention of a content creator. A reproduction apparatus according to one aspect of the present technology acquires content including audio data of each of audio objects and rendering parameters of the audio data for each of a plurality of presumed listening positions, renders the audio data on the basis of the rendering parameters for a selected predetermined presumed listening position, and outputs an audio signal. The present technology can be applied to an apparatus that can reproduce object-based audio data.
    Type: Grant
    Filed: February 1, 2022
    Date of Patent: October 10, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Minoru Tsuji, Toru Chinen, Mitsuhiro Hirabayashi, Keiichi Aoyama
  • Publication number: 20230308661
    Abstract: The present disclosure relates to an information processing apparatus and a method capable of suppressing an increase in load of reproduction processing. A file storing a bitstream track storing a bitstream of content having a subpicture in a frame and an extract base track storing subpicture specifying information which is information for specifying a subpicture to be extracted in the bitstream track is generated. Further, a subpicture is extracted from the bitstream track and a bitstream is generated on the basis of the extract base track of the file. The present disclosure can be applied to, for example, an information processing apparatus, an information processing method, or the like.
    Type: Application
    Filed: September 2, 2021
    Publication date: September 28, 2023
    Applicant: Sony Group Corporation
    Inventors: Mitsuru KATSUMATA, Mitsuhiro HIRABAYASHI
  • Publication number: 20230300374
    Abstract: The present disclosure relates to an information processing apparatus and method capable of suppressing an increase in a load of a reproduction process. A scene description file that describes a scene of 3D object content is generated, the scene description file including information associated with Media Presentation Description (MPD) that stores metadata of the 3D object content distributed by using Moving Picture Experts Group Dynamic Adaptive Streaming over HTTP (MPEG DASH) and information regarding encoding of Representation included in Adaptation Set in the MPD. Furthermore, the scene description file is analyzed, the 3D object content to be decoded is selected on the basis of the information regarding the encoding of the Representation, and the encoded data of the selected 3D content is decoded. The present disclosure can be applied to, for example, an information processing apparatus, an information processing method, or the like.
    Type: Application
    Filed: September 15, 2021
    Publication date: September 21, 2023
    Applicant: Sony Group Corporation
    Inventors: Yuka KIYAMA, Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20230291918
    Abstract: The present disclosure relates to an information processing device and method capable of inhibiting an increase in a load on reproduction processing. Scalable decoding information is generated on the basis of a depth of a slice in the G-PCC content and a dependency relation between slices and is stored in the metadata area of the content file that stores the G-PCC content. Further, on the basis of the scalable decoding information stored in the metadata area of the content file, any slice of the G-PCC content is extracted from the content file and is decoded. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: September 6, 2021
    Publication date: September 14, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Patent number: 11729366
    Abstract: The present disclosure relates to an information processing apparatus and method that allows a stream of sub-pictures to be more easily selected. A control file is generated that manages image encoded data for each of a plurality of sub-pictures into which an entire picture is divided and which is then encoded, the control file including region-related information related to a region in the entire picture corresponding to the sub-picture, as information different from arrangement information for each of picture regions, the control file being used for controlling distribution of the image encoded data. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, an image encoding apparatus, a file generating apparatus, a file transmission apparatus, a distribution apparatus, a file reception apparatus, an image decoding apparatus, or a reproduction apparatus.
    Type: Grant
    Filed: April 4, 2022
    Date of Patent: August 15, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi
  • Patent number: 11710274
    Abstract: The present technology relates to an image processing apparatus and a file generation apparatus that make it possible to appropriately reproduce a BV content. An image processing apparatus includes: a file acquisition unit that acquires a file having a management region where information for management of a 3D object content is stored and a data region where a track in which streams included in the 3D object content are stored is stored, group information for selection, from a plurality of the streams included in the 3D object content, of the stream appropriate for reproduction of the 3D object content being stored in the management region; and a file processor that selects a plurality of the streams to be used for reproduction of the 3D object content on the basis of the group information. The present technology is applicable to a client apparatus.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: July 25, 2023
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Mitsuru Katsumata, Toshiya Hamada
  • Publication number: 20230224482
    Abstract: The present disclosure relates to an information processing device and a method capable of more easily reproducing 3D data using spatial scalability. 2D data obtained by two-dimensionally converting a point cloud representing an object having a three-dimensional shape as a set of points and corresponding to spatial scalability is encoded, a bitstream including a sub-bitstream obtained by encoding the point cloud corresponding to a single or plurality of layers of the spatial scalability is generated, spatial scalability information regarding the spatial scalability of the sub-bitstream is generated, and a file that stores the bitstream generated and the spatial scalability information generated is generated. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: May 28, 2021
    Publication date: July 13, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20230222726
    Abstract: A scene descriptive file describing a scene of 3D object content is generated, in the scene descriptive file, timed metadata identification information indicating that metadata of an associated external file changes in a time direction being stored in an MPEG_media extension, and timed metadata access information associating a camera object with the metadata being stored in the camera object. Furthermore, timed metadata that changes in the time direction is acquired on the basis of the timed metadata identification information and the timed metadata access information stored in the scene descriptive file, and a display image of the 3D object content is generated on the basis of the acquired timed metadata. The present disclosure is applicable to, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: May 28, 2021
    Publication date: July 13, 2023
    Applicant: Sony Group Corporation
    Inventors: Yuka KIYAMA, Mitsuhiro HIRABAYASHI, Ryohei TAKAHASHI
  • Publication number: 20230222693
    Abstract: The present disclosure relates to an information processing apparatus and method capable of suppressing an increase in load of reproduction processing. To generate, by using tile identification information indicating a tile of a point cloud corresponding to a data unit of a bitstream of the point cloud expressing an object having a three-dimensional shape as a set of points, tile management information that is information for managing the tile corresponding to a subsample including a single or a plurality of consecutive data units of the bitstream stored as a sample in a file, and to generate the file that stores the bitstream and the tile management information. The present disclosure can be applied to, for example, an information processing apparatus, an information processing method, or the like.
    Type: Application
    Filed: May 26, 2021
    Publication date: July 13, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI