Patents by Inventor Mitsuhiro Hirabayashi

Mitsuhiro Hirabayashi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230224482
    Abstract: The present disclosure relates to an information processing device and a method capable of more easily reproducing 3D data using spatial scalability. 2D data obtained by two-dimensionally converting a point cloud representing an object having a three-dimensional shape as a set of points and corresponding to spatial scalability is encoded, a bitstream including a sub-bitstream obtained by encoding the point cloud corresponding to a single or plurality of layers of the spatial scalability is generated, spatial scalability information regarding the spatial scalability of the sub-bitstream is generated, and a file that stores the bitstream generated and the spatial scalability information generated is generated. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: May 28, 2021
    Publication date: July 13, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20230222726
    Abstract: A scene descriptive file describing a scene of 3D object content is generated, in the scene descriptive file, timed metadata identification information indicating that metadata of an associated external file changes in a time direction being stored in an MPEG_media extension, and timed metadata access information associating a camera object with the metadata being stored in the camera object. Furthermore, timed metadata that changes in the time direction is acquired on the basis of the timed metadata identification information and the timed metadata access information stored in the scene descriptive file, and a display image of the 3D object content is generated on the basis of the acquired timed metadata. The present disclosure is applicable to, for example, an information processing device, an information processing method, or the like.
    Type: Application
    Filed: May 28, 2021
    Publication date: July 13, 2023
    Applicant: Sony Group Corporation
    Inventors: Yuka KIYAMA, Mitsuhiro HIRABAYASHI, Ryohei TAKAHASHI
  • Publication number: 20230222693
    Abstract: The present disclosure relates to an information processing apparatus and method capable of suppressing an increase in load of reproduction processing. To generate, by using tile identification information indicating a tile of a point cloud corresponding to a data unit of a bitstream of the point cloud expressing an object having a three-dimensional shape as a set of points, tile management information that is information for managing the tile corresponding to a subsample including a single or a plurality of consecutive data units of the bitstream stored as a sample in a file, and to generate the file that stores the bitstream and the tile management information. The present disclosure can be applied to, for example, an information processing apparatus, an information processing method, or the like.
    Type: Application
    Filed: May 26, 2021
    Publication date: July 13, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Patent number: 11676331
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Grant
    Filed: August 10, 2022
    Date of Patent: June 13, 2023
    Assignee: Sony Corporation
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami, Satoru Kuma
  • Publication number: 20230179801
    Abstract: A decrease in bit efficiency is suppressed. An information processing device includes an encoding unit (101) that encodes a picture including two or more subpictures to generate encoded data; a metadata generation unit (102) that generates subpicture mapping information including first size information of a first subpicture among the two or more subpictures and information that second size information of each of one or more second subpictures other than the first subpicture being considered the same as the first size information of the first subpicture; and a bitstream generation unit (103) that generates a bitstream including the encoded data and the subpicture mapping information.
    Type: Application
    Filed: March 19, 2021
    Publication date: June 8, 2023
    Applicant: Sony Group Corporation
    Inventors: Mitsuru KATSUMATA, Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20230043591
    Abstract: There is provided an information processing apparatus and method capable of more easily comparing 3D objects. Comparison information which is information for displaying a plurality of 3D objects of 6DoF content in a comparable manner is generated. Further, the plurality of 3D objects of the 6DoF content is displayed in a comparable manner on the basis of comparison information which is information for displaying the plurality of 3D objects in a comparable manner. The present disclosure can be applied to, for example, an information processing apparatus, an information processing method, an information processing system, and the like.
    Type: Application
    Filed: December 25, 2020
    Publication date: February 9, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Yuka KIYAMA, Ryohei TAKAHASHI, Tsuyoshi ISHIKAWA, Mitsuhiro HIRABAYASHI, Jun KIMURA, Hiroshi KUNO
  • Publication number: 20230043987
    Abstract: The present disclosure relates to an image processing apparatus and method that enable linking between a 3D spatial region and an atlas tile group. Link information is generated and signaled, in which the link information is stored in a file together with a bitstream of a point cloud expressing an object having a three-dimensional shape as a set of points, and the link information links a 3D spatial region of the point cloud with an atlas tile group. On the basis of the link information, the 3D spatial region and the atlas tile group that correspond to a desired three-dimensional space are selected. The present disclosure can be applied to, for example, an image processing apparatus, an information processing apparatus, an image processing method, an information processing method, or the like.
    Type: Application
    Filed: December 11, 2020
    Publication date: February 9, 2023
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20220417499
    Abstract: An image of a fixed subpicture being a subpicture in which a position of a reference pixel is fixed in a time direction, in subpictures that are partial areas obtained by dividing a picture, is encoded with a resolution variable in a time direction. Furthermore, coded data obtained by encoding an image of a fixed subpicture being a subpicture in which a position of a reference pixel is fixed in a time direction, in subpictures that are partial areas obtained by dividing a picture, with a resolution variable in a time direction is decoded to generate the image of the resolution of the fixed subpicture. The present disclosure can be applied to, for example, an image processing apparatus, an image encoding apparatus, an image decoding apparatus, an information processing apparatus, an image processing method, an information processing method, or the like.
    Type: Application
    Filed: December 10, 2020
    Publication date: December 29, 2022
    Applicant: Sony Group Corporation
    Inventors: Mitsuru KATSUMATA, Mitsuhiro HIRABAYASHI, Masaru IKEDA, Yoichi YAGASAKI, Yuji FUJIMOTO, Takeshi TSUKUBA
  • Publication number: 20220406062
    Abstract: There is provided an information processing apparatus, a reproduction processing apparatus, and an information processing method that improve data transmission efficiency. A preprocessing unit (102) generates, as scene configuration information indicating a configuration of a scene of 6DoF content including a three-dimensional object in a three-dimensional space, dynamic scene configuration information that changes over time and static scene configuration information that does not change over time, the static scene configuration information being scene configuration information different from the dynamic scene configuration information.
    Type: Application
    Filed: August 28, 2020
    Publication date: December 22, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Mitsuru KATSUMATA, Mitsuhiro HIRABAYASHI, Ryohei TAKAHASHI
  • Patent number: 11532103
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that are capable of distributing higher-quality G-PCC streams. When G-PCC streams obtained by encoding Point Cloud data according to G-PCC are generated, there are generated spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which the Point Cloud data is segmented, and grouping information that groups the partial Point Cloud data. The present technology is applicable to a generating apparatus that generates G-PCC streams, for example.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: December 20, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Mitsuru Katsumata, Takumi Tsuru, Ohji Nakagami, Satoru Kuma
  • Publication number: 20220383587
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Application
    Filed: August 10, 2022
    Publication date: December 1, 2022
    Applicant: SONY CORPORATION
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI, Satoru KUMA
  • Patent number: 11516453
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that enable processing to be performed simply, and a program. By converting a point cloud representing a three-dimensional structure into two dimensions, a geometry image and a texture image, and three-dimensional information metadata required for constructing the geometry image and the texture image in three dimensions are obtained. Then, one PC sample included in a Point Cloud displayed at a specific time is generated by storing the geometry image, the texture image, and the three-dimensional information metadata in accordance with a playback order required at a time of reproducing and playing back the geometry image and the texture image in three dimensions on the basis of the three-dimensional information metadata. It is possible to apply to a data generation device that generates data for distribution of a Point Cloud.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: November 29, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami
  • Publication number: 20220369005
    Abstract: Provided are an information processing device, an information processing method, a reproduction processing device, and a reproduction processing method that reduce the amount of information and provide a viewer with a high-quality viewing experience. A preprocessing unit individually generates SubSample information used for decoding each of SubSamples, which are a plurality of component streams, in a content stream including the SubSamples. The file generation unit generates a file including the SubSamplel information generated by the preprocessing unit.
    Type: Application
    Filed: June 4, 2020
    Publication date: November 17, 2022
    Applicant: Sony Group Corporation
    Inventors: Mitsuhiro HIRABAYASHI, Ryohei TAKAHASHI
  • Publication number: 20220351484
    Abstract: A generation unit (111) generates an identification region map indicating whether or not each divided object data is visible from each position in a three-dimensional space by using information regarding orientation of a normal vector (15) dividing an object (10) in the three-dimensional space and information regarding an outline of the object (10).
    Type: Application
    Filed: July 2, 2020
    Publication date: November 3, 2022
    Inventors: TAKUMI TSURU, TOSHIYA HAMADA, MITSUHIRO HIRABAYASHI
  • Patent number: 11488633
    Abstract: A playback device of the present disclosure includes a processing unit and a control unit. When having acquired identification information, the control unit calculates, on a playback time axis and based on the acquired identification information, a first point-of-time on the playback time axis, the first point-of-time being a point-of-time turning back a current point-of-time on the playback time axis by a first duration-of-time satisfying a first predetermined condition, and newly sets the calculated first point-of-time in the processing unit. The processing unit generates a video in which frames from the first point-of-time are arranged in chronological order, based on at least a part of acquired 6DoF content, a position and an orientation of a set viewpoint, and the first point-of-time newly set by the control unit.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: November 1, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Toshiya Hamada, Mitsuhiro Hirabayashi
  • Patent number: 11481961
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Grant
    Filed: September 18, 2019
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami, Satoru Kuma
  • Publication number: 20220312035
    Abstract: The present disclosure provides an information processing apparatus, information processing method, reproduction processing apparatus, and reproduction processing method, capable of providing a viewing experience that meets the viewer's requests. An encoding unit (121) encodes point cloud data in such a way as to have a phased hierarchical structure corresponding to a level of detail (LoD) indicating a level of quality to generate a bitstream being constituted of a data region including one or more geometry slices. A metadata generation unit (125) generates partial slice-specific information being used for specifying a correspondence of the LoD to a partial slice used as a partial region corresponding to the LoD in the geometry slice. A file creation unit (126) creates a file including the partial slice-specific information.
    Type: Application
    Filed: August 28, 2020
    Publication date: September 29, 2022
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI
  • Publication number: 20220303641
    Abstract: Provided is an appropriate viewing experience according to the intention of a provider. A metadata generation unit (122) generates timed playback information indicating a display order along time passage for playback of each scene of 6DoF content including a three-dimensional model in a three-dimensional space, and modified timed metadata including recommended viewing information indicating a viewpoint position and a line-of-sight direction at each time point along time passage for playback, and generates association information indicating that the timed playback information and the modified timed metadata correspond to each time point along the time passage for playback.
    Type: Application
    Filed: September 23, 2020
    Publication date: September 22, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Yuka KIYAMA, Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Hiroshi KUNO
  • Publication number: 20220247991
    Abstract: An atlas processing unit generates atlas identification information associating a texture image that forms a reference two-dimensional image corresponding to each projection direction formed by projecting three-dimensional data from a predetermined viewpoint position in a plurality of projection directions and a complementary image for generating, from the reference two-dimensional image, a moved two-dimensional image based on a viewpoint position moved within a limited range from the predetermined viewpoint position, with a depth image corresponding to the texture image, and each piece of post decoding information for rendering each reference two-dimensional image and each moved two-dimensional image, the post decoding information including first post decoding information indicating that the first post decoding information is information of a “3DoF+” region in which the complementary image in the texture image is stored.
    Type: Application
    Filed: March 31, 2020
    Publication date: August 4, 2022
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI
  • Publication number: 20220239994
    Abstract: Provided are an information processing apparatus, a reproduction processing apparatus, an information processing method, and a reproduction processing method that enable a client device to efficiently select a content configuration. A preprocessing unit generates content configuration selection information, with respect to one or a plurality of contents, for determining whether or not each of the contents is reproducible, each of the contents having a content configuration including one or more three-dimensional objects and space arrangement information therefor to represent a virtual space. A file generation unit generates a file including data about the virtual space and the content configuration selection information.
    Type: Application
    Filed: March 31, 2020
    Publication date: July 28, 2022
    Applicant: Sony Group Corporation
    Inventors: Mitsuru KATSUMATA, Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI