Patents by Inventor Satoru Kuma

Satoru Kuma has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11699248
    Abstract: The present disclosure relates to an image processing apparatus and method that can prevent an increase in the load of a decoding process for encoded data in a point cloud video-based approach. The parameters related to a plurality of point cloud models of a point cloud are transformed, a two-dimensional plane image onto which the plurality of point cloud models having the transformed parameters is projected is encoded, and a bitstream containing encoded data of the two-dimensional image and transform information that is information regarding the transform of the parameters is generated. The present disclosure can be applied to an information processing device, an image processing apparatus, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: July 11, 2023
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Patent number: 11676331
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Grant
    Filed: August 10, 2022
    Date of Patent: June 13, 2023
    Assignee: Sony Corporation
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami, Satoru Kuma
  • Publication number: 20230179797
    Abstract: There is provided an image processing apparatus and method, electronic device, and program enabling suppression of deterioration of image quality. A base video frame is generated in which a base patch is arranged, the base patch being obtained by projecting, on a two-dimensional plane for each partial region, a point cloud representing an object having a three-dimensional shape as a set of points, and an additional video frame is generated in which an additional patch is arranged, the additional patch being obtained by projecting, on the two-dimensional plane same as in a case of the base patch, a partial region including at least a part of the partial region corresponding to the base patch of the point cloud, with at least some of parameters made different from a case of the base patch. By encoding the generated base video frame and additional video frame, coded data is generated.
    Type: Application
    Filed: March 11, 2021
    Publication date: June 8, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Kao HAYASHI, Ohji NAKAGAMI, Satoru KUMA, Koji YANO, Tsuyoshi KATO, Hiroyuki YASUDA
  • Publication number: 20230177735
    Abstract: The present disclosure relates to an information processing apparatus and method that enable to more easily achieve scalable decoding of point cloud data. In encoding of a point cloud representing an object having a three-dimensional shape as a set of points, control is performed so as to prohibit combined use of scalable encoding that is an encoding method for generating scalably decodable coded data and scaling encoding that is an encoding method involving a change in a tree structure of geometry data. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: June 8, 2021
    Publication date: June 8, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI
  • Patent number: 11657539
    Abstract: 3D data representing a three-dimensional structure is divided into a plurality of pieces and encoded, an obtained plurality of divided bitstreams is multiplexed, and one bitstream including a separator indicating a position of a joint between the divided bitstreams is generated. Furthermore, a separator indicating a position of a joint between divided bitstreams obtained by dividing 3D data representing a three-dimensional structure into a plurality of pieces and encoding the plurality of divided pieces of the 3D data, which is included in a bitstream obtained by multiplexing a plurality of the divided bitstreams, is analyzed, and the bitstream is divided into every divided bitstream on the basis of information included in the analyzed separator, and decoded. Applications of the technology include being implemented in, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.
    Type: Grant
    Filed: October 3, 2018
    Date of Patent: May 23, 2023
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Satoru Kuma, Tsuyoshi Kato
  • Publication number: 20230126000
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of suppressing an increase in loads when a point cloud is generated from a mesh. Point cloud data is generated by positioning points at intersection points between a surface of a mesh and vectors each including, as a start origin, position coordinates corresponding to a specified resolution. For example, intersection determination is performed between the surface of the mesh and each of the vectors, and in a case where the surface and the vector are determined to intersect each other, the coordinates of the intersection point are calculated. The present disclosure can be applied to an image processing apparatus, electronic equipment, an image processing method, a program, or the like.
    Type: Application
    Filed: December 21, 2022
    Publication date: April 27, 2023
    Applicant: SONY CORPORATION
    Inventors: Ohji NAKAGAMI, Koji YANO, Satoru KUMA, Tsuyoshi KATO, Hiroyuki YASUDA
  • Publication number: 20230113736
    Abstract: There is provided an image processing apparatus and a method that enable suppression of an increase in load of decoding of a point cloud. Auxiliary patch information being information regarding a patch obtained by projecting a point cloud representing a three-dimensional shaped object as an aggregate of points, onto a two-dimensional plane for each partial region is generated in such a manner as to correspond to all of a plurality of frames included in a predetermined section in a time direction of the point cloud, a patch is generated using the generated auxiliary patch information for each frame in the section, and a frame image in which the generated patch is arranged is encoded. The present disclosure can be applied to, for example, an image processing apparatus, an electronic device, an image processing method, a program, or the like.
    Type: Application
    Filed: March 11, 2021
    Publication date: April 13, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Koji YANO, Satoru KUMA, Ohji NAKAGAMI, Kao HAYASHI, Hiroyuki YASUDA, Tsuyoshi KATO
  • Patent number: 11611774
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method capable of suppressing a reduction in encoding efficiency. A bit stream is generated which contains: information indicating a correspondence relation between at least one of a geometry image obtained by projecting position information regarding 3D data representing a three-dimensional structure onto a two-dimensional plane or a texture image obtained by projecting attribute information regarding the 3D data onto a two-dimensional plane, and an occupancy map that is map information indicating whether or not data is present at each position; and encoded data regarding the geometry image, encoded data regarding the texture image, and encoded data regarding the occupancy map. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, an electronic apparatus, an information processing method, a program, and the like.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: March 21, 2023
    Assignee: SONY CORPORATION
    Inventors: Koji Yano, Ohji Nakagami, Tsuyoshi Kato, Satoru Kuma
  • Patent number: 11568602
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of suppressing an increase in loads when a point cloud is generated from a mesh. Point cloud data is generated by positioning points at intersection points between a surface of a mesh and vectors each including, as a start origin, position coordinates corresponding to a specified resolution. For example, intersection determination is performed between the surface of the mesh and each of the vectors, and in a case where the surface and the vector are determined to intersect each other, the coordinates of the intersection point are calculated. The present disclosure can be applied to an image processing apparatus, electronic equipment, an image processing method, a program, or the like.
    Type: Grant
    Filed: September 18, 2019
    Date of Patent: January 31, 2023
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Satoru Kuma, Tsuyoshi Kato, Hiroyuki Yasuda
  • Publication number: 20230023219
    Abstract: There is provided an information processing device and method capable of suppressing a reduction in encoding efficiency. When performing, for attribute information of each point of a point cloud that represents an object having a three-dimensional shape as a set of points, hierarchization of the attribute information by recursively repeating classification of a prediction point for deriving a difference value between the attribute information and a predicted value of the attribute information and a reference point used for deriving the predicted value with respect to the reference point, the reference point is set on the basis of a centroid of points. The present disclosure can be applied to, for example, an information processing device, an image processing device, an encoding device, a decoding device, an electronic device, an information processing method, a program, and the like.
    Type: Application
    Filed: December 24, 2020
    Publication date: January 26, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI, Hiroyuki YASUDA, Koji YANO
  • Publication number: 20220414940
    Abstract: The present disclosure relates to an information processing apparatus and a method capable of controlling the number of the points to be obtained by decoding. A bitstream is generated, the bitstream including encoded data of 3D data having a plane expressing points in a point cloud that expresses a three-dimensional object as a set of the points, and control information for controlling the number of the points to be derived from the 3D data to be obtained by decoding the encoded data. The present disclosure can be applied to an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: September 17, 2020
    Publication date: December 29, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Hiroyuki YASUDA, Ohji NAKAGAMI, Tsuyoshi KATO, Koji YANO, Satoru KUMA
  • Patent number: 11532103
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that are capable of distributing higher-quality G-PCC streams. When G-PCC streams obtained by encoding Point Cloud data according to G-PCC are generated, there are generated spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which the Point Cloud data is segmented, and grouping information that groups the partial Point Cloud data. The present technology is applicable to a generating apparatus that generates G-PCC streams, for example.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: December 20, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Mitsuru Katsumata, Takumi Tsuru, Ohji Nakagami, Satoru Kuma
  • Publication number: 20220383587
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Application
    Filed: August 10, 2022
    Publication date: December 1, 2022
    Applicant: SONY CORPORATION
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI, Satoru KUMA
  • Publication number: 20220375136
    Abstract: The present disclosure relates to an information processing apparatus and method for reducing a decrease in coding efficiency. The information processing apparatus encodes information regarding the luminance of a point corresponding to the lowest hierarchical level in hierarchized geometry data, and information regarding the color of a point corresponding to a predetermined hierarchical level higher than the lowest hierarchical level in the geometry data, in a point cloud expressing a three-dimensional object as a set of points. The present disclosure can be applied to an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: October 23, 2020
    Publication date: November 24, 2022
    Inventors: TSUYOSHI KATO, SATORU KUMA, OHJI NAKAGAMI, HIROYUKI YASUDA, KOJI YANO
  • Patent number: 11508096
    Abstract: The present disclosure relates to information processing apparatus and method that makes it possible to suppress a reduction in encoding efficiency. Information relating to quantization of a three-dimensional position of an encoding target is generated. For example, the information relating to the quantization includes information relating to a coordinate system to be subjected to the quantization, information relating to a bounding box for normalization of position information of the encoding target, or information relating to a voxel for quantization of position information of the encoding target. In addition, three-dimensional information of the encoding target is restored from a signal string on the basis of the information relating to the quantization of the three-dimensional position of the encoding target.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: November 22, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Publication number: 20220353493
    Abstract: The present disclosure relates to an information processing apparatus and a method for achieving scalability of the number of points in point cloud data. Encoded data of a point cloud representing a three-dimensional object as a point group is decoded, a tree structure using the positional information about the respective points constituting the point cloud is generated, and the number of nodes corresponding to the depth of the level of detail is selected for some or all of the levels of detail constituting the tree structure. The present disclosure can be applied to an information processing apparatus, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: June 11, 2020
    Publication date: November 3, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI, Hiroyuki YASUDA, Koji YANO
  • Publication number: 20220353492
    Abstract: The present disclosure relates to an information processing device and a method capable of suppressing a reduction in encoding efficiency of point cloud data. As for a point cloud representing an object having a three-dimensional shape as a point group, position information of a point to be processed is predicted on the basis of position information of a reference point, position information of a prediction point is generated, a difference between the generated position information of the prediction point and the position information of the point to be processed is derived, the derived difference is encoded, and a bitstream is generated. The present disclosure may be applied to, for example, an information processing device, an electronic device, an information processing method, a program or the like.
    Type: Application
    Filed: June 11, 2020
    Publication date: November 3, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Koji YANO, Hiroyuki YASUDA, Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI
  • Patent number: 11481961
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Grant
    Filed: September 18, 2019
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami, Satoru Kuma
  • Patent number: 11468603
    Abstract: The present disclosure relates to an information processing apparatus and a method that allows for suppression of a decrease in encoding efficiency. In comparison of voxel data resulting from quantization of point cloud data, a correlation degree of a distribution pattern between voxel data to be compared is calculated on the basis of a subjective feature of the distribution pattern of values of the voxel data. The present disclosure is applicable to an information processing apparatus, an image processing apparatus, an electronic device, an information processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: October 11, 2022
    Assignee: SONY CORPORATION
    Inventors: Koji Yano, Ohji Nakagami, Satoru Kuma, Tsuyoshi Kato
  • Publication number: 20220303578
    Abstract: There is provided an image processing apparatus and a method designed to be capable of reducing degradation of the subjective quality of a point cloud. Encoded data of a frame image in which a projection image of a point cloud representing a three-dimensional object as a set of points on a two-dimensional plane is placed is decoded, the frame image obtained by decoding the encoded data is unpacked to extract the projection image, and the respective points included in the extracted projection image are arranged in a three-dimensional space. When the coordinates of a point are not integer values in a basic coordinate system that is a predetermined coordinate system of the three-dimensional space, the point is moved in a direction perpendicular to the two-dimensional plane so that the coordinates of the point become integer values. Thus, the point cloud is reconstructed.
    Type: Application
    Filed: October 30, 2020
    Publication date: September 22, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Tsuyoshi KATO, Hiroyuki YASUDA