Patents by Inventor Ohji Nakagami

Ohji Nakagami has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220414940
    Abstract: The present disclosure relates to an information processing apparatus and a method capable of controlling the number of the points to be obtained by decoding. A bitstream is generated, the bitstream including encoded data of 3D data having a plane expressing points in a point cloud that expresses a three-dimensional object as a set of the points, and control information for controlling the number of the points to be derived from the 3D data to be obtained by decoding the encoded data. The present disclosure can be applied to an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: September 17, 2020
    Publication date: December 29, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Hiroyuki YASUDA, Ohji NAKAGAMI, Tsuyoshi KATO, Koji YANO, Satoru KUMA
  • Patent number: 11532103
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that are capable of distributing higher-quality G-PCC streams. When G-PCC streams obtained by encoding Point Cloud data according to G-PCC are generated, there are generated spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which the Point Cloud data is segmented, and grouping information that groups the partial Point Cloud data. The present technology is applicable to a generating apparatus that generates G-PCC streams, for example.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: December 20, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Mitsuru Katsumata, Takumi Tsuru, Ohji Nakagami, Satoru Kuma
  • Publication number: 20220383587
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Application
    Filed: August 10, 2022
    Publication date: December 1, 2022
    Applicant: SONY CORPORATION
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI, Satoru KUMA
  • Patent number: 11516453
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that enable processing to be performed simply, and a program. By converting a point cloud representing a three-dimensional structure into two dimensions, a geometry image and a texture image, and three-dimensional information metadata required for constructing the geometry image and the texture image in three dimensions are obtained. Then, one PC sample included in a Point Cloud displayed at a specific time is generated by storing the geometry image, the texture image, and the three-dimensional information metadata in accordance with a playback order required at a time of reproducing and playing back the geometry image and the texture image in three dimensions on the basis of the three-dimensional information metadata. It is possible to apply to a data generation device that generates data for distribution of a Point Cloud.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: November 29, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami
  • Publication number: 20220375136
    Abstract: The present disclosure relates to an information processing apparatus and method for reducing a decrease in coding efficiency. The information processing apparatus encodes information regarding the luminance of a point corresponding to the lowest hierarchical level in hierarchized geometry data, and information regarding the color of a point corresponding to a predetermined hierarchical level higher than the lowest hierarchical level in the geometry data, in a point cloud expressing a three-dimensional object as a set of points. The present disclosure can be applied to an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: October 23, 2020
    Publication date: November 24, 2022
    Inventors: TSUYOSHI KATO, SATORU KUMA, OHJI NAKAGAMI, HIROYUKI YASUDA, KOJI YANO
  • Patent number: 11508096
    Abstract: The present disclosure relates to information processing apparatus and method that makes it possible to suppress a reduction in encoding efficiency. Information relating to quantization of a three-dimensional position of an encoding target is generated. For example, the information relating to the quantization includes information relating to a coordinate system to be subjected to the quantization, information relating to a bounding box for normalization of position information of the encoding target, or information relating to a voxel for quantization of position information of the encoding target. In addition, three-dimensional information of the encoding target is restored from a signal string on the basis of the information relating to the quantization of the three-dimensional position of the encoding target.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: November 22, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Publication number: 20220353493
    Abstract: The present disclosure relates to an information processing apparatus and a method for achieving scalability of the number of points in point cloud data. Encoded data of a point cloud representing a three-dimensional object as a point group is decoded, a tree structure using the positional information about the respective points constituting the point cloud is generated, and the number of nodes corresponding to the depth of the level of detail is selected for some or all of the levels of detail constituting the tree structure. The present disclosure can be applied to an information processing apparatus, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: June 11, 2020
    Publication date: November 3, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI, Hiroyuki YASUDA, Koji YANO
  • Publication number: 20220353492
    Abstract: The present disclosure relates to an information processing device and a method capable of suppressing a reduction in encoding efficiency of point cloud data. As for a point cloud representing an object having a three-dimensional shape as a point group, position information of a point to be processed is predicted on the basis of position information of a reference point, position information of a prediction point is generated, a difference between the generated position information of the prediction point and the position information of the point to be processed is derived, the derived difference is encoded, and a bitstream is generated. The present disclosure may be applied to, for example, an information processing device, an electronic device, an information processing method, a program or the like.
    Type: Application
    Filed: June 11, 2020
    Publication date: November 3, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Koji YANO, Hiroyuki YASUDA, Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI
  • Patent number: 11481961
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Grant
    Filed: September 18, 2019
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryohei Takahashi, Mitsuhiro Hirabayashi, Ohji Nakagami, Satoru Kuma
  • Patent number: 11468603
    Abstract: The present disclosure relates to an information processing apparatus and a method that allows for suppression of a decrease in encoding efficiency. In comparison of voxel data resulting from quantization of point cloud data, a correlation degree of a distribution pattern between voxel data to be compared is calculated on the basis of a subjective feature of the distribution pattern of values of the voxel data. The present disclosure is applicable to an information processing apparatus, an image processing apparatus, an electronic device, an information processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: October 11, 2022
    Assignee: SONY CORPORATION
    Inventors: Koji Yano, Ohji Nakagami, Satoru Kuma, Tsuyoshi Kato
  • Publication number: 20220312035
    Abstract: The present disclosure provides an information processing apparatus, information processing method, reproduction processing apparatus, and reproduction processing method, capable of providing a viewing experience that meets the viewer's requests. An encoding unit (121) encodes point cloud data in such a way as to have a phased hierarchical structure corresponding to a level of detail (LoD) indicating a level of quality to generate a bitstream being constituted of a data region including one or more geometry slices. A metadata generation unit (125) generates partial slice-specific information being used for specifying a correspondence of the LoD to a partial slice used as a partial region corresponding to the LoD in the geometry slice. A file creation unit (126) creates a file including the partial slice-specific information.
    Type: Application
    Filed: August 28, 2020
    Publication date: September 29, 2022
    Applicant: Sony Group Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI
  • Publication number: 20220303578
    Abstract: There is provided an image processing apparatus and a method designed to be capable of reducing degradation of the subjective quality of a point cloud. Encoded data of a frame image in which a projection image of a point cloud representing a three-dimensional object as a set of points on a two-dimensional plane is placed is decoded, the frame image obtained by decoding the encoded data is unpacked to extract the projection image, and the respective points included in the extracted projection image are arranged in a three-dimensional space. When the coordinates of a point are not integer values in a basic coordinate system that is a predetermined coordinate system of the three-dimensional space, the point is moved in a direction perpendicular to the two-dimensional plane so that the coordinates of the point become integer values. Thus, the point cloud is reconstructed.
    Type: Application
    Filed: October 30, 2020
    Publication date: September 22, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Tsuyoshi KATO, Hiroyuki YASUDA
  • Publication number: 20220286679
    Abstract: There is provided an information processing device and method capable of inhibiting deterioration in encoding efficiency. Attribute information of a point cloud in which 3-dimensional shaped objects are expressed as a set of points is hierarchized to generate a reference relation of the attribute information between layers, and the attribute information of a layer in the layer of the generated attribute information is sub-hierarchized to generate a reference relation of the attribute information between sub-layers. The present disclosure can be applied to, for example, an information processing device, an image processing device, an encoding device, a decoding device, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: June 26, 2020
    Publication date: September 8, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Hiroyuki YASUDA, Tsuyoshi KATO
  • Publication number: 20220277517
    Abstract: The present disclosure relates to an information processing device and method capable of curbing coding efficiency reduction. On the basis of position information indicating positions of points of a point cloud in units of first regions, for each second region composed of a plurality of first regions, a neighboring pattern of each first region including the points is specified by identifying whether or not each neighboring region adjacent to a processing target region includes the points or is positioned outside the second region including the processing target region, a context is selected according to the specified neighboring pattern, and the position information is coded using the selected context. The present disclosure can be applied to, for example, an information processing device, an image processing device, a coding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like.
    Type: Application
    Filed: July 30, 2020
    Publication date: September 1, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Koji YANO, Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI, Hiroyuki YASUDA
  • Publication number: 20220262043
    Abstract: There is provided an information processing apparatus and method which enable an increase in a load of decoding processing of coded data of a point cloud to be suppressed. Positional information of a point cloud expressing an object with a three-dimensional shape as a set of points is encoded in an order which causes a decoding result of coded data of the positional information to be output in a processing order of attribute information of the point cloud, and coded data thereof is generated. In addition, coded data of positional information of a point cloud expressing an object with a three-dimensional shape as a set of points is decoded and a decoding result thereof is to be output in a processing order of attribute information of the point cloud. For example, the present disclosure can be applied to an information processing apparatus, an image processing apparatus, a coding apparatus, a decoding apparatus, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: July 6, 2020
    Publication date: August 18, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Ohji NAKAGAMI, Koji YANO, Satoru KUMA, Hiroyuki YASUDA, Tsuyoshi KATO
  • Publication number: 20220245863
    Abstract: The present disclosure relates to an information processing device and method capable of curbing reduction in encoding efficiency. In an information processing device for processing attribute information of each point of a point cloud representing an object in a three-dimensional shape as a set of points, a first level is hierarchized using a first hierarchization method and a second level different from the first level is hierarchized using a second hierarchization method different from the first hierarchization method at the time of performing hierarchization of attribute information by recursively repeating processing of, among points classified as a predictive point or a reference point, deriving a difference value between a predictive value of attribute information of the predictive point derived using attribute information of the reference point and the attribute information of the predictive point for the reference point to perform hierarchization of the attribute information.
    Type: Application
    Filed: June 18, 2020
    Publication date: August 4, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Hiroyuki YASUDA, Tsuyoshi KATO
  • Patent number: 11405644
    Abstract: An image processing apparatus and a method comprises generating a video frame that includes a patch obtained by projecting, onto a two dimensional plane, a point cloud that represents an object having a three-dimensional shape as a group of points; generating a thumbnail two-dimensional image, the thumbnail two-dimensional image being generated independently from the patch; embedding the thumbnail two-dimensional image into the video frame; and encoding the video frame to generate a bitstream.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: August 2, 2022
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Tsuyoshi Kato, Satoru Kuma
  • Patent number: 11399189
    Abstract: The present disclosure relates to an image processing apparatus and a method that make it possible to suppress reduction of the encoding efficiency. A patch, which is an image where 3D data representative of a three-dimensional structure is projected on a two-dimensional plane, is placed and packed in a frame image on the basis of an evaluation of a result of prediction performed in encoding of the 3D data, and the frame image in which the patch is placed and packed is encoded using the prediction. The present disclosure can be applied, for example, to an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program or the like.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: July 26, 2022
    Assignee: SONY CORPORATION
    Inventors: Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Koji Yano
  • Patent number: 11373339
    Abstract: A method of compressing untracked and tracked meshes using a projection-based approach, and leveraging the tools and syntax already generated for projection-based point cloud compression is described herein. Similar to the V-PCC approach, the mesh is segmented into surface patches, where a difference is that the segments follow the connectivity of the mesh. Each surface patch (or 3D patch) is then projected to a 2D patch, whereby in the case of the mesh, the triangle surface sampling is similar to a common rasterization approach used in computer graphics. For each patch, the position of the projected vertices is kept in a list, along with the connectivity of those vertices. The sampled surface resembles a point cloud and is coded with the same approach used for point cloud compression. Additionally, the list of vertices and connectivity is encoded per patch, and the data is sent along with the coded point cloud data.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: June 28, 2022
    Assignee: Sony Group Corporation
    Inventors: Danillo Graziosi, Ohji Nakagami, Alexandre Zaghetto, Ali Tabatabai
  • Patent number: 11375208
    Abstract: Trisoup node size per slice enables flexibility when encoding a point cloud. Instead of each block/node being the same size, a user or machine is able to indicate block/node sizes such that regions of interest are able to have smaller node sizes for more specificity in that region.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: June 28, 2022
    Assignee: Sony Group Corporation
    Inventors: Alexandre Zaghetto, Danillo Graziosi, Ali Tabatabai, Ohji Nakagami