Patents by Inventor Satoru Kuma

Satoru Kuma has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220286679
    Abstract: There is provided an information processing device and method capable of inhibiting deterioration in encoding efficiency. Attribute information of a point cloud in which 3-dimensional shaped objects are expressed as a set of points is hierarchized to generate a reference relation of the attribute information between layers, and the attribute information of a layer in the layer of the generated attribute information is sub-hierarchized to generate a reference relation of the attribute information between sub-layers. The present disclosure can be applied to, for example, an information processing device, an image processing device, an encoding device, a decoding device, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: June 26, 2020
    Publication date: September 8, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Hiroyuki YASUDA, Tsuyoshi KATO
  • Publication number: 20220277517
    Abstract: The present disclosure relates to an information processing device and method capable of curbing coding efficiency reduction. On the basis of position information indicating positions of points of a point cloud in units of first regions, for each second region composed of a plurality of first regions, a neighboring pattern of each first region including the points is specified by identifying whether or not each neighboring region adjacent to a processing target region includes the points or is positioned outside the second region including the processing target region, a context is selected according to the specified neighboring pattern, and the position information is coded using the selected context. The present disclosure can be applied to, for example, an information processing device, an image processing device, a coding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like.
    Type: Application
    Filed: July 30, 2020
    Publication date: September 1, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Koji YANO, Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI, Hiroyuki YASUDA
  • Publication number: 20220262043
    Abstract: There is provided an information processing apparatus and method which enable an increase in a load of decoding processing of coded data of a point cloud to be suppressed. Positional information of a point cloud expressing an object with a three-dimensional shape as a set of points is encoded in an order which causes a decoding result of coded data of the positional information to be output in a processing order of attribute information of the point cloud, and coded data thereof is generated. In addition, coded data of positional information of a point cloud expressing an object with a three-dimensional shape as a set of points is decoded and a decoding result thereof is to be output in a processing order of attribute information of the point cloud. For example, the present disclosure can be applied to an information processing apparatus, an image processing apparatus, a coding apparatus, a decoding apparatus, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: July 6, 2020
    Publication date: August 18, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Ohji NAKAGAMI, Koji YANO, Satoru KUMA, Hiroyuki YASUDA, Tsuyoshi KATO
  • Publication number: 20220245863
    Abstract: The present disclosure relates to an information processing device and method capable of curbing reduction in encoding efficiency. In an information processing device for processing attribute information of each point of a point cloud representing an object in a three-dimensional shape as a set of points, a first level is hierarchized using a first hierarchization method and a second level different from the first level is hierarchized using a second hierarchization method different from the first hierarchization method at the time of performing hierarchization of attribute information by recursively repeating processing of, among points classified as a predictive point or a reference point, deriving a difference value between a predictive value of attribute information of the predictive point derived using attribute information of the reference point and the attribute information of the predictive point for the reference point to perform hierarchization of the attribute information.
    Type: Application
    Filed: June 18, 2020
    Publication date: August 4, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Hiroyuki YASUDA, Tsuyoshi KATO
  • Patent number: 11405644
    Abstract: An image processing apparatus and a method comprises generating a video frame that includes a patch obtained by projecting, onto a two dimensional plane, a point cloud that represents an object having a three-dimensional shape as a group of points; generating a thumbnail two-dimensional image, the thumbnail two-dimensional image being generated independently from the patch; embedding the thumbnail two-dimensional image into the video frame; and encoding the video frame to generate a bitstream.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: August 2, 2022
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Tsuyoshi Kato, Satoru Kuma
  • Patent number: 11399189
    Abstract: The present disclosure relates to an image processing apparatus and a method that make it possible to suppress reduction of the encoding efficiency. A patch, which is an image where 3D data representative of a three-dimensional structure is projected on a two-dimensional plane, is placed and packed in a frame image on the basis of an evaluation of a result of prediction performed in encoding of the 3D data, and the frame image in which the patch is placed and packed is encoded using the prediction. The present disclosure can be applied, for example, to an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program or the like.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: July 26, 2022
    Assignee: SONY CORPORATION
    Inventors: Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Koji Yano
  • Publication number: 20220191520
    Abstract: There is provided an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an information processing method, and a program that facilitate scalable decoding of attribute information. Regarding the attribute information about a point cloud representing a three-dimensional object, a process of classifying the respective points of the point cloud into prediction points that are the points at which difference values between the attribute information and predicted values are left, and reference points that are the points at which the attribute information is referred to during derivation of the predicted values is recursively repeated on the reference points, so that the attribute information is hierarchized.
    Type: Application
    Filed: March 5, 2020
    Publication date: June 16, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI, Hiroyuki YASUDA, Koji YANO
  • Publication number: 20220182670
    Abstract: The present disclosure relates to an information processing apparatus and an information generation method that enable suppression of deterioration in subjective quality of a point cloud. There is generated an occupancyMap indicating, for each local area of a frame image, presence or absence of a projection image of a point cloud on a two-dimensional plane in accordance with a positional relationship of points in a three-dimensional space, while the point cloud represents an object having a three-dimensional shape as a set of the points. The present disclosure can be applied to, for example, an information processing apparatus, an encoding device, a decoding device, or the like.
    Type: Application
    Filed: December 24, 2019
    Publication date: June 9, 2022
    Applicant: Sony Group Corporation
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Tsuyoshi KATO, Koji YANO
  • Patent number: 11356690
    Abstract: The present disclosure relates to an image processing apparatus and a method that allow for easier and more appropriate rendering. Coded data is generated by encoding a two-dimensional plane image in which position information and attribute information for a point cloud that represents an object having a three-dimensional shape as a group of points are projected onto a two-dimensional plane, and a bitstream that includes the generated coded data and metadata to be used to render the point cloud is generated. The present disclosure can be applied to, for example, an image processing apparatus, an electronic device, an image processing method, a program, or the like.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: June 7, 2022
    Assignee: SONY CORPORATION
    Inventors: Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Koji Yano
  • Patent number: 11315320
    Abstract: There is provided an information processing apparatus and method that makes it possible to suppress a reduction in a subjective image quality. Point cloud data before update of position information is searched for a point to be compared, the point to be compared being a point to be compared with a current point, the current point being a processing target point of the point cloud data with the updated position information, and the retrieved point to be compared is compared with the current point, and attribute information of the current point is set. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, etc.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: April 26, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Tsuyoshi Kato, Ohji Nakagami, Koji Yano
  • Patent number: 11310518
    Abstract: An image processing apparatus and method that make it possible to decode encoded data of 3D data with increased ease. A bit stream is generated which includes projection direction information including information relating to a projection direction of position information of 3D data representative of a three-dimensional structure on a two-dimensional plane and encoded data of a geometry image obtained by projecting the position information on the two-dimensional plane.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: April 19, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Publication number: 20220058832
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method each capable of reducing image quality deterioration. A connection component constituted by points that are included in a point group representing a three-dimensional structure, located adjacent to each other, and projected in an identical direction is projected on a two-dimensional plane in a plurality of directions to generate patches in the respective directions. A frame image where the generated patches in the respective directions are arranged is coded. For example, the present disclosure is applicable to an information processing apparatus, an image processing apparatus, an electronic apparatus, an information processing method, a program, or the like.
    Type: Application
    Filed: December 13, 2019
    Publication date: February 24, 2022
    Inventors: SATORU KUMA, OHJI NAKAGAMI, KOJI YANO, TSUYOSHI KATO
  • Publication number: 20220044448
    Abstract: There is provided an image processing device and a method that are configured to be capable of reducing the increase of a load on encoding/decoding of attribute information of a point cloud. The attribute information of the point cloud is encoded using contexts corresponding to weight values obtained by an orthogonal transformation made on location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure. Further, encoded data associated with the attribute information of the point cloud is decoded using contexts corresponding to weight values obtained by an orthogonal transformation made on the location information of the point cloud, the orthogonal transformation taking into consideration a three-dimensional structure. The present disclosure can be applied to, for example, image processing devices, electronic equipment, image processing methods, programs, and the like.
    Type: Application
    Filed: September 18, 2019
    Publication date: February 10, 2022
    Applicant: SONY CORPORATION
    Inventors: Ohji NAKAGAMI, Koji YANO, Satoru KUMA, Tsuyoshi KATO
  • Publication number: 20220036654
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of suppressing an increase in loads when a point cloud is generated from a mesh. Point cloud data is generated by positioning points at intersection points between a surface of a mesh and vectors each including, as a start origin, position coordinates corresponding to a specified resolution. For example, intersection determination is performed between the surface of the mesh and each of the vectors, and in a case where the surface and the vector are determined to intersect each other, the coordinates of the intersection point are calculated. The present disclosure can be applied to an image processing apparatus, electronic equipment, an image processing method, a program, or the like.
    Type: Application
    Filed: September 18, 2019
    Publication date: February 3, 2022
    Applicant: SONY CORPORATION
    Inventors: Ohji NAKAGAMI, Koji YANO, Satoru KUMA, Tsuyoshi KATO, Hiroyuki YASUDA
  • Publication number: 20220036593
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that are capable of distributing higher-quality G-PCC streams. When G-PCC streams obtained by encoding Point Cloud data according to G-PCC are generated, there are generated spatial positional information indicating spatial positions of respective pieces of partial Point Cloud data that represent individual parts into which the Point Cloud data is segmented, and grouping information that groups the partial Point Cloud data. The present technology is applicable to a generating apparatus that generates G-PCC streams, for example.
    Type: Application
    Filed: December 16, 2019
    Publication date: February 3, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Mitsuru KATSUMATA, Takumi TSURU, Ohji NAKAGAMI, Satoru KUMA
  • Publication number: 20220038751
    Abstract: The present disclosure relates to an image processing apparatus and a method that enable decoding of encoded data of an octree in various processing orders. The octree corresponding to point cloud data is encoded after the context is initialized for each layer of the octree. Further, a breadth-first order or a depth-first order is selected as the decoding order for the encoded data of the octree corresponding to point cloud data, and the encoded data is decoded in the selected decoding order. The present disclosure can be applied to an image processing apparatus, an electronic apparatus, an image processing method, a program, or the like, for example.
    Type: Application
    Filed: September 13, 2019
    Publication date: February 3, 2022
    Inventors: KOJI YANO, TSUYOSHI KATO, SATORU KUMA, OHJI NAKAGAMI
  • Publication number: 20220038674
    Abstract: There is provided an image processing device and a method that enable partial decoding of 3D data to be performed more easily. Management information of a block as a partial region in a predetermined three-dimensional spatial region including 3D data representing a three-dimensional structure is generated. In addition, a block satisfying a condition specified by a user is selected on the basis of management information of the block as a partial region in a predetermined three-dimensional spatial region including 3D data representing a three-dimensional structure, and coded data of the 3D data within the selected block is decoded. The present disclosure can be applied to, for example, an image processing device, an electronic apparatus, an image processing method, a program, or the like.
    Type: Application
    Filed: September 18, 2019
    Publication date: February 3, 2022
    Applicant: SONY CORPORATION
    Inventors: Hiroyuki YASUDA, Ohji NAKAGAMI, Satoru KUMA, Koji YANO, Tsuyoshi KATO
  • Patent number: 11227436
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method capable of suppressing a reduction in quality of rendering results. Rendering is performed on voxel data that is 3D data obtained by quantizing position information using voxels and representing a three-dimensional structure in response to a shape of each of the voxels. Alternatively, rendering is performed on voxel data that is 3D data obtained by quantizing position information using voxels and representing a three-dimensional structure on the basis of rendering information that is information related to the rendering of the voxel data. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, an electronic apparatus, an information processing method, a program, and the like.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: January 18, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Publication number: 20220012849
    Abstract: There is provided an image processing device and a method capable of suppressing lowering of image quality. Correction information that is information regarding correction of 3D data representing a three-dimensional structure constructed using 2D data representing a two-dimensional image is generated, and the generated correction information is coded. Furthermore, coded data of correction information that is information regarding correction of 3D data representing a three-dimensional structure constructed using 2D data representing a two-dimensional image is decoded, and 3D data is constructed using the 2D data and correction information generated by decoding coded data of the correction information. The present disclosure can be applied to, for example, an information processing device, an image processing device, an electronic apparatus, an information processing method, a program, or the like.
    Type: Application
    Filed: December 24, 2019
    Publication date: January 13, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Tsuyoshi KATO
  • Patent number: 11200703
    Abstract: An information processing device and method for enabling partial control of the resolution of a data group that can be turned into a tree structure. Data of an Octree pattern is encoded, so that a bit stream containing depth control information indicating that a leaf node is to be formed at a different level from the lowest level based on information specifying the depth of the Octree pattern is generated. Also, a bit stream is decoded, so that an Octree pattern including a leaf node at a different level from the lowest level is constructed, on the basis of depth control information indicating that the leaf node is to be formed at a different level from the lowest level based on information specifying the depth of the Octree pattern. The present disclosure can be applied to an information processing device, an image processing device, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: December 14, 2021
    Assignee: SONY CORPORATION
    Inventors: Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Koji Yano