Patents by Inventor Ohji Nakagami

Ohji Nakagami has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240129529
    Abstract: There is provided an image processing device and method capable of suppressing an increase in the amount of coding. A spraying attribute projection image, which is used for spraying for adding an attribute to a geometry in the reconstruction of 3D data in a three-dimensional space, is generated by projecting an attribute of 3D data representing an object in a three-dimensional shape onto a two-dimensional plane independently of the projection of the geometry of the 3D data onto the two-dimensional plane, and coding is performed on a frame image in which the spraying attribute projection image is disposed. The present disclosure can be applied to, for example, an image processing device, an electronic device, an image processing method, or a program or the like.
    Type: Application
    Filed: January 19, 2022
    Publication date: April 18, 2024
    Applicant: Sony Group Corporation
    Inventors: Kao HAYASHI, Satoru KUMA, Ohji NAKAGAMI, Tsuyoshi KATO, Koji YANO
  • Publication number: 20240129555
    Abstract: The present disclosure relates to an image processing apparatus and a method that enable decoding of encoded data of an octree in various processing orders. The octree corresponding to point cloud data is encoded after the context is initialized for each layer of the octree. Further, a breadth-first order or a depth-first order is selected as the decoding order for the encoded data of the octree corresponding to point cloud data, and the encoded data is decoded in the selected decoding order. The present disclosure can be applied to an image processing apparatus, an electronic apparatus, an image processing method, a program, or the like, for example.
    Type: Application
    Filed: December 27, 2023
    Publication date: April 18, 2024
    Inventors: KOJI YANO, TSUYOSHI KATO, SATORU KUMA, OHJI NAKAGAMI
  • Patent number: 11948337
    Abstract: The present disclosure relates to image processing apparatus and method that can prevent a reduction in image quality. Geometry data that is a frame image having arranged thereon a projected image obtained by projecting 3D data representing a three-dimensional structure on a two-dimensional plane and includes a special value indicating occupancy map information in a range is generated. The generated geometry data is encoded. Further, the encoded data on the geometry data is decoded, and a depth value indicating a position of the 3D data and the occupancy map information are extracted from the decoded geometry data. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, or a program.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: April 2, 2024
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Hiroyuki Yasuda, Koji Yano, Tsuyoshi Kato
  • Patent number: 11943457
    Abstract: There is provided an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an information processing method, and a program that facilitate scalable decoding of attribute information. Regarding the attribute information about a point cloud representing a three-dimensional object, a process of classifying the respective points of the point cloud into prediction points that are the points at which difference values between the attribute information and predicted values are left, and reference points that are the points at which the attribute information is referred to during derivation of the predicted values is recursively repeated on the reference points, so that the attribute information is hierarchized.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: March 26, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Hiroyuki Yasuda, Koji Yano
  • Patent number: 11922579
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of suppressing an increase in loads when a point cloud is generated from a mesh. Point cloud data is generated by positioning points at intersection points between a surface of a mesh and vectors each including, as a start origin, position coordinates corresponding to a specified resolution. For example, intersection determination is performed between the surface of the mesh and each of the vectors, and in a case where the surface and the vector are determined to intersect each other, the coordinates of the intersection point are calculated. The present disclosure can be applied to an image processing apparatus, electronic equipment, an image processing method, a program, or the like.
    Type: Grant
    Filed: December 21, 2022
    Date of Patent: March 5, 2024
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Satoru Kuma, Tsuyoshi Kato, Hiroyuki Yasuda
  • Patent number: 11917201
    Abstract: The present disclosure relates to an information processing apparatus and an information generation method that enable suppression of deterioration in subjective quality of a point cloud. There is generated an occupancyMap indicating, for each local area of a frame image, presence or absence of a projection image of a point cloud on a two-dimensional plane in accordance with a positional relationship of points in a three-dimensional space, while the point cloud represents an object having a three-dimensional shape as a set of the points. The present disclosure can be applied to, for example, an information processing apparatus, an encoding device, a decoding device, or the like.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: February 27, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Tsuyoshi Kato, Koji Yano
  • Patent number: 11915390
    Abstract: There is provided an image processing device and a method capable of suppressing lowering of image quality. Correction information that is information regarding correction of 3D data representing a three-dimensional structure constructed using 2D data representing a two-dimensional image is generated, and the generated correction information is coded. Furthermore, coded data of correction information that is information regarding correction of 3D data representing a three-dimensional structure constructed using 2D data representing a two-dimensional image is decoded, and 3D data is constructed using the 2D data and correction information generated by decoding coded data of the correction information. The present disclosure can be applied to, for example, an information processing device, an image processing device, an electronic apparatus, an information processing method, a program, or the like.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: February 27, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Patent number: 11910026
    Abstract: The present disclosure relates to an image processing apparatus and a method that enable decoding of encoded data of an octree in various processing orders. The octree corresponding to point cloud data is encoded after the context is initialized for each layer of the octree. Further, a breadth-first order or a depth-first order is selected as the decoding order for the encoded data of the octree corresponding to point cloud data, and the encoded data is decoded in the selected decoding order. The present disclosure can be applied to an image processing apparatus, an electronic apparatus, an image processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 13, 2019
    Date of Patent: February 20, 2024
    Assignee: SONY CORPORATION
    Inventors: Koji Yano, Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami
  • Publication number: 20240056604
    Abstract: There is provided an information processing apparatus and method that enable attribute data to be decoded more reliably. Nearby point search for setting a reference point to be referred to when deriving a prediction value of attribute data of a processing target node is executed only for a node that is decoded earlier than the processing target node at the time of decoding among nodes of a tree structure in which attribute data of each point of a point cloud expressing an object having a three-dimensional shape as a set of points is a node and slices serving as node groups that can be encoded independently of each other are formed. The present disclosure can be applied to, for example, an information processing apparatus, an encoding apparatus, a decoding apparatus, an electronic device, an information processing method, or a program.
    Type: Application
    Filed: December 14, 2021
    Publication date: February 15, 2024
    Applicant: Sony Group Corporation
    Inventors: Satoru KUMA, Ohji NAKAGAMI
  • Publication number: 20230388525
    Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.
    Type: Application
    Filed: August 15, 2023
    Publication date: November 30, 2023
    Applicant: SONY CORPORATION
    Inventors: Shinobu HATTORI, Ohji NAKAGAMI, Mitsuhiro HIRABAYASHI
  • Publication number: 20230377100
    Abstract: A filter process is performed on point cloud data using a representative value of the point cloud data for each local region obtained by dividing a three-dimensional space. A two-dimensional plane image on which the point cloud data subjected to the filter process is projected is encoded, and a bitstream is generated. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.
    Type: Application
    Filed: July 14, 2023
    Publication date: November 23, 2023
    Applicant: Sony Group Corporation
    Inventors: Koji YANO, Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI
  • Publication number: 20230370636
    Abstract: There is provided an image processing device and a method that enables the number of attributes corresponding to a single geometry to be variable in a time direction. An attribute video frame that is a video frame in which a patch obtained by projecting each of a plurality of attributes to a two-dimensional plane for each partial region is arranged is generated, the plurality of attributes corresponding to a single geometry of a point cloud that expresses an object with a three-dimensional shape as a group of points, the generated attribute video frame for each attribute is coded, and attribute information that is information indicating the generated attribute video frames corresponding to the same timing is generated. The present disclosure can be applied to, for example, an image processing device, electronic equipment, an image processing method, a program, or the like.
    Type: Application
    Filed: September 24, 2021
    Publication date: November 16, 2023
    Applicant: Sony Group Corporation
    Inventors: Kao HAYASHI, Satoru KUMA, Ohji NAKAGAMI
  • Publication number: 20230370637
    Abstract: There is provided an image processing device and method capable of suppressing an increase in amount of code. For example, a patch generation parameter used in patch generation processing for generating a patch of an attribute serving as a processing target by referring to an attribute different from the attribute serving as the processing target is derived for some of a plurality of attributes corresponding to single geometry of a point cloud that expresses an object having a three-dimensional shape as a set of points, the derived patch generation parameter is encoded, and an attribute video frame in which a base patch representing a base attribute that is an attribute different from some of the plurality of attributes has been arranged is encoded. The present disclosure can be applied to, for example, an image processing device, an electronic device, an image processing method, or a program.
    Type: Application
    Filed: September 24, 2021
    Publication date: November 16, 2023
    Applicant: Sony Group Corporation
    Inventors: Kao HAYASHI, Satoru KUMA, Ohji NAKAGAMI
  • Patent number: 11812042
    Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.
    Type: Grant
    Filed: December 27, 2021
    Date of Patent: November 7, 2023
    Assignee: SONY CORPORATION
    Inventors: Shinobu Hattori, Ohji Nakagami, Mitsuhiro Hirabayashi
  • Publication number: 20230353786
    Abstract: In image encoding, to raise the degree of concentration of coefficient energy, there is disclosed the application of a secondary transform different from a primary transform to the transform coefficients after the primary transform. Since the transform coefficients after multiple transforms are applied may be transformed to a different domain than the frequency domain with respect to the original image characteristics, bandwidth control using a scaling list for the frequency domain (quantization matrix) is affected. Consequently, even in the case in which multiple transforms are applied, it is an object to provide a mechanism enabling bandwidth control using a scaling list. To achieve the above object, the present invention provides an image processing apparatus including a process control section that controls a scaling list process on the basis of transform information related to a transform applied to a processing target block and an image processing method.
    Type: Application
    Filed: June 30, 2023
    Publication date: November 2, 2023
    Inventor: OHJI NAKAGAMI
  • Publication number: 20230342981
    Abstract: There is provided an information processing device and method capable of suppressing an increase in a load of processing for decoding point cloud data. Slice correspondence information that is information indicating a slice of geometry data corresponding to a resolution and a region of a geometry is generated for a point cloud representing an object having a three-dimensional shape as a set of points, and the geometry data and the generated slice correspondence information are encoded so that a bitstream of the geometry is generated. The present disclosure can be applied to, for example, an information processing device, an encoding device, a decoding device, an electronic device, an information processing method, or a program.
    Type: Application
    Filed: September 24, 2021
    Publication date: October 26, 2023
    Applicant: Sony Group Corporation
    Inventors: Satoru KUMA, Ohji NAKAGAMI
  • Publication number: 20230334704
    Abstract: The present disclosure relates to an information processing apparatus and method capable of reducing a decrease in flexibility in controlling an amount of coding point cloud data. There are formed a reference structure of geometry data in coding of a point cloud that represents a three-dimensional object as a set of points, corrected the geometry data so that a coding amount decreases, derived, on the basis of the formed reference structure, a predicted value of the corrected geometry data, derived a predictive residual that is a difference between the geometry data and the predicted value, and coded the derived predictive residual. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, a coding apparatus, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: August 12, 2021
    Publication date: October 19, 2023
    Inventors: SATORU KUMA, OHJI NAKAGAMI
  • Patent number: 11790602
    Abstract: The present disclosure relates to an information processing device and method capable of curbing coding efficiency reduction. On the basis of position information indicating positions of points of a point cloud in units of first regions, for each second region composed of a plurality of first regions, a neighboring pattern of each first region including the points is specified by identifying whether or not each neighboring region adjacent to a processing target region includes the points or is positioned outside the second region including the processing target region, a context is selected according to the specified neighboring pattern, and the position information is coded using the selected context. The present disclosure can be applied to, for example, an information processing device, an image processing device, a coding device, a decoding device, an electronic apparatus, an information processing method, a program, or the like.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: October 17, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Koji Yano, Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Hiroyuki Yasuda
  • Patent number: 11790567
    Abstract: The present disclosure relates to an information processing apparatus and method that are capable of suppressing a decrease in encoding efficiency. When point cloud data is to be Octree-encoded, a point distribution of child nodes of a current node is updated in accordance with a peripheral point distribution around the current node, and then a sequence of signals is generated by performing Octree encoding with the updated point distribution. The present disclosure is applicable, for example, to information processing apparatuses, image processing apparatuses, electronic equipment, information processing methods, or programs.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: October 17, 2023
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Satoru Kuma, Tsuyoshi Kato
  • Publication number: 20230316582
    Abstract: There is provided an information processing apparatus and method that enable easier control of an information amount of point cloud data. A reference structure of geometry data in encoding of a point cloud is formed, in which the reference structure is layered according to groups into which points of the point cloud representing a three-dimensional shaped object as a set of the points are classified. On the basis of the formed reference structure, for each point, a prediction value of the geometry data is derived, and a prediction residual that is a difference between the geometry data and the prediction value is derived. The derived prediction residual of the geometry data of each point is encoded. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, an encoding device, a decoding device, an electronic device, an information processing method, a program, or the like.
    Type: Application
    Filed: June 16, 2021
    Publication date: October 5, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Satoru KUMA, Hiroyuki YASUDA, Ohji NAKAGAMI