Patents by Inventor Ohji Nakagami

Ohji Nakagami has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11218710
    Abstract: The present disclosure relates to an image decoding device capable of recognizing performance necessary for decoding more accurately and a method. Coded data of image data and decoding load definition information for defining a magnitude of a load of a decoding process of a partial region of an image of the image data are acquired; decoding of the acquired coded data is controlled based on the acquired decoding load definition information; and the acquired coded data is decoded according to the controlling. The present disclosure can be applied to an information processing device such as an image coding device that scalably codes image data or an image decoding device that decodes encoded data obtained by scalably coding image data.
    Type: Grant
    Filed: July 9, 2014
    Date of Patent: January 4, 2022
    Assignee: SONY CORPORATION
    Inventors: Shinobu Hattori, Ohji Nakagami, Mitsuhiro Hirabayashi
  • Publication number: 20210400280
    Abstract: Trisoup node size per slice enables flexibility when encoding a point cloud. Instead of each block/node being the same size, a user or machine is able to indicate block/node sizes such that regions of interest are able to have smaller node sizes for more specificity in that region.
    Type: Application
    Filed: September 23, 2020
    Publication date: December 23, 2021
    Inventors: Alexandre Zaghetto, Danillo Graziosi, Ali Tabatabai, Ohji Nakagami
  • Patent number: 11200703
    Abstract: An information processing device and method for enabling partial control of the resolution of a data group that can be turned into a tree structure. Data of an Octree pattern is encoded, so that a bit stream containing depth control information indicating that a leaf node is to be formed at a different level from the lowest level based on information specifying the depth of the Octree pattern is generated. Also, a bit stream is decoded, so that an Octree pattern including a leaf node at a different level from the lowest level is constructed, on the basis of depth control information indicating that the leaf node is to be formed at a different level from the lowest level based on information specifying the depth of the Octree pattern. The present disclosure can be applied to an information processing device, an image processing device, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: December 14, 2021
    Assignee: SONY CORPORATION
    Inventors: Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami, Koji Yano
  • Patent number: 11190808
    Abstract: There is provided an image processing apparatus and an image processing method in which S/N can be improved. A class tap selection unit configures a class tap by selecting a pixel that is a class tap used in class classification of classifying a pixel to be processed of a first image obtained by adding a residual error of prediction encoding and a prediction image together, into any one class of a plurality of classes, from the first image. A class classification unit performs the class classification of the pixel to be processed by using the class tap, and a filter processing unit performs filter processing corresponding to class of the pixel to be processed, with respect to the first image, to generate a second image used in prediction of the prediction image. The class tap selection unit updates a tap structure of the class tap to a selected tap structure.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: November 30, 2021
    Assignee: SONY CORPORATION
    Inventors: Takuro Kawai, Kenichiro Hosokawa, Ohji Nakagami, Masaru Ikeda
  • Publication number: 20210358176
    Abstract: The present disclosure relates to image processing apparatus and method that can prevent a reduction in image quality. Geometry data that is a frame image having arranged thereon a projected image obtained by projecting 3D data representing a three-dimensional structure on a two-dimensional plane and includes a special value indicating occupancy map information in a range is generated. The generated geometry data is encoded. Further, the encoded data on the geometry data is decoded, and a depth value indicating a position of the 3D data and the occupancy map information are extracted from the decoded geometry data. The present disclosure is applicable to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, or a program.
    Type: Application
    Filed: September 17, 2019
    Publication date: November 18, 2021
    Inventors: SATORU KUMA, OHJI NAKAGAMI, HIROYUKI YASUDA, KOJI YANO, TSUYOSHI KATO
  • Publication number: 20210343069
    Abstract: There is provided an information processing apparatus and an information processing method that can enhance the image quality while, at the same time, reducing increase in client's throughput. Image data of a plurality of projection directions is generated by projecting 3D data in a plurality of projection directions and converting the 3D data into two-dimensional data, and projection direction information indicating the projection direction of each piece of the image data is generated as projection metadata. Further, the projection direction information includes additional projection direction identification information that indicates that the image data has been generated by projection in additional projection directions. The present technology is applicable, for example, to a data generation apparatus that generates data for delivering a point cloud.
    Type: Application
    Filed: September 18, 2019
    Publication date: November 4, 2021
    Applicant: SONY CORPORATION
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI, Satoru KUMA
  • Patent number: 11140400
    Abstract: An image processing apparatus and an image processing method are provided to reduce a processing load in performing intra BC prediction utilizing correlativity in a screen. A limiting unit limits a motion vector of a current block to be used for the intra BC prediction utilizing the correlativity in the screen, in such a manner that a peripheral pixel of the current block is not used for the intra BC prediction of the current block. An encoding apparatus or the like is provided that performs the intra BC prediction when encoding on a CU (Coding Unit)-by-CU basis in compliance with an HEVC (High Efficiency Video Coding) system, for example.
    Type: Grant
    Filed: May 25, 2016
    Date of Patent: October 5, 2021
    Assignee: SONY CORPORATION
    Inventor: Ohji Nakagami
  • Publication number: 20210297702
    Abstract: In image encoding, to raise the degree of concentration of coefficient energy (concentrate the transform coefficients at low frequencies), there is disclosed the application of a secondary transform different from a primary transform to the transform coefficients after the primary transform. Since the transform coefficients after multiple transforms are applied may be transformed to a different domain than the frequency domain with respect to the original image characteristics, bandwidth control using a scaling list for the frequency domain (quantization matrix) is affected. Consequently, even in the case in which multiple transforms are applied, it is an object to provide a mechanism enabling bandwidth control using a scaling list.
    Type: Application
    Filed: July 7, 2017
    Publication date: September 23, 2021
    Inventor: OHJI NAKAGAMI
  • Publication number: 20210297687
    Abstract: There is provided an encoding apparatus, an encoding method, a decoding apparatus, and a decoding method that can significantly improve S/N of an image. A classification unit classifies a target pixel of a first image, which is obtained by adding a residual of prediction encoding and a predicted image, into one of a plurality of classes, and a filter processing unit applies a filtering process corresponding to the class of the target pixel to the first image to generate a second image used to predict the predicted image. The classification is performed by using previous-stage filter related information regarding a previous-stage filtering process executed in a previous stage of the filtering process of the filter processing unit. The present technique can be applied to, for example, an encoding apparatus or a decoding apparatus of an image.
    Type: Application
    Filed: March 1, 2018
    Publication date: September 23, 2021
    Applicant: SONY CORPORATION
    Inventors: Takuro KAWAI, Kenichiro HOSOKAWA, Ohji NAKAGAMI, Masaru IKEDA
  • Publication number: 20210295566
    Abstract: A method of compressing untracked and tracked meshes using a projection-based approach, and leveraging the tools and syntax already generated for projection-based point cloud compression is described herein. Similar to the V-PCC approach, the mesh is segmented into surface patches, where a difference is that the segments follow the connectivity of the mesh. Each surface patch (or 3D patch) is then projected to a 2D patch, whereby in the case of the mesh, the triangle surface sampling is similar to a common rasterization approach used in computer graphics. For each patch, the position of the projected vertices is kept in a list, along with the connectivity of those vertices. The sampled surface resembles a point cloud and is coded with the same approach used for point cloud compression. Additionally, the list of vertices and connectivity is encoded per patch, and the data is sent along with the coded point cloud data.
    Type: Application
    Filed: January 28, 2021
    Publication date: September 23, 2021
    Inventors: Danillo Graziosi, Ohji Nakagami, Alexandre Zaghetto, Ali Tabatabai
  • Publication number: 20210297696
    Abstract: The present disclosure relates to an image processing apparatus and a method that make it easier to reproduce a two-dimensional image. A video frame that includes a patch obtained by projecting, onto a two-dimensional plane, a point cloud that represents an object having a three-dimensional shape as a group of points, and a two-dimensional image different from the patch is generated, and the generated video frame is encoded and a bitstream is generated. The present disclosure can be applied to, for example, an image processing apparatus, an electronic device, an image processing method, a program, or the like.
    Type: Application
    Filed: July 19, 2019
    Publication date: September 23, 2021
    Applicant: Sony Corporation
    Inventors: Ohji NAKAGAMI, Koji YANO, Tsuyoshi KATO, Satoru KUMA
  • Publication number: 20210289196
    Abstract: An image encoding device and a method, and an image decoding device and a method that are designed to improve encoding efficiency in IntraBC. A screen is divided into four slices (Slices # 0 through # 3). In a case where reference to a different slice is prohibited, the range that can be referred to from the current CTU in Slice # 2 is only the decoded portion in Slice # 2, and therefore, any block in Slice # 1 cannot be referred to, for example. In the case of the present technology, on the other hand, decoded different slices (Slice # 0 and Slice # 1)are included in the referable range, and accordingly, a block in Slice # 1 can be referred to from the current CTU in Slice # 2.
    Type: Application
    Filed: May 28, 2021
    Publication date: September 16, 2021
    Inventor: OHJI NAKAGAMI
  • Publication number: 20210258597
    Abstract: The present technology relates to a decoding device and a decoding method, and an encoding device and an encoding method that enable images that configure a packed image to be reliably displayed when an encoded stream is decoded and displayed. A decoding unit decodes an encoded data, the encoded data being an encoded packed image in which a plurality of images is packed, and generates the packed image. A display control unit identifies the images that configure the packed image based on packing SEI preferentially used when the packed image is displayed. The present technology can be applied to a decoding device, for example.
    Type: Application
    Filed: April 23, 2021
    Publication date: August 19, 2021
    Applicant: SONY CORPORATION
    Inventors: Hironari SAKURAI, Ohji NAKAGAMI, Yoshitomo TAKAHASHI, Teruhiko SUZUKI
  • Patent number: 11095900
    Abstract: A point cloud coding structure defines a “key” point cloud frame, where all references used for predicting point cloud patches are limited to the current point cloud frame. A point cloud patch buffer is described, where the list of reference patches and their respective bounding boxes from a point cloud frame are stored to be used for prediction of patches in another frame. The list of reference patches may contain patches from the past and patches from the future, in case the coding order of point cloud frames is allowed to be different from the presentation order, and bi-directional prediction is used. A similar reference buffer list concept is able to be applied to the layers of the point cloud. A signaling method that correlates the blocks of V-PCC by signaling within the payload the reference to the ID of the block containing the higher-level information is also described.
    Type: Grant
    Filed: May 9, 2019
    Date of Patent: August 17, 2021
    Assignee: Sony Group Corporation
    Inventors: Danillo Graziosi, Ohji Nakagami, Ali Tabatabai
  • Patent number: 11095879
    Abstract: An image encoding device and a method, and an image decoding device and a method that are designed to improve encoding efficiency in IntraBC. A screen is divided into four slices (Slices #0 through #3). In a case where reference to a different slice is prohibited, the range that can be referred to from the current CTU in Slice #2 is only the decoded portion in Slice #2, and therefore, any block in Slice #1 cannot be referred to, for example. In the case of the present technology, on the other hand, decoded different slices (Slice #0 and Slice #1) are included in the referable range, and accordingly, a block in Slice #1 can be referred to from the current CTU in Slice #2.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: August 17, 2021
    Assignee: SONY CORPORATION
    Inventor: Ohji Nakagami
  • Publication number: 20210250600
    Abstract: The present disclosure relates to an image processing apparatus and method that make it possible to decode encoded data of 3D data with increased ease. A bit stream is generated which includes projection direction information including information relating to a projection direction of position information of 3D data representative of a three-dimensional structure on a two-dimensional plane and encoded data of a geometry image obtained by projecting the position information on the two-dimensional plane. The present disclosure can be applied, for example, to an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.
    Type: Application
    Filed: March 28, 2019
    Publication date: August 12, 2021
    Applicant: Sony Corporation
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Tsuyoshi KATO
  • Patent number: 11087501
    Abstract: There is provided an information processing apparatus and a method that allow for suppression of a decrease in encoding efficiency. Correlation information is generated that results from encoding of voxel data resulting from quantization of point cloud data with use of correlation of a distribution pattern of values of the voxel data; the generated correlation information is encoded; and a bit stream including the correlation information is generated. The present disclosure is applicable to an information processing apparatus, an image processing apparatus, an electronic device, an information processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: August 10, 2021
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Satoru Kuma, Tsuyoshi Kato
  • Publication number: 20210233278
    Abstract: The present disclosure relates to an image processing apparatus and method that can prevent an increase in the load of a decoding process for encoded data in a point cloud video-based approach. The parameters related to a plurality of point cloud models of a point cloud are transformed, a two-dimensional plane image onto which the plurality of point cloud models having the transformed parameters is projected is encoded, and a bitstream containing encoded data of the two-dimensional image and transform information that is information regarding the transform of the parameters is generated. The present disclosure can be applied to an information processing device, an image processing apparatus, an electronic apparatus, an information processing method, a program, or the like, for example.
    Type: Application
    Filed: June 27, 2019
    Publication date: July 29, 2021
    Applicant: Sony Corporation
    Inventors: Satoru KUMA, Ohji NAKAGAMI, Koji YANO, Tsuyoshi KATO
  • Publication number: 20210235056
    Abstract: The present disclosure relates to an information processing apparatus and an information processing method that enable processing to be performed simply, and a program. By converting a point cloud representing a three-dimensional structure into two dimensions, a geometry image and a texture image, and three-dimensional information metadata required for constructing the geometry image and the texture image in three dimensions are obtained. Then, one PC sample included in a Point Cloud displayed at a specific time is generated by storing the geometry image, the texture image, and the three-dimensional information metadata in accordance with a playback order required at a time of reproducing and playing back the geometry image and the texture image in three dimensions on the basis of the three-dimensional information metadata. It is possible to apply to a data generation device that generates data for distribution of a Point Cloud.
    Type: Application
    Filed: May 29, 2019
    Publication date: July 29, 2021
    Applicant: Sony Corporation
    Inventors: Ryohei TAKAHASHI, Mitsuhiro HIRABAYASHI, Ohji NAKAGAMI
  • Publication number: 20210217139
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that enable to suppress an increase in processing time of a filter process for point cloud data. A filter process is performed on point cloud data using a representative value of the point cloud data for each local region obtained by dividing a three-dimensional space. A two-dimensional plane image on which the point cloud data subjected to the filter process is projected is encoded, and a bitstream is generated. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.
    Type: Application
    Filed: June 27, 2019
    Publication date: July 15, 2021
    Applicant: Sony Corporation
    Inventors: Koji YANO, Tsuyoshi KATO, Satoru KUMA, Ohji NAKAGAMI