Patents by Inventor Goh Kobayashi

Goh Kobayashi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230196653
    Abstract: There is provided an information processing device, a generation method, and a rendering method that makes it possible to generate a high-quality image while curbing a rendering load. The information processing device of the present technology is a device including a generation unit that generate a plurality of pieces of texture information corresponding to an image when an object is imaged at a plurality of different viewpoints, from texture information corresponding to 3D shape data indicating a shape of the object. The present technology can be applied to an information processing system that generates and transfers 3D data that is used for rendering.
    Type: Application
    Filed: March 19, 2021
    Publication date: June 22, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Goh KOBAYASHI, Yoichi HIROTA
  • Publication number: 20230068299
    Abstract: There is provided an information processing device, an information processing method, and a computer program capable of highly accurately designating a discretionary position in a three-dimensional model.
    Type: Application
    Filed: February 10, 2021
    Publication date: March 2, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Tetsuya KIKUKAWA, Goh KOBAYASHI
  • Patent number: 11557087
    Abstract: Provided are an image processing apparatus and an image processing method that enable a strobe image using a 3D model to be generated. A strobe model in which 3D models of an object at a plurality of times generated from a plurality of viewpoint images captured from a plurality of viewpoints are disposed in a three-dimensional space is generated. When the strobe model is generated, a target object that is a target in which the 3D model is disposed in the strobe model is set according to a degree of object relevance indicating relevance with a key object serving as a reference for disposition of the 3D model in the strobe model.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: January 17, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Goh Kobayashi, Hiroshi Oryoji
  • Patent number: 11282265
    Abstract: There is provided an image processing apparatus and an image processing method capable of transmitting data of a 3D model in object units. The image processing apparatus includes a 3D model selection unit that selects an object that satisfies a predetermined condition from among objects of a plurality of 3D models and a transmitter that transmits 3D model data of the selected object. The present technology is applied to, for example, an apparatus and the like for transmitting 3D model data of a 3D model via a network.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: March 22, 2022
    Assignee: SONY CORPORATION
    Inventor: Goh Kobayashi
  • Publication number: 20220036644
    Abstract: The present technology relates to an image processing apparatus, an image processing method, and a program that enable a strobe image using a 3D model to be generated. A strobe model in which 3D models of an object at a plurality of times generated from a plurality of viewpoint images captured from a plurality of viewpoints are disposed in a three-dimensional space is generated. When the strobe model is generated, a target object that is a target in which the 3D model is disposed in the strobe model is set according to a degree of object relevance indicating relevance with a key object serving as a reference for disposition of the 3D model in the strobe model.
    Type: Application
    Filed: December 5, 2019
    Publication date: February 3, 2022
    Inventors: GOH KOBAYASHI, HIROSHI ORYOJI
  • Patent number: 11200675
    Abstract: There is provided an image processing apparatus and an image processing method that make it possible to reduce the transmission amount of data. The image processing apparatus includes a segmentation section configured to generate, for a plurality of point-of-view images of an object from a plurality of points of view, a plurality of segmentation images each of which is narrowed to a region that includes the object. The present technology can be applied to an encoding device, a decoding device and so forth of a system that performs generation and display of a bird view video, for example, on the basis of a plurality of point-of-view images captured from a plurality of points of view or a plurality of point-of-view images that are CG images from a plurality of points of view.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: December 14, 2021
    Assignee: SONY CORPORATION
    Inventors: Yusuke Seshita, Goh Kobayashi
  • Patent number: 11127194
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of improving the accuracy of a depth image of a 3D model. A depth image generation unit generates a depth image of a plurality of viewpoints for each object included in a 3D model. The present disclosure is applicable to, for example, an encoding device or the like configured to generate a color image and a depth image of each object of each of a plurality of viewpoints on the basis of 3D data of a 3D model, generate an encoded stream by encoding the images, and generate object range information indicating the range of each object.
    Type: Grant
    Filed: October 11, 2017
    Date of Patent: September 21, 2021
    Assignee: SONY CORPORATION
    Inventors: Goh Kobayashi, Junichi Tanaka, Yuichi Araki
  • Patent number: 11055909
    Abstract: There is provided an image processing device and an image processing method that make it possible to reduce a processing load in modeling a plurality of 3D objects. A 3D reconstruction device includes a 3D model generator that acquires object spatial information indicating a 3D region of an object for each object, and generates a 3D model of an object for each object space. For example, the present technology is applicable to an image processing device or the like that generates a 3D model.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: July 6, 2021
    Assignee: SONY CORPORATION
    Inventor: Goh Kobayashi
  • Publication number: 20210142551
    Abstract: There is provided an image processing apparatus and an image processing method capable of transmitting data of a 3D model in object units. The image processing apparatus includes a 3D model selection unit that selects an object that satisfies a predetermined condition from among objects of a plurality of 3D models and a transmitter that transmits 3D model data of the selected object. The present technology is applied to, for example, an apparatus and the like for transmitting 3D model data of a 3D model via a network.
    Type: Application
    Filed: June 15, 2018
    Publication date: May 13, 2021
    Applicant: SONY CORPORATION
    Inventor: Goh KOBAYASHI
  • Patent number: 10887571
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: January 5, 2021
    Assignee: SONY CORPORATION
    Inventors: Kendai Furukawa, Junichi Tanaka, Hiroshi Oryoji, Yuichi Hasegawa, Goh Kobayashi
  • Patent number: 10872456
    Abstract: An image processing device and an image processing method in which a home server that reproduces a 3-dimensional image merely by transmitting a viewing range based on a viewing position and a visual line direction and requesting texture images. The texture images are necessary to generate a 3-dimensional image from a request content server. A content server that groups a plurality of multi-camera units for each of cameras included in the multi-camera unit, sets a priority of the cameras for each group on the basis of an evaluation value of disposition of the cameras in each group, and transmits image data of a surface of the selected cameras in accordance with the set priority and the group selected in accordance with a visual field range of a user to a home server.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: December 22, 2020
    Assignee: Sony Corporation
    Inventor: Goh Kobayashi
  • Publication number: 20200258299
    Abstract: There is provided an image processing device and an image processing method that make it possible to reduce a processing load in modeling a plurality of 3D objects. A 3D reconstruction device includes a 3D model generator that acquires object spatial information indicating a 3D region of an object for each object, and generates a 3D model of an object for each object space. For example, the present technology is applicable to an image processing device or the like that generates a 3D model.
    Type: Application
    Filed: August 8, 2018
    Publication date: August 13, 2020
    Applicant: SONY CORPORATION
    Inventor: Goh KOBAYASHI
  • Patent number: 10735670
    Abstract: The present disclosure relates to an information processing apparatus and information processing method that are aimed at enabling arrangements of a plurality of photographing devices to be easily set to an optimum arrangement for generation of three-dimensional data. An evaluation section calculates an evaluation value of an arrangement for generation of the three-dimensional data on the basis of the arrangements of the plurality of photographing devices that photograph two-dimensional image data used to generate the three-dimensional data of a photographic object. For example, the present disclosure is applicable to the information processing apparatus etc. that display information indicating the arrangements of the plurality of photographing devices that photograph the two-dimensional image data used to generate the three-dimensional data of the photographic object.
    Type: Grant
    Filed: February 8, 2017
    Date of Patent: August 4, 2020
    Assignee: SONY CORPORATION
    Inventor: Goh Kobayashi
  • Publication number: 20200013168
    Abstract: There is provided an image processing apparatus and an image processing method that make it possible to reduce the transmission amount of data. The image processing apparatus includes a segmentation section configured to generate, for a plurality of point-of-view images of an object from a plurality of points of view, a plurality of segmentation images each of which is narrowed to a region that includes the object. The present technology can be applied to an encoding device, a decoding device and so forth of a system that performs generation and display of a bird view video, for example, on the basis of a plurality of point-of-view images captured from a plurality of points of view or a plurality of point-of-view images that are CG images from a plurality of points of view.
    Type: Application
    Filed: February 6, 2018
    Publication date: January 9, 2020
    Applicant: SONY CORPORATION
    Inventors: Yusuke SESHITA, Goh KOBAYASHI
  • Publication number: 20190266786
    Abstract: There is provided an image processing apparatus and an image processing method that are capable of improving the accuracy of a depth image of a 3D model. A depth image generation unit generates a depth image of a plurality of viewpoints for each object included in a 3D model. The present disclosure is applicable to, for example, an encoding device or the like configured to generate a color image and a depth image of each object of each of a plurality of viewpoints on the basis of 3D data of a 3D model, generate an encoded stream by encoding the images, and generate object range information indicating the range of each object.
    Type: Application
    Filed: October 11, 2017
    Publication date: August 29, 2019
    Applicant: SONY CORPORATION
    Inventors: Goh KOBAYASHI, Junichi TANAKA, Yuichi ARAKI
  • Publication number: 20190238819
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.
    Type: Application
    Filed: July 14, 2017
    Publication date: August 1, 2019
    Inventors: KENDAI FURUKAWA, JUNICHI TANAKA, HIROSHI ORYOJI, YUICHI HASEGAWA, GOH KOBAYASHI
  • Publication number: 20190228558
    Abstract: The present disclosure relates to an image processing device and an image processing method in which a home server reproduces a 3-dimensional image merely by transmitting a viewing range based on a viewing position and a visual line direction and requesting texture images necessary to generate a 3-dimensional image from a request content server. A content server groups a plurality of multi-camera units for each of cameras included in the multi-camera unit, sets a priority of the cameras for each group on the basis of an evaluation value of disposition of the cameras in each group, and transmits image data of a surface of the selected cameras in accordance with the set priority and the group selected in accordance with a visual field range of a user to a home server. The present disclosure can be applied to, for example, a home server or the like that generates a display image of a predetermined viewpoint from an entire celestial sphere image.
    Type: Application
    Filed: July 14, 2017
    Publication date: July 25, 2019
    Applicant: Sony Corporation
    Inventor: Goh KOBAYASHI
  • Publication number: 20190052816
    Abstract: The present disclosure relates to an information processing apparatus and information processing method that are aimed at enabling arrangements of a plurality of photographing devices to be easily set to an optimum arrangement for generation of three-dimensional data. An evaluation section calculates an evaluation value of an arrangement for generation of the three-dimensional data on the basis of the arrangements of the plurality of photographing devices that photograph two-dimensional image data used to generate the three-dimensional data of a photographic object. For example, the present disclosure is applicable to the information processing apparatus etc. that display information indicating the arrangements of the plurality of photographing devices that photograph the two-dimensional image data used to generate the three-dimensional data of the photographic object.
    Type: Application
    Filed: February 8, 2017
    Publication date: February 14, 2019
    Inventor: GOH KOBAYASHI
  • Patent number: 9852358
    Abstract: An information processing apparatus includes processing circuitry (similarity calculation section) configured to calculate a similarity between a posture model and posture data, wherein the posture model being indicative of a posture in a time series gesture, and the posture data being indicative of a posture in a time series of a subject in moving image data.
    Type: Grant
    Filed: March 21, 2013
    Date of Patent: December 26, 2017
    Assignee: SONY CORPORATION
    Inventors: Keisuke Yamaoka, Toshinori Ihara, Goh Kobayashi, Takuro Kawai
  • Patent number: 9710955
    Abstract: This technology relates to an image processing device, an image processing method, and a program capable of realizing motion parallax closely related to that of the real world. An image processing unit corrects a depth image formed of a depth value indicating a position in a depth direction of each pixel of a color image of a predetermined viewpoint externally input as an input image based on positional information indicating a position of a viewer and the like. This technology is applicable to an image processing device, which performs a process to correct the depth image based on the positional information as an image process, for example.
    Type: Grant
    Filed: May 11, 2012
    Date of Patent: July 18, 2017
    Assignee: Sony Corporation
    Inventors: Goh Kobayashi, Takuro Kawai, Toshinori Ihara, Keisuke Yamaoka