Patents by Inventor Hiroshi Oryoji

Hiroshi Oryoji has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11557087
    Abstract: Provided are an image processing apparatus and an image processing method that enable a strobe image using a 3D model to be generated. A strobe model in which 3D models of an object at a plurality of times generated from a plurality of viewpoint images captured from a plurality of viewpoints are disposed in a three-dimensional space is generated. When the strobe model is generated, a target object that is a target in which the 3D model is disposed in the strobe model is set according to a degree of object relevance indicating relevance with a key object serving as a reference for disposition of the 3D model in the strobe model.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: January 17, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Goh Kobayashi, Hiroshi Oryoji
  • Publication number: 20220224822
    Abstract: In a multi-camera system (S), a control apparatus (1) includes: an acquisition unit (141) configured to acquire image data from each of a plurality of cameras (2); a generation unit (142) configured to generate three-dimensional shape information for a subject in a predetermined imaging area on the basis of a plurality of pieces of image data; a selection unit (143) configured to select at least a partial area of an area represented by the three-dimensional shape information of the subject as an area for calculating a control value of each of the plurality of cameras (2); a creation unit (144) configured to create mask information that is an image area used for control value calculation within the area selected by the selection unit (143) for each of the plurality of pieces of image data; and a calculation unit (145) configured to calculate the control value of each of the plurality of cameras (2) on the basis of the image data from each of the plurality of cameras (2) and the mask information.
    Type: Application
    Filed: August 28, 2019
    Publication date: July 14, 2022
    Inventors: HIROAKI TAKAHASHI, HIROSHI ORYOJI, HISAYUKI TATENO
  • Patent number: 11302021
    Abstract: Provided is an information processing apparatus, including: an estimation processing section that, on the basis of three-dimensional data and a first image feature value that are set and a second image feature value that is acquired from a captured image captured by a first imaging apparatus, estimates a position and attitude of the first imaging apparatus.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: April 12, 2022
    Assignee: SONY CORPORATION
    Inventor: Hiroshi Oryoji
  • Publication number: 20220036644
    Abstract: The present technology relates to an image processing apparatus, an image processing method, and a program that enable a strobe image using a 3D model to be generated. A strobe model in which 3D models of an object at a plurality of times generated from a plurality of viewpoint images captured from a plurality of viewpoints are disposed in a three-dimensional space is generated. When the strobe model is generated, a target object that is a target in which the 3D model is disposed in the strobe model is set according to a degree of object relevance indicating relevance with a key object serving as a reference for disposition of the 3D model in the strobe model.
    Type: Application
    Filed: December 5, 2019
    Publication date: February 3, 2022
    Inventors: GOH KOBAYASHI, HIROSHI ORYOJI
  • Patent number: 11165945
    Abstract: There is provided an information processing device including an information acquisition unit that acquires camera location information indicating locations of a plurality of imaging cameras located in an imaging space, and an evaluation unit that acquires calibration accuracy obtained in a case of locating a calibration camera in the imaging space on a basis of the location of each of the plurality of imaging cameras indicated by the camera location information and a location of the calibration camera.
    Type: Grant
    Filed: November 25, 2016
    Date of Patent: November 2, 2021
    Assignee: SONY CORPORATION
    Inventor: Hiroshi Oryoji
  • Patent number: 11069120
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A selection section selects a quantization method of a depth image of each viewpoint from among a first quantization method that quantizes a reciprocal 1/r of a distance r between a viewpoint corresponding to the depth image and the polygon for each pixel, a second quantization method that quantizes the distance r, and a third quantization method that quantizes a reciprocal 1/r? of a distance r? between the other viewpoint that configures the two viewpoints together with the viewpoint corresponding to the depth image and the polygon in each pixel. The present disclosure can be applied, for example, to a display apparatus and the like.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: July 20, 2021
    Assignee: Sony Corporation
    Inventors: Hiroshi Oryoji, Nobuaki Izumi
  • Publication number: 20210183101
    Abstract: [Object] To find a camera location for optimizing calibration of a multi-camera system efficiently without trial and error. [Solution] There is provided an information processing device including: an information acquisition unit configured to acquire camera location information indicating locations of a plurality of imaging cameras located in an imaging space; and an evaluation unit configured to evaluate calibration accuracy obtained in a case of locating a calibration camera in the imaging space on a basis of the location of each of the plurality of imaging cameras indicated by the camera location information and a location of the calibration camera.
    Type: Application
    Filed: November 25, 2016
    Publication date: June 17, 2021
    Inventor: HIROSHI ORYOJI
  • Patent number: 10991144
    Abstract: There is provided an image processing apparatus that includes an ML3D model generation section, which are applicable to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like. The ML3D model generation section receives transmission information in which auxiliary information is added to at least one of texture information of a first layer, depth information of the first layer, texture information of a second layer or depth information of the second layer, and executes predetermined image processing using the auxiliary information for at least one of the texture information of the first layer, the depth information of the first layer, the texture information of the second layer or the depth information of the second layer.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: April 27, 2021
    Assignee: SONY CORPORATION
    Inventors: Yuichi Araki, Junichi Tanaka, Hiroshi Oryoji, Yuichi Hasegawa, Tooru Masuda, Tetsuya Fukuyasu
  • Patent number: 10950029
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method which make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A drawing section generates a texture image of a predetermined viewpoint using a texture image obtained by perspectively projecting, to a perspective projection face perpendicular to a sight line direction heading from each of two viewpoints which are opposed to each other across a center of a polygon, toward the center of the polygon, a rear face of the polygon and a depth image corresponding to the texture image of each of the viewpoints. The present disclosure can be applied, for example, to a display apparatus and the like.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: March 16, 2021
    Assignee: SONY CORPORATION
    Inventors: Nobuaki Izumi, Hiroshi Oryoji
  • Patent number: 10887571
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: January 5, 2021
    Assignee: SONY CORPORATION
    Inventors: Kendai Furukawa, Junichi Tanaka, Hiroshi Oryoji, Yuichi Hasegawa, Goh Kobayashi
  • Patent number: 10582127
    Abstract: [Object] To resolve or reduce inconvenience resulting from a shift in imaging timing that occurs during reproduction of omnidirectional video or integral processing based on a plurality of captured images captured at different timings. [Solution] Provided is an image processing device including: a reproduction control unit configured to control reproduction of omnidirectional video based on a plurality of captured images sequentially captured in a plurality of fields of view that revolve while partially overlapping one another. The omnidirectional video is covered by M fields of view from a first field of view to an M-th (M>1) field of view with a reference direction serving as a starting point.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: March 3, 2020
    Assignee: SONY CORPORATION
    Inventor: Hiroshi Oryoji
  • Patent number: 10469794
    Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and an information processing system capable of efficiently and temporarily storing contents in a case where the contents are played back using a play list. A calculation unit calculates, on the basis of a play list indicating contents adopted as a playback target chosen from among a plurality of contents, a priority level about a cash temporarily storing the contents, for each of the contents. For example, the present technique can be applied to an information processing system and the like performing streaming playback of contents based on MPEG (Moving Picture Experts Group phase)-DASH standard.
    Type: Grant
    Filed: October 16, 2013
    Date of Patent: November 5, 2019
    Assignee: SONY CORPORATION
    Inventors: Hiroshi Oryoji, Masashi Eshima
  • Publication number: 20190287289
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. An ML3D model generation section receives transmission information in which auxiliary information is added to at least one of texture information of a first layer, depth information of the first layer, texture information of a second layer or depth information of the second layer, and executes predetermined image processing using the auxiliary information for at least one of the texture information of the first layer, the depth information of the first layer, the texture information of the second layer or the depth information of the second layer. The present disclosure can be applied, for example, to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.
    Type: Application
    Filed: July 14, 2017
    Publication date: September 19, 2019
    Inventors: YUICHI ARAKI, JUNICHI TANAKA, HIROSHI ORYOJI, YUICHI HASEGAWA, TOORU MASUDA, TETSUYA FUKUYASU
  • Publication number: 20190236795
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A selection section selects a quantization method of a depth image of each viewpoint from among a first quantization method that quantizes a reciprocal 1/r of a distance r between a viewpoint corresponding to the depth image and the polygon for each pixel, a second quantization method that quantizes the distance r, and a third quantization method that quantizes a reciprocal 1/r? of a distance r? between the other viewpoint that configures the two viewpoints together with the viewpoint corresponding to the depth image and the polygon in each pixel. The present disclosure can be applied, for example, to a display apparatus and the like.
    Type: Application
    Filed: July 27, 2017
    Publication date: August 1, 2019
    Applicant: Sony Corporation
    Inventor: Hiroshi ORYOJI
  • Publication number: 20190238819
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.
    Type: Application
    Filed: July 14, 2017
    Publication date: August 1, 2019
    Inventors: KENDAI FURUKAWA, JUNICHI TANAKA, HIROSHI ORYOJI, YUICHI HASEGAWA, GOH KOBAYASHI
  • Publication number: 20190206074
    Abstract: Provided is an information processing apparatus, including: an estimation processing section that, on the basis of three-dimensional data and a first image feature value that are set and a second image feature value that is acquired from a captured image captured by a first imaging apparatus, estimates a position and attitude of the first imaging apparatus.
    Type: Application
    Filed: July 31, 2017
    Publication date: July 4, 2019
    Inventor: HIROSHI ORYOJI
  • Publication number: 20190028643
    Abstract: [Object] To resolve or reduce inconvenience resulting from a shift in imaging timing that occurs during reproduction of omnidirectional video or integral processing based on a plurality of captured images captured at different timings. [Solution] Provided is an image processing device including: a reproduction control unit configured to control reproduction of omnidirectional video based on a plurality of captured images sequentially captured in a plurality of fields of view that revolve while partially overlapping one another. The omnidirectional video is covered by M fields of view from a first field of view to an M-th (M>1) field of view with a reference direction serving as a starting point.
    Type: Application
    Filed: February 24, 2017
    Publication date: January 24, 2019
    Inventor: HIROSHI ORYOJI
  • Publication number: 20180213139
    Abstract: The present technology relates to an image processing apparatus and method that can reduce a transmission delay of image data items. According to one aspect of the present technology, respective partial images of a plurality of captured images acquired by image capturing units different from each other are integrated and one composited image is generated. The exposure periods of the respective image capturing units may be the same or may be shifted from one another. The exposure periods of only a part of the capturing units may be shifted. The present technology can be applied to an image capturing device, an electronic device using the image capturing device, a computer, a system, or the like that processes the image data items acquired by the image capturing device, for example.
    Type: Application
    Filed: May 27, 2016
    Publication date: July 26, 2018
    Applicant: SONY CORPORATION
    Inventors: ATSUSHI ITO, HIROSHI ORYOJI, TOMOHIRO NISHI
  • Patent number: 9208227
    Abstract: Provided is an electronic apparatus including: a storage to store first and second contents, each of which includes scenes, and meta-information items each indicating a feature of each scene of the first and second contents; a reproducer to reproduce the first and second contents; an operation receiver to receive an input of an operation by a user; and a controller to control the storage to store an operation-history information item indicating an operation history of the user for each scene during reproduction of the first content while it is associated with the meta-information item of each scene, to calculate a similarity between scenes of the first and second contents based on the meta-information items, and to control the reproducer to change a reproduction mode for each scene based on the operation-history information item and the similarity during reproduction of the second content.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: December 8, 2015
    Assignee: Sony Corporation
    Inventors: Koji Kashima, Tatsumi Sakaguchi, Hiroshi Oryoji, Masashi Eshima
  • Publication number: 20150271440
    Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and an information processing system capable of efficiently and temporarily storing contents in a case where the contents are played back using a play list. A calculation unit calculates, on the basis of a play list indicating contents adopted as a playback target chosen from among a plurality of contents, a priority level about a cash temporarily storing the contents, for each of the contents. For example, the present technique can be applied to an information processing system and the like performing streaming playback of contents based on MPEG (Moving Picture Experts Group phase)-DASH standard.
    Type: Application
    Filed: October 16, 2013
    Publication date: September 24, 2015
    Applicant: SONY CORPORATION
    Inventors: Hiroshi Oryoji, Masashi Eshima