Patents by Inventor Hiroshi Oryoji
Hiroshi Oryoji has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11557087Abstract: Provided are an image processing apparatus and an image processing method that enable a strobe image using a 3D model to be generated. A strobe model in which 3D models of an object at a plurality of times generated from a plurality of viewpoint images captured from a plurality of viewpoints are disposed in a three-dimensional space is generated. When the strobe model is generated, a target object that is a target in which the 3D model is disposed in the strobe model is set according to a degree of object relevance indicating relevance with a key object serving as a reference for disposition of the 3D model in the strobe model.Type: GrantFiled: December 5, 2019Date of Patent: January 17, 2023Assignee: SONY GROUP CORPORATIONInventors: Goh Kobayashi, Hiroshi Oryoji
-
Publication number: 20220224822Abstract: In a multi-camera system (S), a control apparatus (1) includes: an acquisition unit (141) configured to acquire image data from each of a plurality of cameras (2); a generation unit (142) configured to generate three-dimensional shape information for a subject in a predetermined imaging area on the basis of a plurality of pieces of image data; a selection unit (143) configured to select at least a partial area of an area represented by the three-dimensional shape information of the subject as an area for calculating a control value of each of the plurality of cameras (2); a creation unit (144) configured to create mask information that is an image area used for control value calculation within the area selected by the selection unit (143) for each of the plurality of pieces of image data; and a calculation unit (145) configured to calculate the control value of each of the plurality of cameras (2) on the basis of the image data from each of the plurality of cameras (2) and the mask information.Type: ApplicationFiled: August 28, 2019Publication date: July 14, 2022Inventors: HIROAKI TAKAHASHI, HIROSHI ORYOJI, HISAYUKI TATENO
-
Patent number: 11302021Abstract: Provided is an information processing apparatus, including: an estimation processing section that, on the basis of three-dimensional data and a first image feature value that are set and a second image feature value that is acquired from a captured image captured by a first imaging apparatus, estimates a position and attitude of the first imaging apparatus.Type: GrantFiled: July 31, 2017Date of Patent: April 12, 2022Assignee: SONY CORPORATIONInventor: Hiroshi Oryoji
-
Publication number: 20220036644Abstract: The present technology relates to an image processing apparatus, an image processing method, and a program that enable a strobe image using a 3D model to be generated. A strobe model in which 3D models of an object at a plurality of times generated from a plurality of viewpoint images captured from a plurality of viewpoints are disposed in a three-dimensional space is generated. When the strobe model is generated, a target object that is a target in which the 3D model is disposed in the strobe model is set according to a degree of object relevance indicating relevance with a key object serving as a reference for disposition of the 3D model in the strobe model.Type: ApplicationFiled: December 5, 2019Publication date: February 3, 2022Inventors: GOH KOBAYASHI, HIROSHI ORYOJI
-
Patent number: 11165945Abstract: There is provided an information processing device including an information acquisition unit that acquires camera location information indicating locations of a plurality of imaging cameras located in an imaging space, and an evaluation unit that acquires calibration accuracy obtained in a case of locating a calibration camera in the imaging space on a basis of the location of each of the plurality of imaging cameras indicated by the camera location information and a location of the calibration camera.Type: GrantFiled: November 25, 2016Date of Patent: November 2, 2021Assignee: SONY CORPORATIONInventor: Hiroshi Oryoji
-
Patent number: 11069120Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A selection section selects a quantization method of a depth image of each viewpoint from among a first quantization method that quantizes a reciprocal 1/r of a distance r between a viewpoint corresponding to the depth image and the polygon for each pixel, a second quantization method that quantizes the distance r, and a third quantization method that quantizes a reciprocal 1/r? of a distance r? between the other viewpoint that configures the two viewpoints together with the viewpoint corresponding to the depth image and the polygon in each pixel. The present disclosure can be applied, for example, to a display apparatus and the like.Type: GrantFiled: July 27, 2017Date of Patent: July 20, 2021Assignee: Sony CorporationInventors: Hiroshi Oryoji, Nobuaki Izumi
-
Publication number: 20210183101Abstract: [Object] To find a camera location for optimizing calibration of a multi-camera system efficiently without trial and error. [Solution] There is provided an information processing device including: an information acquisition unit configured to acquire camera location information indicating locations of a plurality of imaging cameras located in an imaging space; and an evaluation unit configured to evaluate calibration accuracy obtained in a case of locating a calibration camera in the imaging space on a basis of the location of each of the plurality of imaging cameras indicated by the camera location information and a location of the calibration camera.Type: ApplicationFiled: November 25, 2016Publication date: June 17, 2021Inventor: HIROSHI ORYOJI
-
Patent number: 10991144Abstract: There is provided an image processing apparatus that includes an ML3D model generation section, which are applicable to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like. The ML3D model generation section receives transmission information in which auxiliary information is added to at least one of texture information of a first layer, depth information of the first layer, texture information of a second layer or depth information of the second layer, and executes predetermined image processing using the auxiliary information for at least one of the texture information of the first layer, the depth information of the first layer, the texture information of the second layer or the depth information of the second layer.Type: GrantFiled: July 14, 2017Date of Patent: April 27, 2021Assignee: SONY CORPORATIONInventors: Yuichi Araki, Junichi Tanaka, Hiroshi Oryoji, Yuichi Hasegawa, Tooru Masuda, Tetsuya Fukuyasu
-
Patent number: 10950029Abstract: The present disclosure relates to an image processing apparatus and an image processing method which make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A drawing section generates a texture image of a predetermined viewpoint using a texture image obtained by perspectively projecting, to a perspective projection face perpendicular to a sight line direction heading from each of two viewpoints which are opposed to each other across a center of a polygon, toward the center of the polygon, a rear face of the polygon and a depth image corresponding to the texture image of each of the viewpoints. The present disclosure can be applied, for example, to a display apparatus and the like.Type: GrantFiled: July 27, 2017Date of Patent: March 16, 2021Assignee: SONY CORPORATIONInventors: Nobuaki Izumi, Hiroshi Oryoji
-
Patent number: 10887571Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.Type: GrantFiled: July 14, 2017Date of Patent: January 5, 2021Assignee: SONY CORPORATIONInventors: Kendai Furukawa, Junichi Tanaka, Hiroshi Oryoji, Yuichi Hasegawa, Goh Kobayashi
-
Patent number: 10582127Abstract: [Object] To resolve or reduce inconvenience resulting from a shift in imaging timing that occurs during reproduction of omnidirectional video or integral processing based on a plurality of captured images captured at different timings. [Solution] Provided is an image processing device including: a reproduction control unit configured to control reproduction of omnidirectional video based on a plurality of captured images sequentially captured in a plurality of fields of view that revolve while partially overlapping one another. The omnidirectional video is covered by M fields of view from a first field of view to an M-th (M>1) field of view with a reference direction serving as a starting point.Type: GrantFiled: February 24, 2017Date of Patent: March 3, 2020Assignee: SONY CORPORATIONInventor: Hiroshi Oryoji
-
Patent number: 10469794Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and an information processing system capable of efficiently and temporarily storing contents in a case where the contents are played back using a play list. A calculation unit calculates, on the basis of a play list indicating contents adopted as a playback target chosen from among a plurality of contents, a priority level about a cash temporarily storing the contents, for each of the contents. For example, the present technique can be applied to an information processing system and the like performing streaming playback of contents based on MPEG (Moving Picture Experts Group phase)-DASH standard.Type: GrantFiled: October 16, 2013Date of Patent: November 5, 2019Assignee: SONY CORPORATIONInventors: Hiroshi Oryoji, Masashi Eshima
-
Publication number: 20190287289Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. An ML3D model generation section receives transmission information in which auxiliary information is added to at least one of texture information of a first layer, depth information of the first layer, texture information of a second layer or depth information of the second layer, and executes predetermined image processing using the auxiliary information for at least one of the texture information of the first layer, the depth information of the first layer, the texture information of the second layer or the depth information of the second layer. The present disclosure can be applied, for example, to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.Type: ApplicationFiled: July 14, 2017Publication date: September 19, 2019Inventors: YUICHI ARAKI, JUNICHI TANAKA, HIROSHI ORYOJI, YUICHI HASEGAWA, TOORU MASUDA, TETSUYA FUKUYASU
-
Publication number: 20190236795Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A selection section selects a quantization method of a depth image of each viewpoint from among a first quantization method that quantizes a reciprocal 1/r of a distance r between a viewpoint corresponding to the depth image and the polygon for each pixel, a second quantization method that quantizes the distance r, and a third quantization method that quantizes a reciprocal 1/r? of a distance r? between the other viewpoint that configures the two viewpoints together with the viewpoint corresponding to the depth image and the polygon in each pixel. The present disclosure can be applied, for example, to a display apparatus and the like.Type: ApplicationFiled: July 27, 2017Publication date: August 1, 2019Applicant: Sony CorporationInventor: Hiroshi ORYOJI
-
Publication number: 20190238819Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.Type: ApplicationFiled: July 14, 2017Publication date: August 1, 2019Inventors: KENDAI FURUKAWA, JUNICHI TANAKA, HIROSHI ORYOJI, YUICHI HASEGAWA, GOH KOBAYASHI
-
Publication number: 20190206074Abstract: Provided is an information processing apparatus, including: an estimation processing section that, on the basis of three-dimensional data and a first image feature value that are set and a second image feature value that is acquired from a captured image captured by a first imaging apparatus, estimates a position and attitude of the first imaging apparatus.Type: ApplicationFiled: July 31, 2017Publication date: July 4, 2019Inventor: HIROSHI ORYOJI
-
Publication number: 20190028643Abstract: [Object] To resolve or reduce inconvenience resulting from a shift in imaging timing that occurs during reproduction of omnidirectional video or integral processing based on a plurality of captured images captured at different timings. [Solution] Provided is an image processing device including: a reproduction control unit configured to control reproduction of omnidirectional video based on a plurality of captured images sequentially captured in a plurality of fields of view that revolve while partially overlapping one another. The omnidirectional video is covered by M fields of view from a first field of view to an M-th (M>1) field of view with a reference direction serving as a starting point.Type: ApplicationFiled: February 24, 2017Publication date: January 24, 2019Inventor: HIROSHI ORYOJI
-
Publication number: 20180213139Abstract: The present technology relates to an image processing apparatus and method that can reduce a transmission delay of image data items. According to one aspect of the present technology, respective partial images of a plurality of captured images acquired by image capturing units different from each other are integrated and one composited image is generated. The exposure periods of the respective image capturing units may be the same or may be shifted from one another. The exposure periods of only a part of the capturing units may be shifted. The present technology can be applied to an image capturing device, an electronic device using the image capturing device, a computer, a system, or the like that processes the image data items acquired by the image capturing device, for example.Type: ApplicationFiled: May 27, 2016Publication date: July 26, 2018Applicant: SONY CORPORATIONInventors: ATSUSHI ITO, HIROSHI ORYOJI, TOMOHIRO NISHI
-
Electronic apparatus, reproduction control system, reproduction control method, and program therefor
Patent number: 9208227Abstract: Provided is an electronic apparatus including: a storage to store first and second contents, each of which includes scenes, and meta-information items each indicating a feature of each scene of the first and second contents; a reproducer to reproduce the first and second contents; an operation receiver to receive an input of an operation by a user; and a controller to control the storage to store an operation-history information item indicating an operation history of the user for each scene during reproduction of the first content while it is associated with the meta-information item of each scene, to calculate a similarity between scenes of the first and second contents based on the meta-information items, and to control the reproducer to change a reproduction mode for each scene based on the operation-history information item and the similarity during reproduction of the second content.Type: GrantFiled: March 13, 2013Date of Patent: December 8, 2015Assignee: Sony CorporationInventors: Koji Kashima, Tatsumi Sakaguchi, Hiroshi Oryoji, Masashi Eshima -
Publication number: 20150271440Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and an information processing system capable of efficiently and temporarily storing contents in a case where the contents are played back using a play list. A calculation unit calculates, on the basis of a play list indicating contents adopted as a playback target chosen from among a plurality of contents, a priority level about a cash temporarily storing the contents, for each of the contents. For example, the present technique can be applied to an information processing system and the like performing streaming playback of contents based on MPEG (Moving Picture Experts Group phase)-DASH standard.Type: ApplicationFiled: October 16, 2013Publication date: September 24, 2015Applicant: SONY CORPORATIONInventors: Hiroshi Oryoji, Masashi Eshima