Patents by Inventor Akihiko Kaino

Akihiko Kaino has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200394841
    Abstract: There is provided an information processing apparatus to bring a three-dimensional model generated in accordance with observation information, closer to a real object. The information processing apparatus includes: a control section configured to allocate, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.
    Type: Application
    Filed: February 27, 2017
    Publication date: December 17, 2020
    Applicant: SONY CORPORATION
    Inventors: Akihiko KAINO, Shunichi HOMMA, Masaki FUKUCHI
  • Patent number: 10803600
    Abstract: The present disclosure relates to an information processing device, an information processing method, and a program capable of performing continuous estimation of a self-position. An information processing device according to an aspect of the present disclosure includes: a main imaging unit that includes a stereo camera mounted on a moving body, and captures moving images at a predetermined frame rate to output a pair of stereo main images as time-series images; a plurality of sub imaging units each of which is so mounted on the moving body as to have an imaging direction different from an imaging direction of the main imaging unit, and captures moving images at a predetermined frame rate; and a final pose determination unit that estimates a pose of the moving body on the basis of the pair of stereo main images captured by the main imaging unit, and sub images captured by the sub imaging units. For example, the present disclosure is applicable to a self-position sensor for in-vehicle use.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: October 13, 2020
    Assignee: Sony Corporation
    Inventors: Akihiko Kaino, Shingo Tsurumi, Masashi Eshima, Takaaki Kato, Masaki Fukuchi, Tatsuki Kashitani, Shunichi Homma
  • Patent number: 10753757
    Abstract: An information processing apparatus and an information processing method enables enhancement of accuracy in recognition of locations of a moving body. The information processing apparatus is arranged on a moving body and includes an own-location recognition block that recognizes, based on an image taken from the moving body, a first own location of the moving body. A moving body recognition block recognizes a relative location of another moving body relative to the moving body in the image taken from the moving body, and a communication block executes communication with the another moving body to obtain the absolute location of the another moving body, An own location computation block computes, based on the absolute location of the another moving body and the relative location of the another moving body, a second own location of the moving body.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: August 25, 2020
    Assignee: SONY CORPORATION
    Inventors: Shingo Tsurumi, Masashi Eshima, Akihiko Kaino, Takaaki Kato, Masaki Fukuchi, Suguru Aoki, Takuto Motoyama
  • Publication number: 20200264276
    Abstract: The present disclosure relates to a signal processing apparatus, a signal processing method, and an object detection system. A stereo camera performs imaging by a right camera and a left camera to acquire a stereo image and a millimeter wave radar acquires a radar image in which a position of an object is detected in a radiation range of millimeter waves by using millimeter waves. Then, by communication via a communication apparatus with a target in which positional information is known, it is determined whether or not the target is reliable, and in a case where it is determined that the target is reliable, calibration processing is performed for eliminating a deviation in coordinate systems generated in the stereo image and the radar image in which the target is detected.
    Type: Application
    Filed: May 4, 2020
    Publication date: August 20, 2020
    Inventors: TOSHIO YAMAZAKI, KENICHI KAWASAKI, RYO SAWAI, SHINGO TSURUMI, AKIHIKO KAINO, TAKUTO MOTOYAMA
  • Patent number: 10731994
    Abstract: The present disclosure relates to an information processing device and an information processing method that are capable of estimating the self-position by accurately and continuously estimating the self-movement. The information processing device according to an aspect of the present disclosure includes a downward imaging section and a movement estimation section. The downward imaging section is disposed on the bottom of a moving object traveling on a road surface and captures an image of the road surface. The movement estimation section estimates the movement of the moving object in accordance with a plurality of images representing the road surface and captured at different time points by the downward imaging section. The present disclosure can be applied, for example, to a position sensor mounted in an automobile.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: August 4, 2020
    Assignee: SONY CORPORATION
    Inventors: Takaaki Kato, Shingo Tsurumi, Masashi Eshima, Akihiko Kaino, Masaki Fukuchi
  • Publication number: 20200242335
    Abstract: It is possible to acquire information used for recognizing an object in a real space in a more suitable manner. An information processing apparatus includes: an estimating unit that estimates a normal on at least a part of a face of an object in a real space on the basis of polarization information corresponding to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor and having different polarization directions; and a control unit that controls output of notification information for guiding a change in a position in the real space according to an estimation result of the normal.
    Type: Application
    Filed: July 19, 2018
    Publication date: July 30, 2020
    Inventors: MASASHI ESHIMA, AKIHIKO KAINO, DAIKI YAMANAKA
  • Publication number: 20200226774
    Abstract: There is provided an information processing device to enable a three-dimensional shape of an object in a real space to be estimated in a more preferred manner, the information processing device including: a division unit configured to divide, into one or more regions, an image plane corresponding to a viewing point in a real space on which geometric structure information is mapped in accordance with distribution of the geometric structure information; an acquisition unit configured to acquire orientation information indicating at least one of a position and an orientation of the viewing point; an extracting unit configured to extract, as a region of interest, at least part of the regions obtained by dividing the image plane; and an estimation unit configured to estimate a shape of an object in the real space based on the geometric structure information in regions of interest on image planes respectively corresponding to a plurality of different viewing points associated with each other among the viewing point
    Type: Application
    Filed: May 7, 2018
    Publication date: July 16, 2020
    Applicant: SONY CORPORATION
    Inventors: Akihiko KAINO, Masashi ESHIMA, Daiki YAMANAKA
  • Publication number: 20200211275
    Abstract: [Problem] Provided is a technique to reduce volume of data for a model reconstructed from an object in real space and to reconstruct a shape of the object as a further preferable aspect. [Solution] An information processing device includes: a first estimation unit configured to estimate a first distribution of geometric structure information regarding at least part of a face of an object in real space, in accordance with each of a plurality of beams of polarized light, having different polarization directions from each other, as a result detected by a polarization sensor; a second estimation unit configured to estimate a second distribution of information related to continuity of a geometric structure in the real space based on an estimation result of the first distribution; and a processing unit configured to determine a size of unit data for simulating three-dimensional space in accordance with the second distribution.
    Type: Application
    Filed: June 18, 2018
    Publication date: July 2, 2020
    Inventors: MASASHI ESHIMA, AKIHIKO KAINO, DAIKI YAMANAKA
  • Patent number: 10670697
    Abstract: Provided are signal processing apparatus, a signal processing method, and an object detection system that enable an object detection to be accurately performed. A stereo camera performs imaging by a right camera and a left camera to acquire a stereo image. A millimeter wave radar acquires a radar image in which a position of an object is detected in a radiation range of millimeter waves based on millimeter waves. Further, by communication via a communication apparatus with a target of which positional information is known, it is determined whether or not the target is reliable, and in a case where it is determined that the target is reliable, calibration processing is performed for eliminating a deviation in coordinate systems generated in the stereo image and the radar image in which the target is detected.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: June 2, 2020
    Assignee: SONY CORPORATION
    Inventors: Toshio Yamazaki, Kenichi Kawasaki, Ryo Sawai, Shingo Tsurumi, Akihiko Kaino, Takuto Motoyama
  • Patent number: 10636185
    Abstract: There is provided an information processing apparatus to present, to a user, an additional image, which is a virtual object, in a manner superimposed on a real-space image at a position corresponding to a viewpoint in the real space, the image processing apparatus including a processing unit configured to display an additional image corresponding to a viewpoint of a user in the real world, and guide the user to the vicinity of the viewpoint in the real world where the additional image has been acquired.
    Type: Grant
    Filed: March 23, 2015
    Date of Patent: April 28, 2020
    Assignee: SONY CORPORATION
    Inventors: Jianing Wu, Masaki Fukuchi, Akihiko Kaino, Tatsuki Kashitani, Shunichi Homma, Shinichiro Abe, Yuya Hanai, Takaaki Kato
  • Patent number: 10587863
    Abstract: The present disclosure relates to an image processing apparatus, an image processing method, and a program that permit decision as to whether or not calibration of images is necessary. A decision section decides, using a current image captured by a camera and a past image captured by the camera, whether or not it is necessary to calibrate images captured by the camera. The present disclosure is applicable, for example, to a vehicle-mounted camera system that includes an automobile vehicle, two cameras, mounted to a front roof of the automobile vehicle such that imaging regions overlap, and an image processing apparatus, and so on.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: March 10, 2020
    Assignee: Sony Corporation
    Inventors: Masashi Eshima, Akihiko Kaino, Takaaki Kato, Shingo Tsurumi
  • Publication number: 20200027278
    Abstract: An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.
    Type: Application
    Filed: September 30, 2019
    Publication date: January 23, 2020
    Applicant: Sony Corporation
    Inventors: Akihiko KAINO, Masaki FUKUCHI, Tatsuki KASHITANI, Kenichiro OOI, Jingjing GUO
  • Patent number: 10542212
    Abstract: The present technology relates to a control device and a control method that make it possible to estimate a self-position reliably with lower power consumption. An activation determination unit selects some of a plurality of cameras as activation cameras to be used for self-position estimation, and on the basis of the selection result of the activation cameras, an activation switching unit sets cameras taken as the activation cameras among the plurality of cameras to an activation state and causes the cameras to photograph images, and suspends the activation of the other cameras. A self-position estimation unit performs self-position estimation on the basis of images photographed by the activation cameras. Further, the activation determination unit selects the activation cameras again at a predetermined timing. The present technology can be applied to a self-position estimation system.
    Type: Grant
    Filed: March 23, 2016
    Date of Patent: January 21, 2020
    Assignee: SONY CORPORATION
    Inventors: Takaaki Kato, Akihiko Kaino, Tatsuki Kashitani, Masashi Eshima, Masaki Fukuchi
  • Patent number: 10529076
    Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.
    Type: Grant
    Filed: March 1, 2016
    Date of Patent: January 7, 2020
    Assignee: SONY CORPORATION
    Inventors: Ying Lu, Yasutaka Hirasawa, Yuhi Kondo, Ayaka Nakatani, Akihiko Kaino
  • Patent number: 10508911
    Abstract: The present technique relates to an apparatus and a method for measurement, and a program each of which enables distance estimation to be more simply carried out with higher accuracy. A three-dimensional measurement apparatus has a rotation control portion controlling rotation of a photographing portion by a rotation mechanism in such a way that the photographing portion is rotated with a center of rotation as an axis in a state in which a distance from the center of rotation of the rotation mechanism portion to a focal point position of the photographing portion is a constant distance; and a distance calculating portion calculating a distance to an object on a space on the basis of a plurality of photographed images obtained through photographing in positions different from one another by the photographing portion in a state in which the photographing portion is rotated.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: December 17, 2019
    Assignee: Sony Corporation
    Inventors: Shingo Tsurumi, Masashi Eshima, Takaaki Kato, Tatsuki Kashitani, Akihiko Kaino, Masaki Fukuchi, Takuto Motoyama, Suguru Aoki
  • Patent number: 10453266
    Abstract: An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: October 22, 2019
    Assignee: Sony Corporation
    Inventors: Akihiko Kaino, Masaki Fukuchi, Tatsuki Kashitani, Kenichiro Ooi, Jingjing Guo
  • Patent number: 10366537
    Abstract: An information processing apparatus and method acquires an image, performs an image recognition process on the acquired image to recognize a physical object in that image, and then generates a virtual image based on the results of the image recognition process. The virtual image includes a virtual object positioned relative to the physical object that was recognized in the acquired image. A display then displays the virtual image, and a projector projects at least part of the virtual image. The apparatus and method also include modes in which the display displays the virtual image, but the projector does not project the virtual image, where the projector projects the virtual image but the display does not display the virtual image, and where the display displays the virtual image and the projector projects the virtual image.
    Type: Grant
    Filed: March 25, 2013
    Date of Patent: July 30, 2019
    Assignee: SONY CORPORATION
    Inventors: Akihiko Kaino, Kenichirou Ooi
  • Patent number: 10169880
    Abstract: There is provided an information processing apparatus that self position estimation with high robustness is possible, the information processing apparatus including: a tracking unit, a region estimation unit, and an estimation processing unit. The tracking unit that acquires an image captured by an image capture unit disposed at a moving object, and corresponds characteristic points included in the image captured before movement and the image captured after the movement, the moving object moving accompanying a rotation motion. The region estimation unit that acquires information about the movement, and estimates regions where two-dimensional positions of the characteristic points are less changed viewed from the moving object before and after the movement of the moving object on the basis of the information. The estimation processing unit that performs self position estimation of the moving object using the characteristic points within the regions corresponded by the tracking unit.
    Type: Grant
    Filed: June 1, 2015
    Date of Patent: January 1, 2019
    Assignee: SONY CORPORATION
    Inventors: Shunichi Homma, Akihiko Kaino, Tatsuki Kashitani, Masaki Fukuchi
  • Publication number: 20180357829
    Abstract: An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.
    Type: Application
    Filed: August 1, 2018
    Publication date: December 13, 2018
    Applicant: Sony Corporation
    Inventors: Akihiko KAINO, Masaki FUKUCHI, Tatsuki KASHITANI, Kenichiro OOI, Jingjing GUO
  • Publication number: 20180300898
    Abstract: The present disclosure relates to an image processing apparatus, an image processing method, and a program that permit camera calibration with high accuracy by using a known object in images captured by a plurality of imaging sections. An estimation section estimates a 3D position of a road sign included in each of images captured by a plurality of cameras with respect to each of the imaging sections. A recognition section recognizes a positional relationship between the plurality of cameras on the basis of the 3D position of the road sign with respect to each of the cameras estimated by the estimation section. The positional relationship between the plurality of cameras recognized by the recognition section is used to correct the images captured by the plurality of cameras. The present disclosure is applicable, for example, to image processing apparatuses and so on.
    Type: Application
    Filed: September 16, 2016
    Publication date: October 18, 2018
    Applicant: Sony Corporation
    Inventors: Masashi Eshima, Akihiko Kaino, Takaaki Kato, Shingo Tsurumi