Patents by Inventor Masaki Fukuchi

Masaki Fukuchi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210125416
    Abstract: An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.
    Type: Application
    Filed: January 4, 2021
    Publication date: April 29, 2021
    Applicant: Sony Corporation
    Inventors: Akihiko KAINO, Masaki FUKUCHI, Tatsuki KASHITANI, Kenichiro OOI, Jingjing GUO
  • Patent number: 10950053
    Abstract: An information processing system that acquires image data captured by an image capturing device; identifies a density of distribution of a plurality of feature points in the acquired image data; and controls a display to display guidance information based on the density of the distribution of the plurality of feature points.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: March 16, 2021
    Assignee: SONY CORPORATION
    Inventors: Masaki Fukuchi, Kenichirou Ooi, Tatsuki Kashitani
  • Publication number: 20210042513
    Abstract: [Problem] To provide an information processing apparatus, an information processing method, and a program capable of performing position estimation of a controller corresponding to a wearable device having an inside-out type. [Solution] An information processing apparatus includes: a user-position estimating unit that recognizes, based on a first captured image that is captured by a first image capturing unit provided to a wearable device mounted on a user, peripheral environment information of the user to execute position estimation of the user in a real space; and a controller-position estimating unit that executes, based on a second captured image captured by a second image capturing unit that is provided to a controller being operated by the user, position estimation of the controller with reference to the recognized environment information.
    Type: Application
    Filed: January 17, 2019
    Publication date: February 11, 2021
    Inventors: TAKAAKI KATO, SHUNICHI HOMMA, YUYA YAMAGUCHI, MASAKI FUKUCHI
  • Patent number: 10908676
    Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: February 2, 2021
    Assignee: SONY CORPORATION
    Inventors: Masaki Fukuchi, Kouichi Matsuda, Yasuhiro Suto, Kenichiro Oi, Jingjing Guo
  • Publication number: 20210027543
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Application
    Filed: October 13, 2020
    Publication date: January 28, 2021
    Applicant: SONY CORPORATION
    Inventors: Yasuhiro SUTO, Masaki FUKUCHI, Kenichirou OOI, Jingjing GUO, Kouichi MATSUDA
  • Patent number: 10902682
    Abstract: An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: January 26, 2021
    Assignee: SONY CORPORATION
    Inventors: Akihiko Kaino, Masaki Fukuchi, Tatsuki Kashitani, Kenichiro Ooi, Jingjing Guo
  • Publication number: 20200394841
    Abstract: There is provided an information processing apparatus to bring a three-dimensional model generated in accordance with observation information, closer to a real object. The information processing apparatus includes: a control section configured to allocate, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.
    Type: Application
    Filed: February 27, 2017
    Publication date: December 17, 2020
    Applicant: SONY CORPORATION
    Inventors: Akihiko KAINO, Shunichi HOMMA, Masaki FUKUCHI
  • Patent number: 10810803
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: October 20, 2020
    Assignee: SONY CORPORATION
    Inventors: Yasuhiro Suto, Masaki Fukuchi, Kenichirou Ooi, Jingjing Guo, Kouichi Matsuda
  • Patent number: 10803600
    Abstract: The present disclosure relates to an information processing device, an information processing method, and a program capable of performing continuous estimation of a self-position. An information processing device according to an aspect of the present disclosure includes: a main imaging unit that includes a stereo camera mounted on a moving body, and captures moving images at a predetermined frame rate to output a pair of stereo main images as time-series images; a plurality of sub imaging units each of which is so mounted on the moving body as to have an imaging direction different from an imaging direction of the main imaging unit, and captures moving images at a predetermined frame rate; and a final pose determination unit that estimates a pose of the moving body on the basis of the pair of stereo main images captured by the main imaging unit, and sub images captured by the sub imaging units. For example, the present disclosure is applicable to a self-position sensor for in-vehicle use.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: October 13, 2020
    Assignee: Sony Corporation
    Inventors: Akihiko Kaino, Shingo Tsurumi, Masashi Eshima, Takaaki Kato, Masaki Fukuchi, Tatsuki Kashitani, Shunichi Homma
  • Patent number: 10753757
    Abstract: An information processing apparatus and an information processing method enables enhancement of accuracy in recognition of locations of a moving body. The information processing apparatus is arranged on a moving body and includes an own-location recognition block that recognizes, based on an image taken from the moving body, a first own location of the moving body. A moving body recognition block recognizes a relative location of another moving body relative to the moving body in the image taken from the moving body, and a communication block executes communication with the another moving body to obtain the absolute location of the another moving body, An own location computation block computes, based on the absolute location of the another moving body and the relative location of the another moving body, a second own location of the moving body.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: August 25, 2020
    Assignee: SONY CORPORATION
    Inventors: Shingo Tsurumi, Masashi Eshima, Akihiko Kaino, Takaaki Kato, Masaki Fukuchi, Suguru Aoki, Takuto Motoyama
  • Patent number: 10731994
    Abstract: The present disclosure relates to an information processing device and an information processing method that are capable of estimating the self-position by accurately and continuously estimating the self-movement. The information processing device according to an aspect of the present disclosure includes a downward imaging section and a movement estimation section. The downward imaging section is disposed on the bottom of a moving object traveling on a road surface and captures an image of the road surface. The movement estimation section estimates the movement of the moving object in accordance with a plurality of images representing the road surface and captured at different time points by the downward imaging section. The present disclosure can be applied, for example, to a position sensor mounted in an automobile.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: August 4, 2020
    Assignee: SONY CORPORATION
    Inventors: Takaaki Kato, Shingo Tsurumi, Masashi Eshima, Akihiko Kaino, Masaki Fukuchi
  • Patent number: 10636168
    Abstract: There is provided an image processing apparatus and method and a program which enable more accurate estimation of a pose. A matching unit performs matching processing on the basis of a detection result of a feature point from an input image and a three-dimensional map indicating a position of a landmark in real space, and a pose estimating unit estimates a pose on the basis of a result of the matching processing. A three-dimensional map updating unit updates the three-dimensional map on the basis of a three-dimensional shape model indicating a position and a shape of a recognition target, a detection result of the feature point from the input image and an estimation result of the pose so that only a portion of the recognition target is registered as the landmark. The present technology can be applied to a wearable information terminal apparatus.
    Type: Grant
    Filed: May 30, 2016
    Date of Patent: April 28, 2020
    Assignee: SONY CORPORATION
    Inventors: Shinichiro Abe, Masaki Fukuchi, Tatsuki Kashitani
  • Patent number: 10636185
    Abstract: There is provided an information processing apparatus to present, to a user, an additional image, which is a virtual object, in a manner superimposed on a real-space image at a position corresponding to a viewpoint in the real space, the image processing apparatus including a processing unit configured to display an additional image corresponding to a viewpoint of a user in the real world, and guide the user to the vicinity of the viewpoint in the real world where the additional image has been acquired.
    Type: Grant
    Filed: March 23, 2015
    Date of Patent: April 28, 2020
    Assignee: SONY CORPORATION
    Inventors: Jianing Wu, Masaki Fukuchi, Akihiko Kaino, Tatsuki Kashitani, Shunichi Homma, Shinichiro Abe, Yuya Hanai, Takaaki Kato
  • Publication number: 20200066057
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Application
    Filed: October 30, 2019
    Publication date: February 27, 2020
    Applicant: SONY CORPORATION
    Inventors: Yasuhiro SUTO, Masaki FUKUCHI, Kenichirou OOI, Jingjing GUO, Kouichi MATSUDA
  • Publication number: 20200043240
    Abstract: There is provided an information processing device including an image acquisition unit that acquires a captured image of a real space from an image capture device, a setting unit that sets, in association with the real space, an augmented reality space that virtually augments the real space depicted in the captured image, the augmented reality space differing according to related information that relates to the captured image, and a control unit that causes an image of a virtual object placed for each user within the augmented reality space to be displayed on a screen.
    Type: Application
    Filed: October 11, 2019
    Publication date: February 6, 2020
    Applicant: SONY CORPORATION
    Inventors: Shinichiro ABE, Masaki FUKUCHI, Shunichi HOMMA, Jianing WU, Tatsuki KASHITANI
  • Publication number: 20200027278
    Abstract: An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.
    Type: Application
    Filed: September 30, 2019
    Publication date: January 23, 2020
    Applicant: Sony Corporation
    Inventors: Akihiko KAINO, Masaki FUKUCHI, Tatsuki KASHITANI, Kenichiro OOI, Jingjing GUO
  • Patent number: 10542212
    Abstract: The present technology relates to a control device and a control method that make it possible to estimate a self-position reliably with lower power consumption. An activation determination unit selects some of a plurality of cameras as activation cameras to be used for self-position estimation, and on the basis of the selection result of the activation cameras, an activation switching unit sets cameras taken as the activation cameras among the plurality of cameras to an activation state and causes the cameras to photograph images, and suspends the activation of the other cameras. A self-position estimation unit performs self-position estimation on the basis of images photographed by the activation cameras. Further, the activation determination unit selects the activation cameras again at a predetermined timing. The present technology can be applied to a self-position estimation system.
    Type: Grant
    Filed: March 23, 2016
    Date of Patent: January 21, 2020
    Assignee: SONY CORPORATION
    Inventors: Takaaki Kato, Akihiko Kaino, Tatsuki Kashitani, Masashi Eshima, Masaki Fukuchi
  • Patent number: 10529134
    Abstract: There is provided an information processing device including an image acquisition unit that acquires a captured image of a real space from an image capture device, a setting unit that sets, in association with the real space, an augmented reality space that virtually augments the real space depicted in the captured image, and a control unit that determines a target position for an action executed within the augmented reality space, on a basis of a positional relationship between an object within the augmented reality space and an optical axis of the image capture device.
    Type: Grant
    Filed: November 21, 2013
    Date of Patent: January 7, 2020
    Assignee: SONY CORPORATION
    Inventors: Shinichiro Abe, Masaki Fukuchi, Shunichi Homma, Jianing Wu, Tatsuki Kashitani
  • Patent number: 10515488
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: December 24, 2019
    Assignee: SONY CORPORATION
    Inventors: Yasuhiro Suto, Masaki Fukuchi, Kenichirou Ooi, Jingjing Guo, Kouichi Matsuda
  • Patent number: 10508911
    Abstract: The present technique relates to an apparatus and a method for measurement, and a program each of which enables distance estimation to be more simply carried out with higher accuracy. A three-dimensional measurement apparatus has a rotation control portion controlling rotation of a photographing portion by a rotation mechanism in such a way that the photographing portion is rotated with a center of rotation as an axis in a state in which a distance from the center of rotation of the rotation mechanism portion to a focal point position of the photographing portion is a constant distance; and a distance calculating portion calculating a distance to an object on a space on the basis of a plurality of photographed images obtained through photographing in positions different from one another by the photographing portion in a state in which the photographing portion is rotated.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: December 17, 2019
    Assignee: Sony Corporation
    Inventors: Shingo Tsurumi, Masashi Eshima, Takaaki Kato, Tatsuki Kashitani, Akihiko Kaino, Masaki Fukuchi, Takuto Motoyama, Suguru Aoki