Patents by Inventor Masashi Eshima

Masashi Eshima has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11698642
    Abstract: There is provided an information processing apparatus that includes an information acquisition unit and a control prediction unit. The information acquisition unit acquires information regarding a location and a posture of a first mobile object that includes a sensing device. The control prediction unit predicts control performed with respect to the sensing device, on the basis of the information regarding the location and the posture and map information, the information regarding the location and the posture being acquired by the information acquisition unit.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: July 11, 2023
    Assignee: SONY CORPORATION
    Inventor: Masashi Eshima
  • Publication number: 20230012271
    Abstract: An information processing system (1) includes a first acquisition unit (201) that acquires position attitude information indicating a position and attitude of a first device (10) in a real space, an identification unit (203) that identifies a position of a virtual camera provided in a virtual space associated with the real space, based on the position attitude information, a correction unit (207 and 210) that corrects an imaging range (A) of the camera in the position and an attitude, identified by the identification unit (203), based on a terrain in the virtual space, and a video generation unit (212) that generates a video of the virtual space corresponding to the imaging range (A).
    Type: Application
    Filed: November 12, 2020
    Publication date: January 12, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Masashi ESHIMA, Takaaki KATO
  • Publication number: 20220366661
    Abstract: An information processing system (1) includes an estimation unit (212) that, when map information indicating a map of an environment around a first device (10) in a real space is updated, estimates a position of the first device (10), based on observation information obtained by observing the environment around the first device (10) and the map information after update, an identification unit (213) that identifies a position of a virtual camera provided in a virtual space associated with the real space, based on the position of the first device (10) estimated by the estimation unit (212), and a video generation unit (213) that generates a video of the virtual space corresponding to an imaging range of the camera at the position identified by the identification unit.
    Type: Application
    Filed: December 1, 2020
    Publication date: November 17, 2022
    Inventor: MASASHI ESHIMA
  • Patent number: 11488354
    Abstract: To enable both an increase in reproducibility for reproduction of a shape of an object and suppression of an increase in data amount. An information processing apparatus including: an acquisition unit that acquires first information associated with a result of estimation of a shape of an object on a real space and second information associated with a result of estimation of a geometrical feature of the object; and a correction unit that corrects the first information on the basis of the second information.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: November 1, 2022
    Assignee: SONY CORPORATION
    Inventors: Daiki Yamanaka, Masashi Eshima, Akihiko Kaino
  • Publication number: 20220237819
    Abstract: It is possible to generate a CG video desired by a user. An information processing system according to as embodiment includes: an acquisition unit (13) that acquires first position information of a device existing in a real space, the first position information regarding the real space; a trajectory generation unit (15) that generates a movement trajectory of a viewpoint set in a virtual space on the basis of the first position information, the movement trajectory regarding the virtual space; a first modification unit (15) that modifies second position information of the viewpoint in the virtual space, the second position information regarding the virtual space; and a correction unit (22) that corrects the movement trajectory on the basis of the modification of the second position information.
    Type: Application
    Filed: June 24, 2020
    Publication date: July 28, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Takaaki KATO, Masashi ESHIMA
  • Patent number: 11244145
    Abstract: An information processing apparatus includes an estimating unit that estimates a normal on at least a part of a face of an object in a real space on the basis of polarization information corresponding to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor and having different polarization directions and a control unit that controls output of notification information for guiding a change in a position in the real space according to an estimation result of the normal.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: February 8, 2022
    Assignee: SONY CORPORATION
    Inventors: Masashi Eshima, Akihiko Kaino, Daiki Yamanaka
  • Patent number: 11232590
    Abstract: There is provided an information processing apparatus to achieve both the stabilization of estimation of the distance to a target physical body and the suppression of power consumption. The information processing apparatus includes: a first estimation unit configured to estimate a distance between a prescribed visual point and a physical body in a real space on the basis of result of detection of light that is sent from a prescribed light sending unit toward the physical body and is reflected at the physical body; a second estimation unit configured to estimate at least either one of a position or an attitude in the real space of the prescribed visual point on the basis of result of estimation of the distance; and a control unit configured to control the light sent from the light sending unit in accordance with a situation regarding estimation of at least either one of the position or the attitude.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: January 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Akihiko Kaino, Masashi Eshima, Daiki Yamanaka, Shunichi Homma
  • Publication number: 20210407189
    Abstract: To enable both an increase in reproducibility for reproduction of a shape of an object and suppression of an increase in data amount. An information processing apparatus including: an acquisition unit that acquires first information associated with a result of estimation of a shape of an object on a real space and second information associated with a result of estimation of a geometrical feature of the object; and a correction unit that corrects the first information on the basis of the second information.
    Type: Application
    Filed: March 26, 2018
    Publication date: December 30, 2021
    Inventors: DAIKI YAMANAKA, MASASHI ESHIMA, AKIHIKO KAINO
  • Patent number: 11189042
    Abstract: There is provided an information processing device to enable a three-dimensional shape of an object in a real space to be estimated in a more preferred manner, the information processing device including: a division unit configured to divide, into one or more regions, an image plane corresponding to a viewing point in a real space on which geometric structure information is mapped in accordance with distribution of the geometric structure information; an acquisition unit configured to acquire orientation information indicating at least one of a position and an orientation of the viewing point; an extracting unit configured to extract, as a region of interest, at least part of the regions obtained by dividing the image plane; and an estimation unit configured to estimate a shape of an object in the real space based on the geometric structure information in regions of interest on image planes respectively corresponding to a plurality of different viewing points associated with each other among the viewing point
    Type: Grant
    Filed: May 7, 2018
    Date of Patent: November 30, 2021
    Assignee: SONY CORPORATION
    Inventors: Akihiko Kaino, Masashi Eshima, Daiki Yamanaka
  • Patent number: 11019362
    Abstract: Provided are an information processing device and an information processing method that enable suppression of a reduction in coding efficiency while suppressing a reduction in subjective quality. Information regarding a three-dimensional region is encoded on the basis of a distribution related to overlapping of visual fields of the three-dimensional region to be imaged by a plurality of imaging units, the distribution being specified by using a parameter relating to overlapping of visual fields that are imaging ranges of the plurality of imaging units.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: May 25, 2021
    Assignee: SONY CORPORATION
    Inventor: Masashi Eshima
  • Publication number: 20210141386
    Abstract: [Solving Means] [Object] To provide an information processing apparatus, a mobile object, a system, an information processing method, and a program that make it possible to reduce an impact of a disturbance factor. [Solving Means] An information processing apparatus includes an information acquisition unit and a control prediction unit. The information acquisition unit acquires information regarding a location and a posture of a first mobile object that includes a sensing device. The control prediction unit predicts control performed with respect to the sensing device, on the basis of the information regarding the location and the posture and map information, the information regarding the location and the posture being acquired by the information acquisition unit.
    Type: Application
    Filed: November 6, 2018
    Publication date: May 13, 2021
    Inventor: MASASHI ESHIMA
  • Publication number: 20210124174
    Abstract: The present disclosure relates to an HMD, a control method for the head mounted display, an information processor, a display device, and a program that make it possible to estimate camera parameters of a camera mounted in the HMD without the awareness of a user wearing the HMD. At a timing when the HMD is displaying content including a VR image or an AR image, the camera mounted in the HMD captures an image of a calibration pattern displayed on an external display, executes calibration on the basis of the captured image of the calibration pattern, and estimates the camera parameters. At this time, the calibration pattern displayed on the external display is displayed with dimensions according to a positional relationship between the HMD and the external display. The present disclosure is applicable to the HMD.
    Type: Application
    Filed: July 3, 2019
    Publication date: April 29, 2021
    Applicant: SONY CORPORATION
    Inventors: Makoto Daniel TOKUNAGA, Shunichi HOMMA, Akihiko KAINO, Masashi ESHIMA, Kentaro DOBA
  • Publication number: 20210110574
    Abstract: There is provided an information processing apparatus to achieve both the stabilization of estimation of the distance to a target physical body and the suppression of power consumption. The information processing apparatus includes: a first estimation unit configured to estimate a distance between a prescribed visual point and a physical body in a real space on the basis of result of detection of light that is sent from a prescribed light sending unit toward the physical body and is reflected at the physical body; a second estimation unit configured to estimate at least either one of a position or an attitude in the real space of the prescribed visual point on the basis of result of estimation of the distance; and a control unit configured to control the light sent from the light sending unit in accordance with a situation regarding estimation of at least either one of the position or the attitude.
    Type: Application
    Filed: March 26, 2018
    Publication date: April 15, 2021
    Applicant: SONY CORPORATION
    Inventors: Akihiko KAINO, Masashi ESHIMA, Daiki YAMANAKA, Shunichi HOMMA
  • Patent number: 10970877
    Abstract: An image processing apparatus, an image processing method, and a program that permit camera calibration with high accuracy by using a known object in images captured by a plurality of imaging sections. An estimation section estimates a 3D position of a road sign included in each of images captured by a plurality of cameras with respect to each of the imaging sections. A recognition section recognizes a positional relationship between the plurality of cameras on the basis of the 3D position of the road sign with respect to each of the cameras estimated by the estimation section. The positional relationship between the plurality of cameras recognized by the recognition section is used to correct the images captured by the plurality of cameras.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: April 6, 2021
    Assignee: Sony Corporation
    Inventors: Masashi Eshima, Akihiko Kaino, Takaaki Kato, Shingo Tsurumi
  • Patent number: 10803600
    Abstract: The present disclosure relates to an information processing device, an information processing method, and a program capable of performing continuous estimation of a self-position. An information processing device according to an aspect of the present disclosure includes: a main imaging unit that includes a stereo camera mounted on a moving body, and captures moving images at a predetermined frame rate to output a pair of stereo main images as time-series images; a plurality of sub imaging units each of which is so mounted on the moving body as to have an imaging direction different from an imaging direction of the main imaging unit, and captures moving images at a predetermined frame rate; and a final pose determination unit that estimates a pose of the moving body on the basis of the pair of stereo main images captured by the main imaging unit, and sub images captured by the sub imaging units. For example, the present disclosure is applicable to a self-position sensor for in-vehicle use.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: October 13, 2020
    Assignee: Sony Corporation
    Inventors: Akihiko Kaino, Shingo Tsurumi, Masashi Eshima, Takaaki Kato, Masaki Fukuchi, Tatsuki Kashitani, Shunichi Homma
  • Patent number: 10753757
    Abstract: An information processing apparatus and an information processing method enables enhancement of accuracy in recognition of locations of a moving body. The information processing apparatus is arranged on a moving body and includes an own-location recognition block that recognizes, based on an image taken from the moving body, a first own location of the moving body. A moving body recognition block recognizes a relative location of another moving body relative to the moving body in the image taken from the moving body, and a communication block executes communication with the another moving body to obtain the absolute location of the another moving body, An own location computation block computes, based on the absolute location of the another moving body and the relative location of the another moving body, a second own location of the moving body.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: August 25, 2020
    Assignee: SONY CORPORATION
    Inventors: Shingo Tsurumi, Masashi Eshima, Akihiko Kaino, Takaaki Kato, Masaki Fukuchi, Suguru Aoki, Takuto Motoyama
  • Patent number: 10731994
    Abstract: The present disclosure relates to an information processing device and an information processing method that are capable of estimating the self-position by accurately and continuously estimating the self-movement. The information processing device according to an aspect of the present disclosure includes a downward imaging section and a movement estimation section. The downward imaging section is disposed on the bottom of a moving object traveling on a road surface and captures an image of the road surface. The movement estimation section estimates the movement of the moving object in accordance with a plurality of images representing the road surface and captured at different time points by the downward imaging section. The present disclosure can be applied, for example, to a position sensor mounted in an automobile.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: August 4, 2020
    Assignee: SONY CORPORATION
    Inventors: Takaaki Kato, Shingo Tsurumi, Masashi Eshima, Akihiko Kaino, Masaki Fukuchi
  • Publication number: 20200242335
    Abstract: It is possible to acquire information used for recognizing an object in a real space in a more suitable manner. An information processing apparatus includes: an estimating unit that estimates a normal on at least a part of a face of an object in a real space on the basis of polarization information corresponding to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor and having different polarization directions; and a control unit that controls output of notification information for guiding a change in a position in the real space according to an estimation result of the normal.
    Type: Application
    Filed: July 19, 2018
    Publication date: July 30, 2020
    Inventors: MASASHI ESHIMA, AKIHIKO KAINO, DAIKI YAMANAKA
  • Publication number: 20200226774
    Abstract: There is provided an information processing device to enable a three-dimensional shape of an object in a real space to be estimated in a more preferred manner, the information processing device including: a division unit configured to divide, into one or more regions, an image plane corresponding to a viewing point in a real space on which geometric structure information is mapped in accordance with distribution of the geometric structure information; an acquisition unit configured to acquire orientation information indicating at least one of a position and an orientation of the viewing point; an extracting unit configured to extract, as a region of interest, at least part of the regions obtained by dividing the image plane; and an estimation unit configured to estimate a shape of an object in the real space based on the geometric structure information in regions of interest on image planes respectively corresponding to a plurality of different viewing points associated with each other among the viewing point
    Type: Application
    Filed: May 7, 2018
    Publication date: July 16, 2020
    Applicant: SONY CORPORATION
    Inventors: Akihiko KAINO, Masashi ESHIMA, Daiki YAMANAKA
  • Publication number: 20200211275
    Abstract: [Problem] Provided is a technique to reduce volume of data for a model reconstructed from an object in real space and to reconstruct a shape of the object as a further preferable aspect. [Solution] An information processing device includes: a first estimation unit configured to estimate a first distribution of geometric structure information regarding at least part of a face of an object in real space, in accordance with each of a plurality of beams of polarized light, having different polarization directions from each other, as a result detected by a polarization sensor; a second estimation unit configured to estimate a second distribution of information related to continuity of a geometric structure in the real space based on an estimation result of the first distribution; and a processing unit configured to determine a size of unit data for simulating three-dimensional space in accordance with the second distribution.
    Type: Application
    Filed: June 18, 2018
    Publication date: July 2, 2020
    Inventors: MASASHI ESHIMA, AKIHIKO KAINO, DAIKI YAMANAKA