Patents by Inventor Nobuyasu Yamaguchi

Nobuyasu Yamaguchi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10796435
    Abstract: An image processing method includes calculating a first feature-quantity that includes feature-quantities for indicating features of individual pixel values of pixels located in a first direction perpendicular to a first line segment out of line segments and feature-quantities for indicating features of individual pixel values of pixels located in a second direction opposite to the first direction with respect to the first line segment, and calculating, based on pixel values of pixels located for each predetermined distance in a third direction perpendicular to a second line segment out of the line segments and pixel values of pixels located for each of the predetermined distance in a fourth direction opposite to the third direction with respect to the second line segment, a second feature-quantity that includes feature-quantities for indicating individual features of the pixels located for each of the predetermined distance from the second line segment.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: October 6, 2020
    Assignee: FUJITSU LIMITED
    Inventor: Nobuyasu Yamaguchi
  • Patent number: 10636165
    Abstract: An information processing apparatus configured to store a plurality of images captured by an imaging device, store first position information and first orientation information indicating positions and orientations of the imaging device in capturing of each of the plurality of images, identify, among from the plurality of images, a first image resembling a second image, identify a first area included in the first image, identify a second area, included in the second image, corresponding to the first area, identify second position information and second orientation information indicating a position and an orientation of the imaging device respectively in capturing of the second image, based on a comparison between a first luminance of a first pixel included in the first area and a second luminance of a second pixel included in the second area and the first position information and the first orientation information of the first image.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: April 28, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Taichi Murase
  • Patent number: 10573090
    Abstract: A non-transitory computer-readable storage medium storing a program that causes a computer to execute a process including displaying a plurality of first edge lines extracted from a captured image including a structure captured by a camera and a plurality of second edge lines included in a three dimensional model corresponding to structure data of the structure, detecting a first operation that designates target first edge lines included in the plurality of first edge lines in a first order, detecting a second operation that designates target second edge lines included in the plurality of second edge lines in a second order, associating each of the target second edge lines with one of the target first edge lines based on the first order and the second order, and superimposing the three dimensional model with the structure in the captured image based on a result of the associating.
    Type: Grant
    Filed: February 5, 2018
    Date of Patent: February 25, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Hiroshi Kuwabara, Susumu Koga, Tomohiro Aoyagi, Yojiro Numata, Toshiyuki Yoshitake, Nobuyasu Yamaguchi, Taichi Murase
  • Patent number: 10438412
    Abstract: A method includes specifying a position of a virtual object based on a position of a map point that is defined in a first map and indicates three-dimensional coordinates of a feature point, correcting the position of the virtual object based on positions of a plurality of map points defined in a second map and a capturing direction of a camera when the first map is changed to the second map that is different from the first map, and controlling a display to display the virtual object, based on the corrected position of the virtual object and an image captured by the camera.
    Type: Grant
    Filed: April 20, 2017
    Date of Patent: October 8, 2019
    Assignee: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Toshiyuki Yoshitake
  • Patent number: 10354409
    Abstract: An image processing device divides a recognition purpose image into a plurality of areas, selects feature points in the recognition purpose image such that a bias of the number of the feature points included in each of the areas is small registers information on the selected feature points in the recognition purpose image in a memory and estimates a position and an orientation of the camera based on the recognition purpose image registered in the memory and based on a captured image captured by a camera.
    Type: Grant
    Filed: July 24, 2017
    Date of Patent: July 16, 2019
    Assignee: FUJITSU LIMITED
    Inventor: Nobuyasu Yamaguchi
  • Patent number: 10354402
    Abstract: A computer estimates a first position of an image capturing apparatus by using a prescribed number of combinations that correlate projection lines to feature lines. The projection lines are obtained by projecting candidate lines included in shape information of an object onto an image. Then, the computer generates a first projection line by projecting another candidate line onto the image using the first position, and selects a feature line that corresponds to the first projection line. Subsequently, the computer estimates a second position of the image capturing apparatus by using a combination that correlates the first projection line to the selected feature line. The computer generates a second projection line by projecting the other candidate line onto the image using the second position, and determines a third position of the image capturing apparatus according to an indicator of an interval between the second projection line and the other feature line.
    Type: Grant
    Filed: March 22, 2017
    Date of Patent: July 16, 2019
    Assignee: FUJITSU LIMITED
    Inventor: Nobuyasu Yamaguchi
  • Patent number: 10311576
    Abstract: A computer extracts a plurality of candidate lines that are observed from a position of an imaging device that captures an image of an object from among a plurality of candidate lines included in shape information of the object. The computer generates plural pieces of association information indicating a prescribed number of combinations obtained by respectively associating the prescribed number of candidate lines of the observed plurality of candidate lines with the prescribed number of feature lines of a plurality of feature lines detected from the image. The computer determines an association result according to respective errors of the plural pieces of association information.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: June 4, 2019
    Assignee: FUJITSU LIMITED
    Inventors: Nobuyasu Yamaguchi, Yojiro Numata, Hiroshi Kuwabara
  • Publication number: 20190102885
    Abstract: An image processing method includes calculating a first feature-quantity that includes feature-quantities for indicating features of individual pixel values of pixels located in a first direction perpendicular to a first line segment out of line segments and feature-quantities for indicating features of individual pixel values of pixels located in a second direction opposite to the first direction with respect to the first line segment, and calculating, based on pixel values of pixels located for each predetermined distance in a third direction perpendicular to a second line segment out of the line segments and pixel values of pixels located for each of the predetermined distance in a fourth direction opposite to the third direction with respect to the second line segment, a second feature-quantity that includes feature-quantities for indicating individual features of the pixels located for each of the predetermined distance from the second line segment.
    Type: Application
    Filed: September 25, 2018
    Publication date: April 4, 2019
    Applicant: FUJITSU LIMITED
    Inventor: Nobuyasu YAMAGUCHI
  • Patent number: 10235118
    Abstract: An image processing method includes acquiring a three-dimensional model obtained by modeling a plurality of objects included in a work space, acquiring, from a camera which is hold by a user, an image captured by the camera, the user existing in the work space, acquiring, from a sensor which is hold by the user, distance information indicating distances between the sensor and each of the plurality of objects, determining a position of the user in the work space based on the three-dimensional model and the distance information, identifying a predetermined region closest to the position of the user among at least one of predetermined regions defined in the three-dimensional model, generating a display screen displaying the predetermined region and the image, and outputting the display screen to another computer.
    Type: Grant
    Filed: August 22, 2016
    Date of Patent: March 19, 2019
    Assignee: FUJITSU LIMITED
    Inventors: Ayu Karasudani, Nobuyasu Yamaguchi
  • Patent number: 10223804
    Abstract: A method includes associating a plurality of first feature points with a plurality of second feature points, the plurality of first feature points being included in a keyframe that represents a first captured image at a first time when a position and an orientation of a camera are successfully estimated, the plurality of second feature points being included in a second captured image captured at a second time, calculating vectors based on feature descriptors of the first feature points and feature descriptors of the second feature points for respective pairs of the first feature points and the second feature points, determining whether an association of the first feature points and the second feature points is satisfactory, and performing an estimation process that estimates a new position and a new orientation of the camera at the second time when the association is determined to be satisfactory.
    Type: Grant
    Filed: November 16, 2016
    Date of Patent: March 5, 2019
    Assignee: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Toshiyuki Yoshitake
  • Patent number: 10147192
    Abstract: A coordinate-conversion-parameter determination apparatus includes a marker detector that detects feature points of a marker from each of a first and second images; a three-dimensional position determiner that calculates three-dimensional coordinates of each of the feature points of the marker in a camera coordinate system in which reference is a first place, based on positions of the feature points in the first and second images; and a coordinate-conversion-parameter determiner that calculates a coordinate conversion parameter so that a sum of absolute values of errors between three-dimensional coordinates in a world coordinate system, the three-dimensional coordinates in the world coordinate system being obtained by converting the three-dimensional coordinates of the feature points of the marker in the camera coordinate system by using the coordinate conversion parameter, and three-dimensional coordinates of feature points in the world coordinate system that correspond to the feature points of the marker in
    Type: Grant
    Filed: February 25, 2016
    Date of Patent: December 4, 2018
    Assignee: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Takahiro Matsuda
  • Patent number: 10102647
    Abstract: A device includes a processor configured to execute a first estimation process including detecting a marker from a captured image, and estimating first position and posture of a camera at a time when the captured image is captured, based on a shape of the marker, execute a second estimation process including obtaining a map point in a three-dimensional space from the memory, and estimating second position and posture of the camera at the time when the captured image is captured, based on a correspondence between a projection point in which the map point is projected on the captured image and a characteristic point extracted from the captured image, and select the first position and posture or the second position and posture based on a result of comparison between a first translational component of the first position and posture and a second translational component of the second position and posture.
    Type: Grant
    Filed: April 18, 2016
    Date of Patent: October 16, 2018
    Assignee: FUJITSU LIMITED
    Inventors: Nobuyasu Yamaguchi, Atsunori Moteki
  • Patent number: 10088294
    Abstract: A method includes determining movement of a camera from a first time point when a first image has been captured to a second time point when a second image has been captured, performing first estimation processing for estimating a position and pose of the camera in the second time point based on image data at the time of capturing, a past image captured in the past, and a past position and pose of the camera at a time point when the past image has been captured, when the movement is not a translational movement and a rotation movement around an optical direction, and performing a second estimation processing for estimating the position and pose based on a feature descriptor of a feature point extracted from the second image and a feature descriptor of a map point accumulated when the movement is the translational movement or the rotational movement.
    Type: Grant
    Filed: April 13, 2016
    Date of Patent: October 2, 2018
    Assignee: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Toshiyuki Yoshitake
  • Publication number: 20180253861
    Abstract: An information processing apparatus configured to store a plurality of images captured by an imaging device, store first position information and first orientation information indicating positions and orientations of the imaging device in capturing of each of the plurality of images, identify, among from the plurality of images, a first image resembling a second image, identify a first area included in the first image, identify a second area, included in the second image, corresponding to the first area, identify second position information and second orientation information indicating a position and an orientation of the imaging device respectively in capturing of the second image, based on a comparison between a first luminance of a first pixel included in the first area and a second luminance of a second pixel included in the second area and the first position information and the first orientation information of the first image.
    Type: Application
    Filed: February 23, 2018
    Publication date: September 6, 2018
    Applicant: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Taichi Murase
  • Publication number: 20180247430
    Abstract: A display control apparatus includes a memory, and a processor configured to obtain an image including an object, the image being captured by a camera, extract a group of edge lines from the image, determine a plurality of edge lines in accordance with a position of a reference object from among the group of edge lines when the reference object is detected in the image, execute an association process between each of the plurality of edge lines and each of a plurality of ridge lines included in a model corresponding to structure data of the object, the model being obtained from the memory, and superimpose the model on the image in a state in which positions of the plurality of ridge lines correspond to positions of the plurality of edge lines respectively.
    Type: Application
    Filed: February 13, 2018
    Publication date: August 30, 2018
    Applicant: FUJITSU LIMITED
    Inventors: SUSUMU KOGA, Hiroshi KUWABARA, Nobuyasu YAMAGUCHI, Toshiyuki Yoshitake, Taichi Murase, Tomohiro AOYAGI
  • Publication number: 20180225883
    Abstract: A non-transitory computer-readable storage medium storing a program that causes a computer to execute a process including displaying a plurality of first edge lines extracted from a captured image including a structure captured by a camera and a plurality of second edge lines included in a three dimensional model corresponding to structure data of the structure, detecting a first operation that designates target first edge lines included in the plurality of first edge lines in a first order, detecting a second operation that designates target second edge lines included in the plurality of second edge lines in a second order, associating each of the target second edge lines with one of the target first edge lines based on the first order and the second order, and superimposing the three dimensional model with the structure in the captured image based on a result of the associating.
    Type: Application
    Filed: February 5, 2018
    Publication date: August 9, 2018
    Applicant: FUJITSU LIMITED
    Inventors: Hiroshi KUWABARA, SUSUMU KOGA, Tomohiro AOYAGI, Yojiro NUMATA, Toshiyuki Yoshitake, Nobuyasu YAMAGUCHI, Taichi Murase
  • Publication number: 20180089836
    Abstract: A computer extracts a plurality of candidate lines that are observed from a position of an imaging device that captures an image of an object from among a plurality of candidate lines included in shape information of the object. The computer generates plural pieces of association information indicating a prescribed number of combinations obtained by respectively associating the prescribed number of candidate lines of the observed plurality of candidate lines with the prescribed number of feature lines of a plurality of feature lines detected from the image. The computer determines an association result according to respective errors of the plural pieces of association information.
    Type: Application
    Filed: August 18, 2017
    Publication date: March 29, 2018
    Applicant: FUJITSU LIMITED
    Inventors: Nobuyasu YAMAGUCHI, Yojiro NUMATA, Hiroshi KUWABARA
  • Publication number: 20180061078
    Abstract: An image processing device divides a recognition purpose image into a plurality of areas, selects feature points in the recognition purpose image such that a bias of the number of the feature points included in each of the areas is small registers information on the selected feature points in the recognition purpose image in a memory and estimates a position and an orientation of the camera based on the recognition purpose image registered in the memory and based on a captured image captured by a camera.
    Type: Application
    Filed: July 24, 2017
    Publication date: March 1, 2018
    Applicant: FUJITSU LIMITED
    Inventor: Nobuyasu YAMAGUCHI
  • Patent number: 9892516
    Abstract: A three-dimensional coordinate computing apparatus includes an image selecting unit and a coordinate computing unit. The image selecting unit selects a first selected image from multiple captured images, and selects a second selected image from multiple subsequent images captured by the camera after the first selected image has been captured. The second selected image is selected based on a distance between a position of capture of the first selected image and a position of capture of each of the multiple subsequent images and the number of corresponding feature points, each of which corresponds to one of feature points extracted from the first selected image and one of feature points extracted from each of the multiple subsequent images. The coordinate computing unit computes three-dimensional coordinates of the multiple corresponding feature points based on two-dimensional coordinates of each corresponding feature point in the first and second selected images.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: February 13, 2018
    Assignee: FUJITSU LIMITED
    Inventors: Atsunori Moteki, Nobuyasu Yamaguchi, Takahiro Matsuda
  • Patent number: 9842399
    Abstract: A device includes a memory configured to store map point information including a first map point group indicating a three-dimensional position of an object measured by a distance sensor and a second map point group indicating a three-dimensional position of the object determined based on captured images and a processor configured to compare a first projection point group of the first map point group with a feature point group extracted from a new captured image, create pairs of a feature point in the feature point group and a first projection point that is similar to the feature point, when the number of the pairs is less than or equal to a threshold, compare a second projection point group of the second map point group with the feature point group, create other pairs of the feature point and a second projection point, and estimate a position and attitude of a camera.
    Type: Grant
    Filed: April 26, 2016
    Date of Patent: December 12, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Nobuyasu Yamaguchi