Patents by Inventor Kenichiro Oi

Kenichiro Oi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8896628
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Grant
    Filed: January 5, 2011
    Date of Patent: November 25, 2014
    Assignee: Sony Corporation
    Inventors: Yasuhiro Suto, Masaki Fukuchi, Kenichiro Oi, Jingjing Guo, Kouichi Matsuda
  • Publication number: 20140334679
    Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit storing dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data to the environmental map and executes object arrangement on the environmental map.
    Type: Application
    Filed: July 24, 2014
    Publication date: November 13, 2014
    Inventors: KENICHIRO OI, STEFFEN GUTMANN, TAKAYUKI YOSHIGAHARA
  • Patent number: 8861785
    Abstract: An information processing device, including: a three-dimensional information generating section for obtaining position and attitude of a moving camera or three-dimensional positions of feature points by successively receiving captured images from different viewpoints, and updating status data using observation information which includes tracking information of the feature points, the status data including three-dimensional positions of the feature points within the images and position and attitude information of the camera; and a submap generating section for generating submaps by dividing an area for which the three-dimensional position is to be calculated.
    Type: Grant
    Filed: August 12, 2010
    Date of Patent: October 14, 2014
    Assignee: Sony Corporation
    Inventors: Kenichiro Oi, Masaki Fukuchi
  • Patent number: 8818039
    Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit storing dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data to the environmental map and executes object arrangement on the environmental map.
    Type: Grant
    Filed: October 31, 2012
    Date of Patent: August 26, 2014
    Assignee: Sony Corporation
    Inventors: Kenichiro Oi, Steffen Gutmann, Takayuki Yoshigahara
  • Publication number: 20140177917
    Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.
    Type: Application
    Filed: February 26, 2014
    Publication date: June 26, 2014
    Applicant: SONY CORPORATION
    Inventors: Masaki FUKUCHI, Kouichi MATSUDA, Yasuhiro SUTO, Kenichiro OI, Jingjing GUO
  • Publication number: 20140168268
    Abstract: According to an embodiment of the present disclosure, there is provided an information processing device including a data acquisition unit configured to acquire sensor data indicating the direction of gravity exerted on an imaging device configured to image an image in which a physical space is projected, a decision unit configured to decide a relative attitude of a plane in the physical space with respect to the image based on the sensor data, and a conversion unit configured to perform conversion between a three-dimensional position of a given point on the plane and a two-dimensional position in the corresponding image using the attitude decided by the decision unit.
    Type: Application
    Filed: August 14, 2012
    Publication date: June 19, 2014
    Applicant: Sony Corporation
    Inventors: Kenichiro Oi, Hiroyuki Ishiwatara
  • Patent number: 8744130
    Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.
    Type: Grant
    Filed: August 30, 2013
    Date of Patent: June 3, 2014
    Assignee: Sony Corporation
    Inventors: Masaki Fukuchi, Kouichi Matsuda, Yasuhiro Suto, Kenichiro Oi, Jingjing Guo
  • Publication number: 20140003667
    Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.
    Type: Application
    Filed: August 30, 2013
    Publication date: January 2, 2014
    Applicant: SONY CORPORATION
    Inventors: Masaki FUKUCHI, Kouichi MATSUDA, Yasuhiro SUTO, Kenichiro OI, Jingjing GUO
  • Publication number: 20130293586
    Abstract: An apparatus comprising a memory storing instructions is provided. The apparatus includes a control unit for executing the instructions to send signals to display, for a user, a first virtual image superimposed onto a representation of real space. The control unit further executes instructions to send signals to identify a potential source of interest for the user, the potential source of interest being outside of a user focus area in the representation of real space. The control unit further executes instructions to send signals to notify the user of the potential source of interest.
    Type: Application
    Filed: December 19, 2011
    Publication date: November 7, 2013
    Applicant: Sony Corporation
    Inventors: Akihiko Kaino, Yoshiaki Iwai, Kenichiro Oi, Shunichi Homma, Jianing Wu
  • Publication number: 20130108108
    Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit storing dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data to the environmental map and executes object arrangement on the environmental map.
    Type: Application
    Filed: October 31, 2012
    Publication date: May 2, 2013
    Inventors: Kenichiro OI, Steffen Gutmann, Takayuki Yoshigahara
  • Patent number: 8345925
    Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.
    Type: Grant
    Filed: January 3, 2011
    Date of Patent: January 1, 2013
    Assignee: Sony Corporation
    Inventors: Masaki Fukuchi, Kouichi Matsuda, Yasuhiro Suto, Kenichiro Oi, Jingjing Guo
  • Patent number: 8325985
    Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit having stored therein dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image acquired by the camera with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data registered in the dictionary data to the environmental map and executes object arrangement on the environmental map.
    Type: Grant
    Filed: October 26, 2011
    Date of Patent: December 4, 2012
    Assignee: Sony Corporation
    Inventors: Kenichiro Oi, Steffen Guimann, Takayuki Yoshigahara
  • Publication number: 20120194554
    Abstract: An apparatus comprising a memory storing instructions is provided. The apparatus includes a control unit for executing the instructions to send signals to display, for a user, a first virtual image superimposed onto an image of real space, the image of real space comprising an image of a potential source of interest for the user. The control unit further executes instructions to send signals to send signals to analyze the image of real space to detect the potential source of interest. The control unit further executes instructions to send signals to notify the user of the potential source of interest.
    Type: Application
    Filed: January 23, 2012
    Publication date: August 2, 2012
    Inventors: Akihiko KAINO, Yoshiaki Iwai, Kenichiro Oi, Shunichi Homma, Jianing Wu
  • Publication number: 20120039511
    Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit having stored therein dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image acquired by the camera with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data registered in the dictionary data to the environmental map and executes object arrangement on the environmental map.
    Type: Application
    Filed: October 26, 2011
    Publication date: February 16, 2012
    Inventors: Kenichiro OI, Steffen GUIMANN, Takayuki YOSHIGAHARA
  • Patent number: 8073200
    Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit having stored therein dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image acquired by the camera with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data registered in the dictionary data to the environmental map and executes object arrangement on the environmental map.
    Type: Grant
    Filed: June 6, 2008
    Date of Patent: December 6, 2011
    Assignee: Sony Corporation
    Inventors: Kenichiro Oi, Steffen Gutmann, Takayuki Yoshigahara
  • Publication number: 20110224902
    Abstract: There is provided an information processing device including: a global map acquiring unit that acquires at least a part of a global map representing positions of objects in a real space where a plurality of users are in activity; a local map generating unit that generates a local map representing positions of nearby objects detectable by a device of one user among the plurality of users; and an updating unit that updates the global map based on position data of objects included in the local map
    Type: Application
    Filed: March 1, 2011
    Publication date: September 15, 2011
    Inventors: Kenichiro Oi, Quan Wang, Kouichi Matsuda, Takayuki Yoshigahara
  • Publication number: 20110187726
    Abstract: There is provided an image processing device including: a data storage unit having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space using an imaging device and the feature data stored in the data storage unit, the environment map representing a position of a physical object present in the real space; an information generating unit for generating animation data for displaying a status of communication via a communication interface on a screen, using the environment map built by the environment map building unit; and an image superimposing unit for generating an output image by superimposing an animation according to the animation data generated by the information generating unit on the input image.
    Type: Application
    Filed: January 27, 2011
    Publication date: August 4, 2011
    Inventors: YASUHIRO SUTO, Kouichi Matsuda, Masaki Fukuchi, Kenichiro Oi, Jingjing Guo
  • Publication number: 20110187746
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Application
    Filed: January 5, 2011
    Publication date: August 4, 2011
    Inventors: Yasuhiro SUTO, Masaki Fukuchi, Kenichiro Oi, Jingjing Guo, Kouichi Matsuda
  • Publication number: 20110096093
    Abstract: There is provided an image processing device, including: a data storage unit storing feature data indicating a feature of appearance of an object; an environment map generating unit for generating an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and an output image generating unit for generating an output image obtained by erasing an erasing target object from the input image based on a position of the erasing target object specified out of objects present in the input image represented in the environment map and a position of the imaging device.
    Type: Application
    Filed: September 10, 2010
    Publication date: April 28, 2011
    Applicant: Sony Corporation
    Inventors: Kenichiro OI, Jingjing Guo, Yasuhiro Suto
  • Publication number: 20110044504
    Abstract: An information processing device, including: a three-dimensional information generating section for obtaining position and attitude of a moving camera or three-dimensional positions of feature points by successively receiving captured images from different viewpoints, and updating status data using observation information which includes tracking information of the feature points, the status data including three-dimensional positions of the feature points within the images and position and attitude information of the camera; and a submap generating section for generating submaps by dividing an area for which the three-dimensional position is to be calculated.
    Type: Application
    Filed: August 12, 2010
    Publication date: February 24, 2011
    Inventors: Kenichiro OI, Masaki Fukuchi