Patents by Inventor Kenichiro Oi
Kenichiro Oi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 8896628Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.Type: GrantFiled: January 5, 2011Date of Patent: November 25, 2014Assignee: Sony CorporationInventors: Yasuhiro Suto, Masaki Fukuchi, Kenichiro Oi, Jingjing Guo, Kouichi Matsuda
-
Publication number: 20140334679Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit storing dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data to the environmental map and executes object arrangement on the environmental map.Type: ApplicationFiled: July 24, 2014Publication date: November 13, 2014Inventors: KENICHIRO OI, STEFFEN GUTMANN, TAKAYUKI YOSHIGAHARA
-
Patent number: 8861785Abstract: An information processing device, including: a three-dimensional information generating section for obtaining position and attitude of a moving camera or three-dimensional positions of feature points by successively receiving captured images from different viewpoints, and updating status data using observation information which includes tracking information of the feature points, the status data including three-dimensional positions of the feature points within the images and position and attitude information of the camera; and a submap generating section for generating submaps by dividing an area for which the three-dimensional position is to be calculated.Type: GrantFiled: August 12, 2010Date of Patent: October 14, 2014Assignee: Sony CorporationInventors: Kenichiro Oi, Masaki Fukuchi
-
Patent number: 8818039Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit storing dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data to the environmental map and executes object arrangement on the environmental map.Type: GrantFiled: October 31, 2012Date of Patent: August 26, 2014Assignee: Sony CorporationInventors: Kenichiro Oi, Steffen Gutmann, Takayuki Yoshigahara
-
Publication number: 20140177917Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.Type: ApplicationFiled: February 26, 2014Publication date: June 26, 2014Applicant: SONY CORPORATIONInventors: Masaki FUKUCHI, Kouichi MATSUDA, Yasuhiro SUTO, Kenichiro OI, Jingjing GUO
-
Publication number: 20140168268Abstract: According to an embodiment of the present disclosure, there is provided an information processing device including a data acquisition unit configured to acquire sensor data indicating the direction of gravity exerted on an imaging device configured to image an image in which a physical space is projected, a decision unit configured to decide a relative attitude of a plane in the physical space with respect to the image based on the sensor data, and a conversion unit configured to perform conversion between a three-dimensional position of a given point on the plane and a two-dimensional position in the corresponding image using the attitude decided by the decision unit.Type: ApplicationFiled: August 14, 2012Publication date: June 19, 2014Applicant: Sony CorporationInventors: Kenichiro Oi, Hiroyuki Ishiwatara
-
Patent number: 8744130Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.Type: GrantFiled: August 30, 2013Date of Patent: June 3, 2014Assignee: Sony CorporationInventors: Masaki Fukuchi, Kouichi Matsuda, Yasuhiro Suto, Kenichiro Oi, Jingjing Guo
-
Publication number: 20140003667Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.Type: ApplicationFiled: August 30, 2013Publication date: January 2, 2014Applicant: SONY CORPORATIONInventors: Masaki FUKUCHI, Kouichi MATSUDA, Yasuhiro SUTO, Kenichiro OI, Jingjing GUO
-
Publication number: 20130293586Abstract: An apparatus comprising a memory storing instructions is provided. The apparatus includes a control unit for executing the instructions to send signals to display, for a user, a first virtual image superimposed onto a representation of real space. The control unit further executes instructions to send signals to identify a potential source of interest for the user, the potential source of interest being outside of a user focus area in the representation of real space. The control unit further executes instructions to send signals to notify the user of the potential source of interest.Type: ApplicationFiled: December 19, 2011Publication date: November 7, 2013Applicant: Sony CorporationInventors: Akihiko Kaino, Yoshiaki Iwai, Kenichiro Oi, Shunichi Homma, Jianing Wu
-
Publication number: 20130108108Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit storing dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data to the environmental map and executes object arrangement on the environmental map.Type: ApplicationFiled: October 31, 2012Publication date: May 2, 2013Inventors: Kenichiro OI, Steffen Gutmann, Takayuki Yoshigahara
-
Patent number: 8345925Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.Type: GrantFiled: January 3, 2011Date of Patent: January 1, 2013Assignee: Sony CorporationInventors: Masaki Fukuchi, Kouichi Matsuda, Yasuhiro Suto, Kenichiro Oi, Jingjing Guo
-
Patent number: 8325985Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit having stored therein dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image acquired by the camera with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data registered in the dictionary data to the environmental map and executes object arrangement on the environmental map.Type: GrantFiled: October 26, 2011Date of Patent: December 4, 2012Assignee: Sony CorporationInventors: Kenichiro Oi, Steffen Guimann, Takayuki Yoshigahara
-
Publication number: 20120194554Abstract: An apparatus comprising a memory storing instructions is provided. The apparatus includes a control unit for executing the instructions to send signals to display, for a user, a first virtual image superimposed onto an image of real space, the image of real space comprising an image of a potential source of interest for the user. The control unit further executes instructions to send signals to send signals to analyze the image of real space to detect the potential source of interest. The control unit further executes instructions to send signals to notify the user of the potential source of interest.Type: ApplicationFiled: January 23, 2012Publication date: August 2, 2012Inventors: Akihiko KAINO, Yoshiaki Iwai, Kenichiro Oi, Shunichi Homma, Jianing Wu
-
Publication number: 20120039511Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit having stored therein dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image acquired by the camera with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data registered in the dictionary data to the environmental map and executes object arrangement on the environmental map.Type: ApplicationFiled: October 26, 2011Publication date: February 16, 2012Inventors: Kenichiro OI, Steffen GUIMANN, Takayuki YOSHIGAHARA
-
Patent number: 8073200Abstract: An information processing apparatus that executes processing for creating an environmental map includes a camera that photographs an image, a self-position detecting unit that detects a position and a posture of the camera on the basis of the image, an image-recognition processing unit that detects an object from the image, a data constructing unit that is inputted with information concerning the position and the posture of the camera and information concerning the object and executes processing for creating or updating the environmental map, and a dictionary-data storing unit having stored therein dictionary data in which object information is registered. The image-recognition processing unit executes processing for detecting an object from the image acquired by the camera with reference to the dictionary data. The data constructing unit applies the three-dimensional shape data registered in the dictionary data to the environmental map and executes object arrangement on the environmental map.Type: GrantFiled: June 6, 2008Date of Patent: December 6, 2011Assignee: Sony CorporationInventors: Kenichiro Oi, Steffen Gutmann, Takayuki Yoshigahara
-
Publication number: 20110224902Abstract: There is provided an information processing device including: a global map acquiring unit that acquires at least a part of a global map representing positions of objects in a real space where a plurality of users are in activity; a local map generating unit that generates a local map representing positions of nearby objects detectable by a device of one user among the plurality of users; and an updating unit that updates the global map based on position data of objects included in the local mapType: ApplicationFiled: March 1, 2011Publication date: September 15, 2011Inventors: Kenichiro Oi, Quan Wang, Kouichi Matsuda, Takayuki Yoshigahara
-
Publication number: 20110187726Abstract: There is provided an image processing device including: a data storage unit having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space using an imaging device and the feature data stored in the data storage unit, the environment map representing a position of a physical object present in the real space; an information generating unit for generating animation data for displaying a status of communication via a communication interface on a screen, using the environment map built by the environment map building unit; and an image superimposing unit for generating an output image by superimposing an animation according to the animation data generated by the information generating unit on the input image.Type: ApplicationFiled: January 27, 2011Publication date: August 4, 2011Inventors: YASUHIRO SUTO, Kouichi Matsuda, Masaki Fukuchi, Kenichiro Oi, Jingjing Guo
-
Publication number: 20110187746Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.Type: ApplicationFiled: January 5, 2011Publication date: August 4, 2011Inventors: Yasuhiro SUTO, Masaki Fukuchi, Kenichiro Oi, Jingjing Guo, Kouichi Matsuda
-
Publication number: 20110096093Abstract: There is provided an image processing device, including: a data storage unit storing feature data indicating a feature of appearance of an object; an environment map generating unit for generating an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and an output image generating unit for generating an output image obtained by erasing an erasing target object from the input image based on a position of the erasing target object specified out of objects present in the input image represented in the environment map and a position of the imaging device.Type: ApplicationFiled: September 10, 2010Publication date: April 28, 2011Applicant: Sony CorporationInventors: Kenichiro OI, Jingjing Guo, Yasuhiro Suto
-
Publication number: 20110044504Abstract: An information processing device, including: a three-dimensional information generating section for obtaining position and attitude of a moving camera or three-dimensional positions of feature points by successively receiving captured images from different viewpoints, and updating status data using observation information which includes tracking information of the feature points, the status data including three-dimensional positions of the feature points within the images and position and attitude information of the camera; and a submap generating section for generating submaps by dividing an area for which the three-dimensional position is to be calculated.Type: ApplicationFiled: August 12, 2010Publication date: February 24, 2011Inventors: Kenichiro OI, Masaki Fukuchi