Abstract: An information processing apparatus includes an input unit configured to input a plurality of images captured from a plurality of viewpoints, an extraction unit configured to extract a region of an object from each of the plurality of images, an acquisition unit configured to obtain a contour from the region of the object, a smoothing unit configured to perform smoothing of the contour based on a point group on the obtained contour, a correlation unit configured to correlate regions of the object extracted from respective ones of the plurality of images, and a calculation unit configured to calculate a position of the object based on information of regions correlated by the correlation unit and the point group obtained by the smoothing unit.

Abstract: An image processing apparatus obtains location information of each image feature in a captured image based on image coordinates of the image feature in the captured image. The image processing apparatus selects location information usable to calculate a position and an orientation of the imaging apparatus among the obtained location information. The image processing apparatus obtains the position and the orientation of the imaging apparatus based on the selected location information and an image feature corresponding to the selected location information among the image features included in the captured image.

Abstract: An object region detection unit (130) decides the region of a physical object of interest in a physical space image. An image manipulation unit (140) performs shading processing of an inclusion region including the decided region. A rendering unit (155) arranges a virtual object in virtual space at the position and orientation of the physical object of interest and generates a virtual space image based on the position and orientation of the user's viewpoint. A composition unit (160) generates a composite image by superimposing the virtual space image on the physical space image that has undergone the shading processing and outputs the generated composite image to an HMD (190).

Abstract: An information processing apparatus extracts, from each of images of an object captured from a plurality of viewpoints, a contour of the object, selects at least one point included in the contour for each of the extracted contour, and associates the selected points between the images, derives three-dimensional coordinates of the associated points, derives a plane for approximating the object based on the derived three-dimensional coordinates of the points, and estimates depth values of unassociated points out of points on the contour based on the three-dimensional coordinates of the related points and the derived plane, to accurately estimate depth value of the object.

Abstract: An object region detection unit (130) decides the region of a physical object of interest in a physical space image. An image manipulation unit (140) performs shading processing of an inclusion region including the decided region. A rendering unit (155) arranges a virtual object in virtual space at the position and orientation of the physical object of interest and generates a virtual space image based on the position and orientation of the user's viewpoint. A composition unit (160) generates a composite image by superimposing the virtual space image on the physical space image that has undergone the shading processing and outputs the generated composite image to an HMD (190).

Abstract: A technique for reducing the time required before a tracking process is performed again in calculating the position and orientation of an image capturing apparatus or an object. Images captured by the apparatus are acquired, the acquired images are stored in order per frame, straight lines detected in the captured images and straight lines in a three-dimensional space model are matched, the position and orientation of the apparatus are initialized by obtaining correspondences having the highest consistency, a captured image to be processed is selected from the captured images, the change in position and orientation of the apparatus is measured using the change in position and orientation of a target object in the selected image based on the initialized position and orientation of the apparatus, and if the measured change in position and orientation is not within a predetermined threshold, initialization is performed using the selected image.

Abstract: An image processing apparatus includes a distance measuring unit configured to measure a distance from a target object and generate a distance image, a camera configured to acquire a captured image including the target object, a reliability calculating unit configured to calculate a reliability level with respect to a measurement value of the generated distance image based on the captured image and the distance image and generate a reliability image, and distance data correcting unit configured to generate a high reliability distance image using the reliability image and the distance image and generate a corrected distance image by interpolating or extrapolating the high reliability distance image up to a region including a contour line.

Abstract: In a method of calibrating an image capture environment based on a captured image obtained by capturing an image of a physical space by an image capturing unit that captures the image of the physical space, an image of the physical space is captured using the image capturing unit, an index serving as a reference for calibration is detected from the captured image of the physical space, the position and orientation of the image capturing unit are calculated from the detected index, and image capturing unit unique information, geometric information associated with the physical space, or the relationship between the image capturing unit and the physical space is calibrated using the obtained data.

Abstract: In a method of calibrating an image capture environment based on a captured image obtained by capturing an image of a physical space by an image capturing unit that captures the image of the physical space, an image of the physical space is captured using the image capturing unit, an index serving as a reference for calibration is detected from the captured image of the physical space, the position and orientation of the image capturing unit are calculated from the detected index, and image capturing unit unique information, geometric information associated with the physical space, or the relationship between the image capturing unit and the physical space is calibrated using the obtained data.

Abstract: For each image sensing device, an index in a sensed image is recognized, and layout information of the recognized index in a coordinate system based on an image sensing device that has acquired the sensed image is calculated. Index information including identification information unique to the index and the layout information of the index is managed. If recognition of a first index in a first sensed image acquired by a first image sensing device has failed, or the first index has erroneously been recognized, the index information of the first index is varied on the basis of the layout information of the first index calculated by the above process for a second sensed image acquired by a second image sensing device other than the first image sensing device.

Abstract: An image presentation system which enables a user observing an image on a first display to recognize an instruction sent from a person seeing an image on a second display to the user. An HMD as the first display detects the position and orientation of the HMD and presents an image to the user. The second display presents an image to the person who gives an instruction to the user. A three-dimensional CG drawing device draws a virtual space image seen from a point of view corresponding to the position and orientation of the HMD and displays the virtual space image on the HMD and the second display. When receiving the instruction, the three-dimensional CG drawing device draws a virtual space image to be displayed on the HMD such that the virtual space image reflects the input instruction.

Abstract: An information processing apparatus includes a region segmentation unit configured to segment each of a plurality of images shot by an imaging apparatus for shooting an object from a plurality of viewpoints, into a plurality of regions based on colors of the object, an attribute determination unit configured to determine, based on regions in proximity to intersections between scanning lines set on the each image and boundary lines of the regions segmented by the region segmentation unit in the each image, attributes of the intersections, a correspondence processing unit configured to obtain corresponding points between the images based on the determined intersections' attributes, and a three-dimensional position calculation unit configured to calculate a three-dimensional position of the object based on the obtained corresponding points.

Abstract: A marker arrangement information measuring apparatus includes an image acquiring unit configured to acquire a captured image, a marker detecting unit configured to detect markers from the captured image, a marker identifying unit configured to identify the marker detected by the marker detecting unit, an arrangement information calculating unit configured to calculate arrangement information of the marker based on an identification result of the marker identifying unit, an analyzing unit configured to analyze the identification result of the marker identifying unit, and a display unit configured to display an image corresponding to an analysis result of the analyzing unit on the captured image in a combined manner, thus presenting the analysis result to a user.

Abstract: In a method of calibrating an image capture environment based on a captured image obtained by capturing an image of a physical space by an image capturing unit that captures the image of the physical space, an image of the physical space is captured using the image capturing unit, an index serving as a reference for calibration is detected from the captured image of the physical space, the position and orientation of the image capturing unit are calculated from the detected index, and image capturing unit unique information, geometric information associated with the physical space, or the relationship between the image capturing unit and the physical space is calibrated using the obtained data.

Abstract: In a method of calibrating an image capture environment based on a captured image obtained by capturing an image of a physical space by an image capturing unit that captures the image of the physical space, an image of the physical space is captured using the image capturing unit, an index serving as a reference for calibration is detected from the captured image of the physical space, the position and orientation of the image capturing unit are calculated from the detected index, and image capturing unit unique information, geometric information associated with the physical space, or the relationship between the image capturing unit and the physical space is calibrated using the obtained data.

Abstract: A sensed image of the physical space is acquired by an image sensing apparatus. One or more indices are detected from the sensed image. The reliability of each of the detected results is determined by calculating a first reliability value based on the sensed image and a second reliability value based on orientation information of the image sensing apparatus. Each of the detected indices is then identified based on its first and second reliability values.

Abstract: Image exhibiting method of exhibiting an image of mixed reality space is provided. A three-dimensional visual-field area of an observer in the mixed reality space is calculated, a virtual visual-field object representing the visual-field area is generated, and the virtual visual-field object is superimposed on the image of the mixed reality space to be exhibited.

Abstract: A technique for reducing the time required before a tracking process is performed again in calculating the position and orientation of an image capturing apparatus or an object. Images captured by the apparatus are acquired, the acquired images are stored in order per frame, straight lines detected in the captured images and straight lines in a three-dimensional space model are matched, the position and orientation of the apparatus are initialized by obtaining correspondences having the highest consistency, a captured image to be processed is selected from the captured images, the change in position and orientation of the apparatus is measured using the change in position and orientation of a target object in the selected image based on the initialized position and orientation of the apparatus, and if the measured change in position and orientation is not within a predetermined threshold, initialization is performed using the selected image.

Abstract: The orientation of each index is estimated from a sensed image, and the index detected from the image is identified based on the orientation of an image sensing device and that of the index estimated from known coordinate information of the index. In this way, indices which are located at nearby positions but have different orientations are never misidentified, and can be stably identified. Indices can be stably identified from the sensed image in which indices located in the physical space appear.

Abstract: An information processing device, for aiding operations relating to position and orientation of a virtual object positioned in three-dimensional space, comprises: an image-taking unit for taking images in real space in order to display the virtual object in a superimposed manner on real space; a synthesizing unit for synthesizing a virtual object with the taken image; an operating unit for operating the position and orientation of the virtual object; an aiding unit for obtaining a three-dimensional position of real space from external instructions, and obtaining a constraining shape for aiding in operations for the position and orientation of the virtual object; wherein the position and orientation of the virtual object are operated by instructions from the operating unit, based on constraint conditions based on the constraining shape obtained by the aiding unit.