Abstract: In position and orientation measurement based on natural features, erroneous detection of the natural features is prevented when an observation target object is occluded by another object, and registration stability is improved. To this end, an occluding object that can occlude the observation target object is defined, and an occluding region where the occluding object occludes the observation target object is detected in an input captured image. Image features of the observation target object are detected in a region of the captured image other than the detected occluding region. Therefore, the position or orientation of an image pickup apparatus that captured the captured image, or the position or orientation of the observation target object in the captured image are calculated.

Abstract: Indices in an image of a physical space on which a plurality of indices are allocated are identified, and the positions and orientations, on the physical space, of all or some identified indices are calculated.

Abstract: The first values of position and orientation of an image sensing device are obtained by using positions of all indices in a frame image. Indices having the same inherent information between a first index group (FIG) in the frame image and a second index group (SIG) in a preceding frame image are detected as a common index. If the information of the SIG contains information different from that of the FIG, second values of the position and orientation are obtained by using the positions of the common indices in the preceding frame image. If the information of the FIG contains information different from that of the SIG, third values of the position and orientation are obtained by using the positions of the common indices in the frame image. The first values are corrected by using correction values based on the obtained first to third values.

Abstract: When a calibration jig (50) which includes an image sensing device (100) is moved within the image sensing range of an image sensing device (200), the image coordinates of an index (110) on the image sensing device (100) in a plurality of images sensed by the image sensing device (200) are extracted. The image coordinates of environment allocation indices (300) in a plurality of images sensed by the image sensing device (100) are extracted. An information processing apparatus (1000) calculates camera parameters of the image sensing device (200) based on the extracted image coordinates of the index (110) and the environment allocation indices (300).

Abstract: An index layout measurement method and apparatus measures a relative layout relationship between a first index or index group which exists in a given first region in a physical space and a second index or index group which exists in a second region.

Abstract: An information processing method includes the steps of acquiring a sense image of an image sensing unit, acquiring coordinate values of registered indices, detecting image positions of the registered indices in the sense image, and calculating position and orientation of the image sensing unit on the basis of the detected image positions of the registered indices and the coordinate values of the registered indices. Additional steps include detecting an image position of an additional index in the sense image in accordance with a user's instruction, calculating a coordinate value of the additional index using the image positions of the registered indices, the coordinate values of the registered indices, the position and orientation of the image sensing unit, and the image position of the additional index, and registering the calculated coordinate value of the additional index as a registered index.

Abstract: In position and orientation measurement based on natural features, erroneous detection of the natural features is prevented when an observation target object is occluded by another object, and registration stability is improved. To this end, an occluding object that can occlude the observation target object is defined, and an occluding region where the occluding object occludes the observation target object is detected in an input captured image. Image features of the observation target object are detected in a region of the captured image other than the detected occluding region. Therefore, the position or orientation of an image pickup apparatus that captured the captured image, or the position or orientation of the observation target object in the captured image are calculated.

Abstract: When a calibration jig (50) which includes an image sensing device (100) is moved within the image sensing range of an image sensing device (200), the image coordinates of an index (110) on the image sensing device (100) in a plurality of images sensed by the image sensing device (200) are extracted. The image coordinates of environment allocation indices (300) in a plurality of images sensed by the image sensing device (100) are extracted. An information processing apparatus (1000) calculates camera parameters of the image sensing device (200) based on the extracted image coordinates of the index (110) and the environment allocation indices (300).

Abstract: Indices in an image of a physical space on which a plurality of indices are allocated are identified, and the positions and orientations, on the physical space, of all or some identified indices are calculated (S142).

Abstract: The first values of position and orientation of an image sensing device are obtained by using positions of all indices in a frame image. Indices having the same inherent information between a first index group (FIG) in the frame image and a second index group (SIG) in a preceding frame image are detected as a common index. If the information of the SIG contains information different from that of the FIG, second values of the position and orientation are obtained by using the positions of the common indices in the preceding frame image. If the information of the FIG contains information different from that of the SIG, third values of the position and orientation are obtained by using the positions of the common indices in the frame image. The first values are corrected by using correction values based on the obtained first to third values.

Abstract: The layout relationship between indices included in a first image and those included in a second image are calculated using the layout relationship between a common index commonly included in the first and second images, and the indices included in the first image, and that between the common index and the indices included in the second image.

Abstract: When the user designates an additional marker using an operation input unit in a sense image of the physical world sensed by an image sensing unit, a marker extraction/management unit calculates the world coordinates of the additional marker using known marker group information in the sense image, and registers and manages the world coordinates as new known marker group information.