Abstract: An object region detection unit (130) decides the region of a physical object of interest in a physical space image. An image manipulation unit (140) performs shading processing of an inclusion region including the decided region. A rendering unit (155) arranges a virtual object in virtual space at the position and orientation of the physical object of interest and generates a virtual space image based on the position and orientation of the user's viewpoint. A composition unit (160) generates a composite image by superimposing the virtual space image on the physical space image that has undergone the shading processing and outputs the generated composite image to an HMD (190).

Abstract: To provide a technique capable of reducing the transmission delay of an image, a communication apparatus wirelessly communicable with another communication apparatus, receives a compressed captured image from the other communication apparatus; decompresses the compressed captured image to obtain a decompressed captured image; generates, based on the decompressed captured image, a CG image to be superimposed and displayed on the captured image; and compresses the CG image to generate a compressed CG image; transmits the compressed CG image to the other communication apparatus. Then, the communication apparatus derives a delay time based on a transmission time of the compressed captured image in the other communication apparatus and a generation completion time of the CG image; and changes a compression ratio of the CG image based on whether the delay time is longer than a predetermined threshold.

Abstract: An information processing apparatus includes a first identification unit that identifies an input device to be used to execute a task, the input device lying in a field of view range of a user wearing a display device, a second identification unit that identifies an operation medium with which the user operates the input device, the operation medium lying in the field of view range of the user, a determination unit that determines processing to be executed based on the identified input device and the identified operation medium, and a display control unit that causes the display device to display an image corresponding to the determined processing.

Abstract: A display obtains a first image by image capturing, receives, from an external apparatus, a second image generated based on the first image, determines a communication quality with the external apparatus in reception of the second image, and controls to display the second image on a display unit until a value indicating a degree of degradation of the communication quality exceeds a first threshold as a result of determination, and display the first image on the display unit when the value indicating the degree of degradation of the communication quality exceeds the first threshold. The display controls to display the first image until the value indicating the degree of degradation of the communication quality becomes smaller than a second threshold smaller than the first threshold after exceeding the first threshold.

Abstract: A warning information output outputs warning information for a user, based on a position of the user and a position of a real object with which data is associated in a case where a first attribute indicates outputting of the warning information for the user. An image output outputs an image to be generated, in a case where a second attribute indicates drawing of a virtual object in accordance with the position of the real object and a position at which the virtual object to be viewed by the user is arranged, by not drawing the virtual object in a region in which the position of the real object with which the data is associated is closer to the position of the user than the position at which the virtual object is arranged.

Abstract: An information processing apparatus extracts, from each of images of an object captured from a plurality of viewpoints, a contour of the object, selects at least one point included in the contour for each of the extracted contour, and associates the selected points between the images, derives three-dimensional coordinates of the associated points, derives a plane for approximating the object based on the derived three-dimensional coordinates of the points, and estimates depth values of unassociated points out of points on the contour based on the three-dimensional coordinates of the related points and the derived plane, to accurately estimate depth value of the object.

Abstract: An image processing apparatus obtains location information of each image feature in a captured image based on image coordinates of the image feature in the captured image. The image processing apparatus selects location information usable to calculate a position and an orientation of the imaging apparatus among the obtained location information. The image processing apparatus obtains the position and the orientation of the imaging apparatus based on the selected location information and an image feature corresponding to the selected location information among the image features included in the captured image.

Abstract: In order to easily and rapidly determine a subject region in a captured image using a single image, a synthesized image of an extraction image including a subject and an instruction image representing a first acquisition region from which color information on the subject is acquired is used. Color information on the subject is acquired from the first acquisition region represented by the instruction image in the synthesized image. Color information on a background of the subject is acquired from a region not including the first acquisition region and a color information non-acquisition region that is adjacent to the first acquisition region and is set in advance in the synthesized image. On the basis of the color information on the subject and the color information on the background, extraction information of the subject is determined and output.

Abstract: An information processing apparatus includes a first identification unit that identifies an input device to be used to execute a task, the input device lying in a field of view range of a user wearing a display device, a second identification unit that identifies an operation medium with which the user operates the input device, the operation medium lying in the field of view range of the user, a determination unit that determines processing to be executed based on the identified input device and the identified operation medium, and a display control unit that causes the display device to display an image corresponding to the determined processing.

Abstract: An information processing apparatus includes an image obtaining unit that obtains an image captured by an image capturing apparatus. An index detection unit detects index information from the image. A measurement value obtaining unit obtains a measurement value measured by a sensor. A determination unit determines a suitability of calibration data for the sensor, which includes the index information and the measurement value, based on the index information and the measurement value. A presentation unit presents the suitability.

Abstract: The apparatus draws virtual objects as an image from a predetermined point of view, determines whether the virtual objects interfere with each other, calculates the region of interference of the virtual objects determined as interfering with each other, and outputs an image in which the region of interference located behind of the virtual objects as seen from the point of view is drawn.

Abstract: An apparatus includes an image acquisition unit configured to acquire a captured image of a real space, a position and orientation acquisition unit configured to acquire a position and orientation of each of a plurality of virtual objects, an interference determination unit configured to determine whether interference is present between the virtual objects based on the position and orientation of each of the plurality of virtual objects and model data of the plurality of virtual objects, an interference information recording unit configured to record an outline of an interference part where the virtual objects interfere with each other as interference information, based on a result of the interference determination unit, a generation unit configured to generate a composite image including the captured image, an image of the plurality of virtual objects, and an image representing the outline of the interference part.

Abstract: To provide a technique capable of reducing the transmission delay of an image, a communication apparatus wirelessly communicable with another communication apparatus, receives a compressed captured image from the other communication apparatus; decompresses the compressed captured image to obtain a decompressed captured image; generates, based on the decompressed captured image, a CG image to be superimposed and displayed on the captured image; and compresses the CG image to generate a compressed CG image; transmits the compressed CG image to the other communication apparatus. Then, the communication apparatus derives a delay time based on a transmission time of the compressed captured image in the other communication apparatus and a generation completion time of the CG image; and changes a compression ratio of the CG image based on whether the delay time is longer than a predetermined threshold.

Abstract: In a method of calibrating an image capture environment based on a captured image obtained by capturing an image of a physical space by an image capturing unit that captures the image of the physical space, an image of the physical space is captured using the image capturing unit, an index serving as a reference for calibration is detected from the captured image of the physical space, the position and orientation of the image capturing unit are calculated from the detected index, and image capturing unit unique information, geometric information associated with the physical space, or the relationship between the image capturing unit and the physical space is calibrated using the obtained data.

Abstract: An information processing apparatus includes a region segmentation unit configured to segment each of a plurality of images shot by an imaging apparatus for shooting an object from a plurality of viewpoints, into a plurality of regions based on colors of the object, an attribute determination unit configured to determine, based on regions in proximity to intersections between scanning lines set on the each image and boundary lines of the regions segmented by the region segmentation unit in the each image, attributes of the intersections, a correspondence processing unit configured to obtain corresponding points between the images based on the determined intersections' attributes, and a three-dimensional position calculation unit configured to calculate a three-dimensional position of the object based on the obtained corresponding points.

Abstract: A warning information output outputs warning information for a user, based on a position of the user and a position of a real object with which data is associated in a case where a first attribute indicates outputting of the warning information for the user. An image output outputs an image to be generated, in a case where a second attribute indicates drawing of a virtual object in accordance with the position of the real object and a position at which the virtual object to be viewed by the user is arranged, by not drawing the virtual object in a region in which the position of the real object with which the data is associated is closer to the position of the user than the position at which the virtual object is arranged.

Abstract: A display obtains a first image by image capturing, receives, from an external apparatus, a second image generated based on the first image, determines a communication quality with the external apparatus in reception of the second image, and controls to display the second image on a display unit until a value indicating a degree of degradation of the communication quality exceeds a first threshold as a result of determination, and display the first image on the display unit when the value indicating the degree of degradation of the communication quality exceeds the first threshold. The display controls to display the first image until the value indicating the degree of degradation of the communication quality becomes smaller than a second threshold smaller than the first threshold after exceeding the first threshold.

Abstract: An image processing system includes an image processing apparatus that is wearable by a user and is configured to capture real space and display real space video. The system generates mixed reality video obtained by superimposing virtual object video on the real space video; identifies a display area of a real object that is included in the real space video; measures a distance between the image processing apparatus and the real object. In addition, the system performs notification for causing a user who is wearing the image processing apparatus to recognize existence of the real object, if the display area of the real object is hidden by the virtual object video, and the distance between the image processing apparatus and the real object is less than a predetermined distance.

Abstract: In order to easily and rapidly determine a subject region in a captured image using a single image, a synthesized image of an extraction image including a subject and an instruction image representing a first acquisition region from which color information on the subject is acquired is used. Color information on the subject is acquired from the first acquisition region represented by the instruction image in the synthesized image. Color information on a background of the subject is acquired from a region not including the first acquisition region and a color information non-acquisition region that is adjacent to the first acquisition region and is set in advance in the synthesized image. On the basis of the color information on the subject and the color information on the background, extraction information of the subject is determined and output.

Abstract: An image processing apparatus obtains location information of each image feature in a captured image based on image coordinates of the image feature in the captured image. The image processing apparatus selects location information usable to calculate a position and an orientation of the imaging apparatus among the obtained location information. The image processing apparatus obtains the position and the orientation of the imaging apparatus based on the selected location information and an image feature corresponding to the selected location information among the image features included in the captured image.