Abstract: a processing system comprises a plurality of image capturing units configured to capture a space including an object and configured to be used for generating a virtual viewpoint image representing a view from a virtual viewpoint; and a presenting unit configured to perform presentation for determining an orientation of the object in the space.

Abstract: An information processing apparatus is provided. A three-dimensional model of an object, which has been obtained by capturing an image of the object in an imaging area from a plurality of positions, and information indicating a position of the object with respect to the imaging area are obtained. A virtual viewpoint image that includes the object is generated based on the three-dimensional model of the object through performing correction that accords with a position of the object, on the object in the virtual viewpoint image.

Abstract: An information processing apparatus, which transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, obtains an image based on image capturing by an image capturing apparatus, obtains camera viewpoint information about at least one of a position and orientation of the image capturing apparatus, obtains virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint, reduces an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information, and transmits the image with the reduced information amount to the image processing apparatus.

Abstract: An information processing apparatus includes: a first obtaining unit configured to obtain a first three-dimensional model expressing a position and a shape of a first object in a three-dimensional space based on images of the first object captured by a plurality of image-capturing devices at different locations; a second obtaining unit configured to obtain a second three-dimensional model expressing a position and a shape of a second object in the three-dimensional space; an identifying unit configured to identify a plurality of parts of the first object; a determining unit configured to determine a contact between a certain part of the first object and the second object based on the obtained first three-dimensional model and second three-dimensional model and an identification result of the plurality of parts; and an output unit configured to output information according to a determination result of the contact.

Abstract: The technique of this disclosure suppresses a reduction in visibility of a predetermined object in virtual viewpoint image data. An image processing apparatus includes: an image capturing information acquisition unit configured to acquire image capturing information indicating a position and orientation of each of a plurality of image capturing apparatuses; an object information acquisition unit configured to acquire object information indicating a position and orientation of an object to be captured by the image capturing apparatuses, the object having a specific viewing angle; and a determination unit configured to determine, based on the acquired image capturing information and the position and orientation of the object indicated by the acquired object information, an image to be used for generating a virtual viewpoint image according to a position and orientation of a virtual viewpoint among a plurality of images based on capturing by the image capturing apparatuses.

Abstract: An image processing apparatus in an embodiment of the present disclosure includes: an obtaining unit configured to obtain viewpoint information indicating a change over time in a viewpoint corresponding to a virtual image; and a generation unit configured to generate the virtual image from the viewpoint according to the viewpoint information obtained by the obtaining unit such that among a plurality of objects included in the generated virtual image, an object whose position in the virtual image changes by a first amount according to the change of the viewpoint indicated by the viewpoint information is lower in clearness than an object whose position in the virtual image changes by a second amount smaller than the first amount according to the change of the viewpoint.

Abstract: The technique of this disclosure suppresses a reduction in visibility of a predetermined object in virtual viewpoint image data. An image processing apparatus includes: an image capturing information acquisition unit configured to acquire image capturing information indicating a position and orientation of each of a plurality of image capturing apparatuses; an object information acquisition unit configured to acquire object information indicating a position and orientation of an object to be captured by the image capturing apparatuses, the object having a specific viewing angle; and a determination unit configured to determine, based on the acquired image capturing information and the position and orientation of the object indicated by the acquired object information, an image to be used for generating a virtual viewpoint image according to a position and orientation of a virtual viewpoint among a plurality of images based on capturing by the image capturing apparatuses.

Abstract: a processing system comprises a plurality of image capturing units configured to capture a space including an object and configured to be used for generating a virtual viewpoint image representing a view from a virtual viewpoint; and a presenting unit configured to perform presentation for determining an orientation of the object in the space.

Abstract: An image processing apparatus for generating a virtual viewpoint image based on a plurality of images obtained by capturing an object in an image-capturing region from a plurality of directions by using a plurality of image capturing apparatuses includes a viewpoint acquisition unit configured to acquire viewpoint information indicating a position of a virtual viewpoint, and a generation unit configured to generate the virtual viewpoint image corresponding to the position of the virtual viewpoint indicated by the acquired viewpoint information, the virtual viewpoint image including at least one of an image depending on a positional relationship between a boundary and the virtual viewpoint and/or an image representing the boundary, the boundary being between an inside and an outside of a predetermined region included in the image-capturing region.

Abstract: An information processing apparatus, which transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, obtains an image based on image capturing by an image capturing apparatus, obtains camera viewpoint information about at least one of a position and orientation of the image capturing apparatus, obtains virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint, reduces an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information, and transmits the image with the reduced information amount to the image processing apparatus.

Abstract: An information processing apparatus obtains object information representing a position and a shape of an object in an image capturing region of which image is captured from different directions by a plurality of image capturing apparatuses, discriminates between a visible region that can be seen from a specific position in the image capturing region and an occluded region that cannot be seen from the specific position due to occlusion by the object based on the object information, and generates a virtual viewpoint image that displays information based on a result of the discrimination, the virtual viewpoint image being based on image data based on image capturing by the plurality of image capturing apparatuses and virtual viewpoint information indicating a position and a direction of a virtual viewpoint.

Abstract: An information processing apparatus includes: a first obtaining unit configured to obtain a first three-dimensional model expressing a position and a shape of a first object in a three-dimensional space based on images of the first object captured by a plurality of image-capturing devices at different locations; a second obtaining unit configured to obtain a second three-dimensional model expressing a position and a shape of a second object in the three-dimensional space; an identifying unit configured to identify a plurality of parts of the first object; a determining unit configured to determine a contact between a certain part of the first object and the second object based on the obtained first three-dimensional model and second three-dimensional model and an identification result of the plurality of parts; and an output unit configured to output information according to a determination result of the contact.

Abstract: The technique of this disclosure suppresses a reduction in visibility of a predetermined object in virtual viewpoint image data. An image processing apparatus includes: an image capturing information acquisition unit configured to acquire image capturing information indicating a position and orientation of each of a plurality of image capturing apparatuses; an object information acquisition unit configured to acquire object information indicating a position and orientation of an object to be captured by the image capturing apparatuses, the object having a specific viewing angle; and a determination unit configured to determine, based on the acquired image capturing information and the position and orientation of the object indicated by the acquired object information, an image to be used for generating a virtual viewpoint image according to a position and orientation of a virtual viewpoint among a plurality of images based on capturing by the image capturing apparatuses.

Abstract: An information processing apparatus, which transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, obtains an image based on image capturing by an image capturing apparatus, obtains camera viewpoint information about at least one of a position and orientation of the image capturing apparatus, obtains virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint, reduces an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information, and transmits the image with the reduced information amount to the image processing apparatus.

Abstract: An image processing apparatus for generating a virtual viewpoint image based on a plurality of images obtained by capturing an object in an image-capturing region from a plurality of directions by using a plurality of image capturing apparatuses includes a viewpoint acquisition unit configured to acquire viewpoint information indicating a position of a virtual viewpoint, and a generation unit configured to generate the virtual viewpoint image corresponding to the position of the virtual viewpoint indicated by the acquired viewpoint information, the virtual viewpoint image including at least one of an image depending on a positional relationship between a boundary and the virtual viewpoint and/or an image representing the boundary, the boundary being between an inside and an outside of a predetermined region included in the image-capturing region.

Abstract: An information processing apparatus, which transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, obtains an image based on image capturing by an image capturing apparatus, obtains camera viewpoint information about at least one of a position and orientation of the image capturing apparatus, obtains virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint, reduces an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information, and transmits the image with the reduced information amount to the image processing apparatus.

Abstract: An image processing apparatus in an embodiment of the present disclosure includes: an obtaining unit configured to obtain viewpoint information indicating a change over time in a viewpoint corresponding to a virtual image; and a generation unit configured to generate the virtual image from the viewpoint according to the viewpoint information obtained by the obtaining unit such that among a plurality of objects included in the generated virtual image, an object whose position in the virtual image changes by a first amount according to the change of the viewpoint indicated by the viewpoint information is lower in clearness than an object whose position in the virtual image changes by a second amount smaller than the first amount according to the change of the viewpoint.

Abstract: An information processing apparatus comprising: a marker detection unit configured to detect one or more markers from an image obtained by capturing a physical space by an image capturing unit; a feature detection unit configured to detect a feature from the image; an estimation unit configured to estimate a position and orientation of the image capturing unit based on a detection result obtained by the marker detection unit and a detection result obtained by the feature detection unit; a stability obtaining unit configured to obtain stability of estimation of the position and orientation when some markers of the one or more markers are removed; and a determination unit configured to determine, based on the stability, whether the some markers are removable.

Abstract: An information processing apparatus, which transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, obtains an image based on image capturing by an image capturing apparatus, obtains camera viewpoint information about at least one of a position and orientation of the image capturing apparatus, obtains virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint, reduces an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information, and transmits the image with the reduced information amount to the image processing apparatus.

Abstract: An information processing apparatus comprising: a marker detection unit configured to detect one or more markers from an image obtained by capturing a physical space by an image capturing unit; a feature detection unit configured to detect a feature from the image; an estimation unit configured to estimate a position and orientation of the image capturing unit based on a detection result obtained by the marker detection unit and a detection result obtained by the feature detection unit; a stability obtaining unit configured to obtain stability of estimation of the position and orientation when some markers of the one or more markers are removed; and a determination unit configured to determine, based on the stability, whether the some markers are removable.