Abstract: An image processing apparatus includes one or more memories storing instructions, and one or more processors executing the instructions to obtain three-dimensional shape data of at least one object, wherein the three-dimensional shape data is generated using images of the at least one object captured from a plurality of directions by a plurality of image capturing units, extract a plurality of parts of the obtained three-dimensional shape data, assign identifiers to the extracted plurality of parts based on positions of the extracted plurality of parts, and track the extracted plurality of parts based on the identifiers and the positions of the extracted plurality of parts.

Abstract: An information processing apparatus 100 includes an acquisition unit 105 configured to acquire material data that is to be used for generation of a virtual viewpoint image that is based on a plurality of captured images obtained by a plurality of cameras 101 performing image capturing of a subject, and is material data represented by a first format, a conversion unit 107 configured to convert, based on information for identifying a format of material data processable by a different apparatus being an output destination of the material data, a format of the acquired material data from the first format into a second format, and a transmission/reception unit 108 configured to output the material data converted into the second format, to the different apparatus.

Abstract: An information processing apparatus identifies a sub region of an object, displayed in a virtual viewpoint image representing a view from a virtual viewpoint, based on virtual viewpoint information, and outputs division model data corresponding to the identified sub region out of foreground model data.

Abstract: An information processing apparatus includes a management unit configured to acquire a plurality of material data for use in generation of a virtual viewpoint image based on a plurality of images captured with a plurality of cameras by imaging an object, the plurality of material data including first material data and second material data different from the first material data, and a transmission/reception unit configured to output, to a device, material data that has been selected from among the plurality of acquired material data based on information for identifying a format of material data processable by the device.

Abstract: A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated file.

Abstract: An information processing apparatus that provides information about a virtual viewpoint image includes: a generation unit configured to generate scene information including type information and time information, the type information indicating a type of an event occurring in an image-capturing region in which an image is captured by a plurality of cameras, the time information indicating a time when the event has occurred; and a provision unit configured to provide an output destination of material data with the scene information generated by the generation unit, the material data being generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions, the material data being used to generate the virtual viewpoint image depending on a position and an orientation of a virtual viewpoint.

Abstract: A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated file.

Abstract: An information processing apparatus includes one or more memories storing instructions and one or more processors executing the instructions to acquire viewpoint information representing a position of a virtual viewpoint and a line-of-sight direction from the virtual viewpoint used for generating a virtual viewpoint image based on a plurality of captured images obtained by imaging performed by a plurality of imaging apparatuses, output a plurality of pieces of acquired viewpoint information to a first generation unit configured to generate a plurality of virtual viewpoint images based on a condition of first quality according to viewpoint information, and output one or more pieces of viewpoint information selected from among the plurality of pieces of acquired viewpoint information to a second generation unit configured to generate a virtual viewpoint image based on a condition of second quality higher than the first quality according to the viewpoint information.

Abstract: To make it possible to obtain a natural image in which a foreground object included in a two-dimensional image and a background object included in a three-dimensional computer graphics space are in harmony with each other. A two-dimensional image, corresponding to a specific viewpoint, including a foreground object, a parameter specifying a condition at the time of obtaining the two-dimensional image, and position and shape data representing a three-dimensional position and a shape of the foreground object included in the two-dimensional image are obtained. Then, an image including the foreground object and a background object is generated by arranging a screen based on the position and shape data in a computer graphics space including the background object and projecting the image of the foreground object included in the two-dimensional image.

Abstract: An image processing apparatus for generating a virtual viewpoint image that acquires a parameter for identifying a position and orientation of a first imaging device, acquires three-dimensional shape data of an object that is generated based on a plurality of images acquired by a plurality of second imaging devices different from the first imaging device, and corrects a pixel value of a pixel included in a region corresponding to the object in an image acquired by the first imaging device, based on the position and orientation of the first imaging device identified based on the acquired parameter and the acquired three-dimensional shape data of the object.

Abstract: The present disclosure allows for generating a virtual viewpoint image matching an object's sight. To achieve this, an image processing apparatus comprises one or more memories storing instructions; and one or more processors executing the instructions to: obtain a plurality of images captured by a plurality of image capturing devices while a symbol representing a position at which an object should direct a look is being displayed; and generate a virtual viewpoint image in accordance with a position of a virtual viewpoint and a view direction from the virtual viewpoint, the position of the virtual viewpoint being a position at which the symbol is displayed, and the view direction from the virtual viewpoint being a direction specified based on the position of the virtual viewpoint and a position of the object.

Abstract: A generation apparatus includes following units. A first acquisition unit acquires a first virtual viewpoint image generated based on a plurality of images captured by a plurality of image capturing apparatuses, and a first virtual viewpoint in a three-dimensional space including an image capturing space captured by the plurality of image capturing apparatuses. A second acquisition unit acquires a second virtual viewpoint image generated based on the plurality of captured images, and a second virtual viewpoint arranged with respect to a predetermined surface in the three-dimensional space and the first virtual viewpoint. A generation unit generates a third virtual viewpoint image corresponding to the first virtual viewpoint and including an image indicating a state where an object in the image capturing space is reflected on the predetermined surface, based on the first virtual viewpoint image, and the second virtual viewpoint image.

Abstract: There is provided a medical support device for holding and positioning a needle. This device is particularly useful for positioning needles in a less invasive puncture treatment. This device comprises two rotational elements and at least one needle guide attached to a rotational element and. The needle guide guides the direction of insertion of a needle-like instrument and includes a guide portion that guides a needle or other needle-like instrument where the puncture point of the needle in a first position is different from the puncture point when the needle guide guides the needle in a second position.

Abstract: An information processing apparatus specifies that material data for generating a virtual-viewpoint content at what time is stored in a storage device that stores a plurality of material data for generating a virtual-viewpoint content; and outputs, based on a result of the specification, information for causing an image to be displayed, the image indicating a time at which a virtual-viewpoint content can be generated.

Abstract: An image processing apparatus acquires a parameter for identifying a position and orientation of a first imaging device, acquires three-dimensional shape data of an object that is generated based on a plurality of images acquired by a plurality of second imaging devices different from the first imaging device, and corrects a pixel value of a pixel included in a region corresponding to the object in an image acquired by the first imaging device, based on the position and orientation of the first imaging device identified based on the acquired parameter and the acquired three-dimensional shape data of the object.

Abstract: An information processing apparatus that provides information about a virtual viewpoint image includes: a generation unit configured to generate scene information including type information and time information, the type information indicating a type of an event occurring in an image-capturing region in which an image is captured by a plurality of cameras, the time information indicating a time when the event has occurred; and a provision unit configured to provide an output destination of material data with the scene information generated by the generation unit, the material data being generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions, the material data being used to generate the virtual viewpoint image depending on a position and an orientation of a virtual viewpoint.

Abstract: A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated life.

Abstract: An information processing apparatus that provides information about a virtual viewpoint image includes: a generation unit configured to generate scene information including type information and time information, the type information indicating a type of an event occurring in an image-capturing region in which an image is captured by a plurality of cameras, the time information indicating a time when the event has occurred; and a provision unit configured to provide an output destination of material data with the scene information generated by the generation unit, the material data being generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions, the material data being used to generate the virtual viewpoint image depending on a position and an orientation of a virtual viewpoint.

Abstract: An information processing apparatus specifies that material data for generating a virtual-viewpoint content at what time is stored in a storage device that stores a plurality of material data for generating a virtual-viewpoint content; and outputs, based on a result of the specification, information for causing an image to be displayed, the image indicating a time at which a virtual-viewpoint content can be generated.

Abstract: An information processing apparatus specifies that material data for generating a virtual-viewpoint content at what time is stored in a storage device that stores a plurality of material data for generating a virtual-viewpoint content; and outputs, based on a result of the specification, information for causing an image to be displayed, the image indicating a time at which a virtual-viewpoint content can be generated.