Abstract: A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated file.

Abstract: It has been difficult to provide attractive digital content including a virtual point of view image and other images. The present disclosure is directed to providing an image processing system for providing a technique for displaying attractive digital content including a virtual point of view image and other images. Attractive digital content including a virtual point of view image and other images is displayed. The image processing system identifies a virtual point of view image and an image from a point of view different from a virtual point of view corresponding to the virtual point of view image from digital content of three-dimensional shape, and controls display of images corresponding to the virtual point of view image and the image from the point of view different from the virtual point of view corresponding to the virtual point of view image in a display area.

Abstract: An image processing apparatus extracts a foreground image corresponding to an object included in a processing image using a background image corresponding to the processing image, and generates the background image from the processing image. The image processing apparatus determines whether it is allowed to update the background image for use in the extraction, and based on a result of the determination, updates the background image for use in the extraction using the generated background image.

Abstract: A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated file.

Abstract: An image processing apparatus extracts a foreground image corresponding to an object included in a processing image using a background image corresponding to the processing image, and generates the background image from the processing image. The image processing apparatus determines whether it is allowed to update the background image for use in the extraction, and based on a result of the determination, updates the background image for use in the extraction using the generated background image.

Abstract: The present invention provides a user with a user interface for enabling the user to efficiently perform an operation for generating a virtual viewpoint image for each imaging target subject to be imaged by a plurality of imaging apparatuses. An event information acquisition unit acquires information about an event subjected to virtual viewpoint image generation, and transmits the acquired event information to a user interface (UI) determination unit. The UI determination unit determines a UI to be generated by a UI generation unit based on the event information transmitted from the event information acquisition unit. The UI generation unit generates the UI determined by the UI determination unit. The user performs an input operation for generating a virtual viewpoint image according to the UI generated by the UI generation unit.

Abstract: An object is to appropriately determine a color of a three-dimensional model of an object. In an image processing apparatus, based on the analysis of the three-dimensional model of the object, the determination method of a color for the portion, which corresponds to the object shape of the component constituting the three-dimensional model, is made different from that for the portion, which does not correspond to the object shape.

Abstract: An image processing apparatus generates, based on an input image, region information indicating a region including an object, determines, based on the region information, a region including an object to be transmitted, and transmits, based on the region information indicating the determined region, an image of the object and region information indicating the determined region.

Abstract: The technology disclosed herein is an information processing apparatus comprising: one or more memories storing instructions; and one or more processors executing the instructions to function as: an obtaining unit configured to obtain information for specifying a position of an object included in multi-viewpoint image data obtained by image capturing using a plurality of imaging apparatuses; and a generation unit configured to generate a virtual viewpoint path data to generate virtual viewpoint image data by inputting the information obtained by the obtaining unit to an output unit which is a learned model learned from the virtual viewpoint path data to be training data and at least information for specifying a position of an object to be input data corresponding to the virtual viewpoint path data and is configured to output virtual viewpoint data by receiving input of information for specifying a position of an object.

Abstract: A material generation apparatus includes an acquisition unit configured to acquire a plurality of camera images, and a material data generation unit configured to generate, based on a camera image selected from among the camera images, at least one of a foreground image and a background image as material data to be used for generation of an image corresponding to a designated viewpoint.

Abstract: A file-processing apparatus 20 acquires (S104) access information that is used for requesting material data for generating a virtual viewpoint image that is generated based on a virtual viewpoint and captured images acquired from a plurality of imaging apparatuses, generates (S107) a virtual viewpoint image file that contains the acquired access information and a virtual viewpoint image data corresponding to the virtual viewpoint image, and outputs (S108) the generated virtual viewpoint image file.

Abstract: The present invention provides an information provision system that provides a user with information for coping with a problem by using an information terminal having a camera and a display, wherein the information terminal includes at least one processor with a memory comprising instructions cause the at least one processor to at least: identify a problem area in a captured image obtained by the camera; and display, on the display, a plurality of procedure screens indicating contents of a procedure for coping with the identified problem area, in accordance with an answer from the user, the plurality of procedure screens include a first procedure screen on which a plurality of answer items selectable by the user are displayed.

Abstract: In an image processing apparatus, three-dimensional shape data indicating a shape of an object is generated based on at least one of a plurality of images captured from different directions by a plurality image capturing devices. Color information indicating a color of each element of the three-dimensional shape data is generated based on the generated three-dimensional shape data and the plurality of images. The three-dimensional shape data and the color information are associated with each other and written to a storage unit as material data for generating a virtual viewpoint image corresponding to virtual viewpoint information indicating a virtual viewpoint.

Abstract: In an image processing apparatus, three-dimensional shape data indicating a shape of an object is generated based on at least one of a plurality of images captured from different directions by a plurality image capturing devices. Color information indicating a color of each element of the three-dimensional shape data is generated based on the generated three-dimensional shape data and the plurality of images. The three-dimensional shape data and the color information are associated with each other and written to a storage unit as material data for generating a virtual viewpoint image corresponding to virtual viewpoint information indicating a virtual viewpoint.

Abstract: An image processing apparatus extracts a foreground image corresponding to an object included in a processing image using a background image corresponding to the processing image, and generates the background image from the processing image. The image processing apparatus determines whether it is allowed to update the background image for use in the extraction, and based on a result of the determination, updates the background image for use in the extraction using the generated background image.

Abstract: The technology disclosed herein is an information processing apparatus comprising: one or more memories storing instructions; and one or more processors executing the instructions to function as: an obtaining unit configured to obtain information for specifying a position of an object included in multi-viewpoint image data obtained by image capturing using a plurality of imaging apparatuses; and a generation unit configured to generate a virtual viewpoint path data to generate virtual viewpoint image data by inputting the information obtained by the obtaining unit to an output unit which is a learned model learned from the virtual viewpoint path data to be training data and at least information for specifying a position of an object to be input data corresponding to the virtual viewpoint path data and is configured to output virtual viewpoint data by receiving input of information for specifying a position of an object.

Abstract: A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated life.

Abstract: A file-processing apparatus 20 acquires (S104) access information that is used for requesting material data for generating a virtual viewpoint image that is generated based on a virtual viewpoint and captured images acquired from a plurality of imaging apparatuses, generates (S107) a virtual viewpoint image file that contains the acquired access information and a virtual viewpoint image data corresponding to the virtual viewpoint image, and outputs (S108) the generated virtual viewpoint image file.

Abstract: The present invention provides a user with a user interface for enabling the user to efficiently perform an operation for generating a virtual viewpoint image for each imaging target subject to be imaged by a plurality of imaging apparatuses. An event information acquisition unit acquires information about an event subjected to virtual viewpoint image generation, and transmits the acquired event information to a user interface (UI) determination unit. The UI determination unit determines a UI to be generated by a UI generation unit based on the event information transmitted from the event information acquisition unit. The UI generation unit generates the UI determined by the UI determination unit. The user performs an input operation for generating a virtual viewpoint image according to the UI generated by the UI generation unit.

Abstract: A material generation apparatus includes an acquisition unit configured to acquire a plurality of camera images, and a material data generation unit configured to generate, based on a camera image selected from among the camera images, at least one of a foreground image and a background image as material data to be used for generation of an image corresponding to a designated viewpoint.