Abstract: A rotation state of an object obtained from an input video of a plurality of frames in time series is estimated by using an object image obtained by excluding at least a part of a region common to the plurality of frames from an image corresponding to the object.

Abstract: A target estimation image which is an image of a target at a time point t+w·u obtained by spinning the object in an object image at a time point t obtained from an input video of a plurality of frames in time-series by w unit time on the basis of a hypothesis of spin state and an object image at the time point t+w·u obtained from the input video are used, to estimate the spin state of the object by selecting a hypothesis of spin state and w in which likelihood of the target estimation image becomes high from among a plurality of hypotheses of spin states and a plurality of w whose absolute values are two or more, wherein an absolute value of w is an integer of 2 or more and u is a unit time.

Abstract: A target estimation image which is an image of a target at a time point t+w·u obtained by spinning the object in an object image which is an image of the object at a time point t obtained from an input video in time-series by w unit time on the basis of a hypothesis of spin state and an object image at the time point t+w·u obtained from the input video are used, to estimate a spin state of the object by selecting a hypothesis of spin state and w in which likelihood of the target estimation image becomes high from among a plurality of hypotheses of spin states and a plurality of w, wherein an absolute value of W is an integer of 1 or more and u is a unit time.

Abstract: Information for displaying information representing rotation axes of balls seen from a first point side or a second point side in regard to one or more motions of the balls moving from the first point side to the second point side is output, and information for displaying information representing rotation axes of the balls seen from an outer side located in a direction that is orthogonal to a virtual straight line connecting the first point to the second point in regard to the motions is output.

Abstract: Provided is technology for extracting a person region from an image, that can suppress preparation costs of learning data. Included are a composited learning data generating unit that generates, from already-existing learning data that is a set of an image including a person region and a mask indicating the person region, and a background image to serve as a background of a composited image, composited learning data that is a set of a composited image and a compositing mask indicating a person region in the composited image, and a learning unit that learns model parameters using the composited learning data.

Abstract: A motion classification model learning apparatus that learns a model for early recognizing a motion is provided. A training data acquisition part acquiring training data configured with pairs of video information about a motion that can be classified into any of a plurality of categories according to characteristics of the motion and category information that is a correct label corresponding to the video information; a motion history image generation part generation a motion history image of the video information; and a model learning part learning a model that outputs a label that is the category information, with the motion history image as an input are included.

Abstract: A video and audio presentation device configured to present video and audio for sports training with less delay in physical reaction is provided.

Abstract: An image display device (1) according to the present disclosure includes an image display unit (2) that has a pixel structure of subpixels having a plurality of colors, in which the subpixels having different colors are aligned in a first direction, and the subpixels having the same color are aligned in a second direction perpendicular to the first direction and causes an observer ob to observe an image through a plurality of opening portions (24) disposed for each pixel block BL including a plurality of pixels including the subpixels having the plurality of colors. A width of each of the plurality of opening portions (24) in the first direction is substantially equal to a width of a subpixel of the subpixels in the first direction, and the plurality of opening portions (24) are disposed to be shifted in the first direction.

Abstract: A height estimation method performed by a height estimation apparatus includes a first feature point extraction step of extracting a feature point coordinate, a first coordinate estimation step of estimating a coordinate of a first subject frame, a pre-generation step of deriving a height of the first subject frame and generating a distance addition pattern and a correction coefficient for an individual missing pattern, a second feature point extraction step of extracting a feature point coordinate from a second input image, a second coordinate estimation step of estimating a coordinate of a second subject frame and estimating a coordinate of an object frame, a subject data selection step of selecting the individual missing pattern and the correction coefficient in accordance with the feature point coordinate, an object data selection step of selecting an object height, and a height estimation step of adding up a distance between a feature point coordinate and another feature point coordinate extracted in acc

Abstract: A learning data generation device for generating learning data for learning a recognizer capable of estimating a contour of a sphere making spinning motion, with high accuracy, the sphere being recorded in a single camera video image, is provided.

Abstract: A video image editing device or the like, capable of editing a wraparound video image generated by using a plurality of video images captured by multi-viewpoint cameras to be comfortably viewable by viewers, is provided. Based on information about the positions and the sizes of X subjects, a polynomial expression regarding the position of the subject and a polynomial expression regarding the size of the subject are generated. Correction or interpolation of the positions of the H subjects is performed by a polynomial approximation curve using the polynomial expression regarding the position of the subject, correction or interpolation of the sizes of the N subjects is performed by a polynomial approximation curve using the polynomial expression regarding the size of the subject, and the sizes of the N subjects are expanded or contracted with an expansion/contraction parameter p.

Abstract: A virtual reality system is provided that includes a video presentation apparatus, the virtual reality system comprising: the video presentation apparatus which includes circuitry configured to: obtain as input a video sequence composed of a plurality of frames and mask information specifying a complementation target region in the video sequence; separate a frame into a foreground region and a background region based on binary images representing differences between the plurality of frames included in the video sequence; determine either one of patch-search-based completion and paste synthesis as a complementation method for the complementation target region based on a number of pixels belonging to the foreground region and located within a given distance from a periphery of the complementation target region; and complement the complementation target region in accordance with the complementation method; and a virtual reality head mounted display which presents the complemented video sequence to the user.

Abstract: A virtual reality system is provided that includes a video presentation apparatus, the virtual reality system comprising: the video presentation apparatus which includes circuitry configured to: obtain as input a video sequence composed of a plurality of frames and mask information specifying a complementation target region in the video sequence; separate a frame into a foreground region and a background region based on binary images representing differences between the plurality of frames included in the video sequence; determine either one of patch-search-based completion and paste synthesis as a complementation method for the complementation target region based on a number of pixels belonging to the foreground region and located within a given distance from a periphery of the complementation target region; and complement the complementation target region in accordance with the complementation method; and a virtual reality head mounted display which presents the complemented video sequence to the user.

Abstract: A technique for interpolating positional information of a target in an image of a frame in which positional information of the target has not been acquired.

Abstract: A video image synchronization device capable of stably synchronizing multiple viewpoint video images is provided. The video image synchronization device includes: a norm calculation unit that, from chronological data of a coordinate of each of joints of a human body in each of video images taken from a plurality of viewpoints, calculates a norm that is a movement amount per unit time of the joint in the video image; a motion rhythm detection unit that based on the norms, detects a motion rhythm including a movement start timing and a movement stop timing, for each of the joints in each of the video images; and a time shift detection unit that based on the motion rhythms of the respective joints in the respective video images, calculates a matching score indicating a degree of stability of a time shift between the video images and detects a time shift whose matching score is high.

Abstract: A technique that enables, even if a video image corresponding to one period is not obtained, estimating a rotational state of an object is provided. The rotational state estimation device includes: an object image generation unit 1 that generates object images, each of the object images being an image of an object, from an input video image; and a rotational state estimation unit 3 that estimates a rotational state of the object by selecting, from among a plurality of hypotheses of the rotational state, a hypothesis of the rotational state, a likelihood of an image of the object resulting from the object in the object image at a certain time being rotated for tc unit time based on the hypothesis of the rotational state being high, using the object image at a time t and the object image at a time t+tc where tc is a predetermined integer of no less than 1.

Abstract: A technology for obtaining a coordinate system conversion parameter more easily than in the related art is provided.

Abstract: A video and audio presentation device configured to present video and audio for sports training with less delay in physical reaction is provided.

Abstract: A technique of generating training data which enables improvement of estimation accuracy compared to the related art is provided. A training data generation device includes an image acquisition unit 11 configured to acquire an image of an object on which three or more markers are pasted, a marker measurement unit 12 configured to measure a position of each marker in the image and generate position and attitude information which is information regarding a position and an attitude of the object on the basis of the position of each marker, a recovery region determination unit 13 configured to determine a recovery region for inpainting in the image on the basis of the position of each marker, an image inpainting unit 14 configured to remove each marker from the image on the basis of the recovery region, and a training data generation unit 15 configured to generate training data on the basis of the image in which each marker is removed and the position and attitude information.

Abstract: A video image editing device or the like, capable of editing a wraparound video image generated by using a plurality of video images captured by multi-viewpoint cameras to be comfortably viewable by viewers, is provided. Based on information about the positions and the sizes of X subjects, a polynomial expression regarding the position of the subject and a polynomial expression regarding the size of the subject are generated. Correction or interpolation of the positions of the H subjects is performed by a polynomial approximation curve using the polynomial expression regarding the position of the subject, correction or interpolation of the sizes of the N subjects is performed by a polynomial approximation curve using the polynomial expression regarding the size of the subject, and the sizes of the N subjects are expanded or contracted with an expansion/contraction parameter p.