Abstract: An image display device (1) according to the present disclosure includes an image display unit (2) that has a pixel structure of subpixels having a plurality of colors, in which the subpixels having different colors are aligned in a first direction, and the subpixels having the same color are aligned in a second direction perpendicular to the first direction and causes an observer ob to observe an image through a plurality of opening portions (24) disposed for each pixel block BL including a plurality of pixels including the subpixels having the plurality of colors. A width of each of the plurality of opening portions (24) in the first direction is substantially equal to a width of a subpixel of the subpixels in the first direction, and the plurality of opening portions (24) are disposed to be shifted in the first direction.

Abstract: A behavior classifier includes a coordinate estimation unit that receives a plurality of frames in chronological order as an input to estimate a keypoint coordinate group for each of the plurality of frames and to generate a chronological keypoint coordinate group for the plurality of input frames; a matrix generation unit that generates a trajectory matrix and generates a trajectory matrix group in which trajectory matrices are collected for all of keypoints defined for the object; and a behavior classification unit that classifies a behavior of the object based on the trajectory matrix group. Each of the plurality of frames captures an object as a moving image. The keypoint coordinate group is a set of two-dimensional coordinates of a keypoint defined for the object. The chronological keypoint coordinate group is a set of the keypoint coordinate groups arranged in chronological order.

Abstract: An object-specific keypoint separation apparatus includes: an inference execution unit configured to receive a captured image capturing an object as an input and use a pre-trained model that has been trained in order to output a plurality of first maps and a plurality of second maps generated from the input captured image to output the plurality of first maps and the plurality of second maps, the plurality of first maps storing, for keypoints of the object. a distance from a first keypoint only around a second keypoint, and the plurality of second maps representing a heat map configured to have a peak at coordinates at which the keypoint of the object appears; and an object-specific keypoint separation unit configured to separate the keypoints for each object based on the plurality of first maps and the plurality of second maps output from the inference execution unit.

Abstract: An object-specific keypoint separation apparatus includes: an inference execution unit configured to receive a captured image capturing an object as an input and use a pre-trained model that has been trained in order to output a plurality of first maps and a plurality of second maps generated from the input captured image to output the plurality of first maps and the plurality of second maps, the plurality of first maps storing a vector describing a connection relationship of a keypoint of the object only around the keypoint, and the plurality of second maps representing a heat map configured to have a peak at coordinates at which the keypoint of the object appears; a map correction unit configured to correct the plurality of second maps using the plurality of first maps and the plurality of second maps; an upsampling unit configured to upsample the plurality of first maps; and an object-specific keypoint separation unit configured to separate keypoints for each object based on the plurality of upsampled firs

Abstract: A height estimation method performed by a height estimation apparatus includes a first feature point extraction step of extracting a feature point coordinate, a first coordinate estimation step of estimating a coordinate of a first subject frame, a pre-generation step of deriving a height of the first subject frame and generating a distance addition pattern and a correction coefficient for an individual missing pattern, a second feature point extraction step of extracting a feature point coordinate from a second input image, a second coordinate estimation step of estimating a coordinate of a second subject frame and estimating a coordinate of an object frame, a subject data selection step of selecting the individual missing pattern and the correction coefficient in accordance with the feature point coordinate, an object data selection step of selecting an object height, and a height estimation step of adding up a distance between a feature point coordinate and another feature point coordinate extracted in acc

Abstract: A learning data generation device for generating learning data for learning a recognizer capable of estimating a contour of a sphere making spinning motion, with high accuracy, the sphere being recorded in a single camera video image, is provided.

Abstract: A video image editing device or the like, capable of editing a wraparound video image generated by using a plurality of video images captured by multi-viewpoint cameras to be comfortably viewable by viewers, is provided. Based on information about the positions and the sizes of X subjects, a polynomial expression regarding the position of the subject and a polynomial expression regarding the size of the subject are generated. Correction or interpolation of the positions of the H subjects is performed by a polynomial approximation curve using the polynomial expression regarding the position of the subject, correction or interpolation of the sizes of the N subjects is performed by a polynomial approximation curve using the polynomial expression regarding the size of the subject, and the sizes of the N subjects are expanded or contracted with an expansion/contraction parameter p.

Abstract: A technique for interpolating positional information of a target in an image of a frame in which positional information of the target has not been acquired.

Abstract: A video image synchronization device capable of stably synchronizing multiple viewpoint video images is provided. The video image synchronization device includes: a norm calculation unit that, from chronological data of a coordinate of each of joints of a human body in each of video images taken from a plurality of viewpoints, calculates a norm that is a movement amount per unit time of the joint in the video image; a motion rhythm detection unit that based on the norms, detects a motion rhythm including a movement start timing and a movement stop timing, for each of the joints in each of the video images; and a time shift detection unit that based on the motion rhythms of the respective joints in the respective video images, calculates a matching score indicating a degree of stability of a time shift between the video images and detects a time shift whose matching score is high.

Abstract: A technology for obtaining a coordinate system conversion parameter more easily than in the related art is provided.

Abstract: A technique that enables, even if a video image corresponding to one period is not obtained, estimating a rotational state of an object is provided. The rotational state estimation device includes: an object image generation unit 1 that generates object images, each of the object images being an image of an object, from an input video image; and a rotational state estimation unit 3 that estimates a rotational state of the object by selecting, from among a plurality of hypotheses of the rotational state, a hypothesis of the rotational state, a likelihood of an image of the object resulting from the object in the object image at a certain time being rotated for tc unit time based on the hypothesis of the rotational state being high, using the object image at a time t and the object image at a time t+tc where tc is a predetermined integer of no less than 1.

Abstract: A video and audio presentation device configured to present video and audio for sports training with less delay in physical reaction is provided.

Abstract: A technique of generating training data which enables improvement of estimation accuracy compared to the related art is provided. A training data generation device includes an image acquisition unit 11 configured to acquire an image of an object on which three or more markers are pasted, a marker measurement unit 12 configured to measure a position of each marker in the image and generate position and attitude information which is information regarding a position and an attitude of the object on the basis of the position of each marker, a recovery region determination unit 13 configured to determine a recovery region for inpainting in the image on the basis of the position of each marker, an image inpainting unit 14 configured to remove each marker from the image on the basis of the recovery region, and a training data generation unit 15 configured to generate training data on the basis of the image in which each marker is removed and the position and attitude information.

Abstract: A video image editing device or the like, capable of editing a wraparound video image generated by using a plurality of video images captured by multi-viewpoint cameras to be comfortably viewable by viewers, is provided. Based on information about the positions and the sizes of X subjects, a polynomial expression regarding the position of the subject and a polynomial expression regarding the size of the subject are generated. Correction or interpolation of the positions of the H subjects is performed by a polynomial approximation curve using the polynomial expression regarding the position of the subject, correction or interpolation of the sizes of the N subjects is performed by a polynomial approximation curve using the polynomial expression regarding the size of the subject, and the sizes of the N subjects are expanded or contracted with an expansion/contraction parameter p.