Abstract: A method and an apparatus for virtual training based on tangible interaction are provided. The apparatus acquires data for virtual training, and acquires a three-dimensional position of a real object based on a depth image and color image of the real object and infrared (IR) data included in the obtained data. Then, virtualization of an overall appearance of a user is performed by extracting a depth from depth information on a user image included in the obtained data and matching the extracted depth with the color information, and depth data and color data for the user obtained according to virtualization of the user is visualized in virtual training content. In addition, the apparatus performs correction on joint information using the joint information and the depth information included in the obtained data, estimates a posture of the user using the corrected joint information, and estimates a posture of a training tool using the depth information and IR data included in the obtained data.

Abstract: A method of supporting self-learning and a system for performing the method are disclosed. The method includes estimating an object of interest of a user in content based on user performance information inputted by the user in response to content situation information and the content being received from a learning module including the content, analyzing the content situation information, determining whether to generate support information for supporting the user to perform the content based on the estimated object of interest and the analyzed content situation information, and generating the support information that allows the user to self-learn the content according to whether to generate the support information, and outputting the support information to the learning module.

Abstract: Provided is a system for education in augmented reality (AR) for technology education in AR, The system for education in AR includes an instructor terminal configured to, in order to guide training of at least one learner on site or remotely using AR content, identify a training process of the trainee and generate training support information, an AR service providing server configured to manage the instructor terminal and a learner terminal that participate in the training using the AR content based on a request of the instructor terminal, and at least one learner terminal configured to transmit content training information to the AR service providing server.

Abstract: A method of supporting self-learning and a system for performing the method are disclosed. The method includes estimating an object of interest of a user in content based on user performance information inputted by the user in response to content situation information and the content being received from a learning module including the content, analyzing the content situation information, determining whether to generate support information for supporting the user to perform the content based on the estimated object of interest and the analyzed content situation information, and generating the support information that allows the user to self-learn the content according to whether to generate the support information, and outputting the support information to the learning module.

Abstract: A virtual content providing device includes: a communication circuit capable of communicating with a wearable device worn by a user; and a processor functionally connected to the communication circuit. The processor is configured to: display virtual training content on the wearable device through the communication circuit; generate training situation information and user condition information associated with the virtual training content through the wearable device; determine a intervention time point for the virtual training content based on the training situation information and the user condition information; generate virtual intervention content associated with the intervention time point; and display the virtual intervention content in synchronization with the virtual training content through the wearable device.

Abstract: Provided are an apparatus and method for experiencing an augmented reality (AR)-based screen sports match which enable even a child, an elderly person, and a person with a disability to easily and safely experience a ball sports match, such as tennis, badminton, or squash, as a screen sports match without using a wearable marker or sensor, a wearable display, an actual ball, and an actual tool.

Abstract: A method and an apparatus for virtual training based on tangible interaction are provided. The apparatus acquires data for virtual training, and acquires a three-dimensional position of a real object based on a depth image and color image of the real object and infrared (IR) data included in the obtained data. Then, virtualization of an overall appearance of a user is performed by extracting a depth from depth information on a user image included in the obtained data and matching the extracted depth with the color information, and depth data and color data for the user obtained according to virtualization of the user is visualized in virtual training content. In addition, the apparatus performs correction on joint information using the joint information and the depth information included in the obtained data, estimates a posture of the user using the corrected joint information, and estimates a posture of a training tool using the depth information and IR data included in the obtained data.

Abstract: Provided are an apparatus and method for experiencing an augmented reality (AR)-based screen sports match which enable even a child, an elderly person, and a person with a disability to easily and safely experience a ball sports match, such as tennis, badminton, or squash, as a screen sports match without using a wearable marker or sensor, a wearable display, an actual ball, and an actual tool.

Abstract: A virtual content providing device includes: a communication circuit capable of communicating with a wearable device worn by a user; and a processor functionally connected to the communication circuit. The processor is configured to: display virtual training content on the wearable device through the communication circuit; generate training situation information and user condition information associated with the virtual training content through the wearable device; determine a intervention time point for the virtual training content based on the training situation information and the user condition information; generate virtual intervention content associated with the intervention time point; and display the virtual intervention content in synchronization with the virtual training content through the wearable device.

Abstract: A system for recognizing collision positions of a plurality of moving objects in a screen includes an infrared camera configured to obtain an image frame when a plurality of moving objects move toward a screen, a memory configured to store a program for calculating a collision position in the screen on the basis of the image frame, and a processor configured to execute the program stored in the memory. By executing the program, the processor detects all of the plurality of moving objects from the image frame to generate a graph where moving objects included in a successive image frame are connected to one another, and calculates a collision position of the moving object included in the image frame and a collision position of the moving object in the screen on the basis of the graph.

Abstract: A method of recognizing motions of a plurality of users through a motion recognition apparatus includes acquiring a plurality of depth images from a plurality of depth sensors disposed at different positions, extracting user depth data corresponding to a user area from each of the plurality of depth images, allocating a label ID of each user to the extracted user depth data; matching the label ID for each frame of the depth images, and tracking a joint position for the user depth data on the basis of a result of the matching.

Abstract: Provided is a system and method for automatically recognizing virtual ball sports information, specifically, a system and method for automatically recognizing virtual ball sports events and motions on the basis of ball measurement data training. Provided is a server for automatically recognizing virtual ball sports information including an inputter configured to receive ball measurement data, a memory which stores a program for automatically recognizing virtual ball sports information, and a processor configured to execute the program, wherein the processor automatically recognizes an event and a motion of a sport that is currently played by a user using the ball measurement data and a ball classification label.

Abstract: Provided are a system and method for simultaneously reconstructing an initial three-dimensional (3D) trajectory and velocity of an object by using single camera images. The system for simultaneously reconstructing an initial 3D trajectory and velocity of an object by using single camera images includes a receiver configured to receive 3D world coordinate information of a starting point of an object and object-captured image information of a single camera, a two-dimensional (2D) coordinate acquisition unit configured to acquire 2D image coordinates of the object from the object-captured image information, and a reconstructor configured to simultaneously reconstruct an initial 3D velocity and trajectory of the object by applying a 3D motion equation to the 2D image coordinates and depth information from the single camera to the object.

Abstract: A system for recognizing collision positions of a plurality of moving objects in a screen includes an infrared camera configured to obtain an image frame when a plurality of moving objects move toward a screen, a memory configured to store a program for calculating a collision position in the screen on the basis of the image frame, and a processor configured to execute the program stored in the memory. By executing the program, the processor detects all of the plurality of moving objects from the image frame to generate a graph where moving objects included in a successive image frame are connected to one another, and calculates a collision position of the moving object included in the image frame and a collision position of the moving object in the screen on the basis of the graph.

Abstract: Provided are a system and method for simultaneously reconstructing an initial three-dimensional (3D) trajectory and velocity of an object by using single camera images. The system for simultaneously reconstructing an initial 3D trajectory and velocity of an object by using single camera images includes a receiver configured to receive 3D world coordinate information of a starting point of an object and object-captured image information of a single camera, a two-dimensional (2D) coordinate acquisition unit configured to acquire 2D image coordinates of the object from the object-captured image information, and a reconstructor configured to simultaneously reconstruct an initial 3D velocity and trajectory of the object by applying a 3D motion equation to the 2D image coordinates and depth information from the single camera to the object.

Abstract: An apparatus for generating animation includes: an input interface receiving a motion path sketch input and a posture sketch input from a user; a motion path information generator generating motion path information corresponding to the motion path sketch input; a posture information generator generating posture information corresponding to the posture sketch input; a similar motion clip retriever retrieving a similar motion clip corresponding to the posture information among motion clips stored in a database; a motion information generator generating motion information including a frame of the similar motion clip disposed according to the motion path information; and an animation generator generating animation by rendering a graphic model according to the motion information.

Abstract: An apparatus for generating a 3-dimensional character motion via timing transfer. The apparatus includes an example motion database configured to store data about one or more example motions of characters with an identical skeleton model structure; an example motion analyzer configured to generate a timing source by analyzing timing in a designated example motion data among the one or more example motion data stored in the example motion database; and an input motion transfer part configured to re-adjust spatial movements in an input motion in correspondence with the generated timing source so as to generate an output motion.

Abstract: This invention provides a device and a method of multi-view image calibration which can easily acquire calibration parameters (intrinsic/extrinsic parameter) of multi-image input device in wide space without separate calibration tool.

Abstract: An object trajectory tracking apparatus for tracking three-dimensional position of a high-speed moving instrument, i.e., a high-speed moving object for which it is difficult to acquire actual depth information, and a moving path thereof when information is extracted by utilizing a single depth sensor in a swing motion of sport in which a predetermined instrument is used by hand, and method therefor. The apparatus includes grid information generation unit, shadow area determination unit, initial object position information generation unit, object position estimation unit, and three-dimensional trajectory restoration unit, tracks three-dimensional route of an object, for which it is difficult to acquire depth information, in a fast sports motion such that information that allows user to correct and learn motion can be provided, and calculates a three-dimensional position and route calculated such that information required for practicing a more accurate swing motion can be provided.

Abstract: An apparatus for generating a 3-dimensional character motion via timing transfer. The apparatus includes an example motion database configured to store data about one or more example motions of characters with an identical skeleton model structure; an example motion analyzer configured to generate a timing source by analyzing timing in a designated example motion data among the one or more example motion data stored in the example motion database; and an input motion transfer part configured to re-adjust spatial movements in an input motion in correspondence with the generated timing source so as to generate an in output motion.