Abstract: A mixed reality display device according to one embodiment of the present invention comprises: a virtual environment rendering unit for generating a virtual object by using information on a scene in a virtual reality, and then generating a color map and a depth map for the virtual object; a depth rendering unit for generating a depth map for a real object by using information on a real environment; an occlusion processing unit for performing occlusion processing by using the color map and the depth map, for the virtual object, received from the virtual environment rendering unit, the depth map, for a real object, received from the depth rendering unit, and a color map, for the real object, received from a see-through camera; and a display unit for outputting a color image by using a color map for the virtual object and a color map for the real object, which are received from the occlusion processing unit.

Abstract: The present invention relates to a data processing device, method, and computer program for data sharing among multiple users. The device includes a sensor module collecting data by using at least one of a camera sensor, a distance sensor, a microphone array, a motion capture sensor, an environment scanner, and a haptic device; a memory module storing and controlling the data collected by the sensor module; and a network module transmitting the data stored in the memory module to a remote location, or receiving predetermined data from the remote location, wherein the memory module stores the stored data and the predetermined data as data in a standardized format according to data features.

Abstract: A head-mounted device (HMD) for enabling a 3D drawing interaction in a mixed-reality space is provided. The HMD includes a frame section, a rendering unit providing a specified image, a camera unit attached to the frame section to pick up an image for rendering, and a control unit configured to, when the camera unit picks up an image of a specified marker, perform a calibration process based on position information of the image of the marker displayed on a screen of the HMD and to, when there is a motion of an input device for interaction with a virtual whiteboard, obtain position information of an image of the input device displayed on a virtual camera screen based on position information of the whiteboard.

Abstract: Disclosed is an apparatus for outputting a virtual keyboard, the apparatus including: a virtual keyboard image output unit determining coordinates of a virtual keyboard image by using hand information of a user and outputting the virtual keyboard image; a contact recognition unit determining a contact state by using collision information between a virtual physical collider associated with an end point of a user's finger and a virtual physical collider associated with each virtual key of the virtual keyboard image; a keyboard input unit providing multiple input values for a single virtual key; and a feedback output unit outputting respective feedback for the multiple input values. Accordingly, input convenience and efficiency may be provided by outputting the virtual keyboard in a three dimensional virtual space and reproducing an input method using a keyboard form that is similar to the real world.

Abstract: Disclosed is an apparatus for outputting a virtual keyboard, the apparatus including: a virtual keyboard image output unit determining coordinates of a virtual keyboard image by using hand information of a user and outputting the virtual keyboard image; a contact recognition unit determining a contact state by using collision information between a virtual physical collider associated with an end point of a user's finger and a virtual physical collider associated with each virtual key of the virtual keyboard image; a keyboard input unit providing multiple input values for a single virtual key; and a feedback output unit outputting respective feedback for the multiple input values. Accordingly, input convenience and efficiency may be provided by outputting the virtual keyboard in a three dimensional virtual space and reproducing an input method using a keyboard form that is similar to the real world.

Abstract: An apparatus for providing haptic force feedback to a user interacting with a virtual object in a virtual space is provided. The apparatus includes a force-feedback provision unit providing a sensation of touch arising from an interaction with the virtual object to at least a portion of the user's body. A processor unit performs (i) receiving at least one of a first force-feedback control data generated based on vector information on a motion of the at least a portion of the user's body and information on the virtual object and a second force-feedback control data generated based on image information the information on the virtual object from the external terminal, or (ii) generating at least one of the first and second force-feedback control data.

Abstract: A head-mounted device (HMD) for enabling a 3D drawing interaction in a mixed-reality space is provided. The HMD includes a frame section, a rendering unit providing a specified image, a camera unit attached to the frame section to pick up an image for rendering, and a control unit configured to, when the camera unit picks up an image of a specified marker, perform a calibration process based on position information of the image of the marker displayed on a screen of the HMD and to, when there is a motion of an input device for interaction with a virtual whiteboard, obtain position information of an image of the input device displayed on a virtual camera screen based on position information of the whiteboard.

Abstract: A method for displaying a shadow of a 3D virtual object, includes steps of: (a) acquiring information on a viewpoint of a user looking at a 3D virtual object displayed in a specific location in 3D space by a wall display device; (b) determining a location and a shape of a shadow of the 3D virtual object to be displayed by referring to information on the viewpoint of the user and the information on a shape of the 3D virtual object; and (c) allowing the shadow of the 3D virtual object to be displayed by at least one of the wall display device and a floor display device by referring to the determined location and the determined shape of the shadow of the 3D virtual object. Accordingly, the user is allowed to feel the accurate sense of depth or distance regarding the 3D virtual object.

Abstract: A method for displaying a shadow of a 3D virtual object, includes steps of: (a) acquiring information on a viewpoint of a user looking at a 3D virtual object displayed in a specific location in 3D space by a wall display device; (b) determining a location and a shape of a shadow of the 3D virtual object to be displayed by referring to information on the viewpoint of the user and the information on a shape of the 3D virtual object; and (c) allowing the shadow of the 3D virtual object to be displayed by at least one of the wall display device and a floor display device by referring to the determined location and the determined shape of the shadow of the 3D virtual object. Accordingly, the user is allowed to feel the accurate sense of depth or distance regarding the 3D virtual object.

Abstract: An apparatus for generating tactile sensation by using a magnetic field, includes: a first magnet and a second one which are placed across a target as a subject to provide tactile sensation; and a first electromagnet placed between the target and the first magnet; wherein a strength of the whole magnetic field between the first and the second magnets is allowed to be adjusted by adjusting at least either of a direction and a strength of a magnetic field arising from the first electromagnet to control the strength of the force with which the target is pressed by the first and the second magnets. Because a magnet itself that generates a magnetic field without any complicated mechanical components may perform a function as an actuator that generates tactile sensation, the apparatus for generating tactile sensation may become simple, light and compact.