Abstract: The technical result obtained herein is providing the ability to display an output image having the actual texture of the photo or video image, simplifying the implementation by eliminating the need to store a database of reference textures of objects, enabling texturizing of a 3D model areas invisible on the 2D object. A feature-based ORB-SLAM algorithm can be used for image processing using sparse point cloud. An advantageous solution is provided that allows to improve the efficiency of the texturizing process and therefore allows to use the ORB-SLAM algorithm on mobile devices by reducing computational intensity of the overall process. In order to achieve these advantages, a system of preliminary image processing is implemented. Said preliminary image processing allows to identify the most promising areas for detecting object features on the images coming from the camera.

Abstract: Embodiments of the present disclosure relate to a method, apparatus, device and computer readable storage medium for reconstructing a three-dimensional scene. The method for reconstructing a three-dimensional scene includes acquiring a point cloud data frame set for a three-dimensional scene, point cloud data frames in the point cloud data frame set respectively having a pose parameter. The method further comprises determining a subset corresponding to a part of the three-dimensional scene from the point cloud data frame set. The method further comprises adjusting a pose parameter of a point cloud data frame in the subset to obtain an adjusted subset, the adjusted subset including at least two point cloud data frames having matching overlapping parts. The method further comprises updating the point cloud data frame set using the adjusted subset. In this way, distributed processing on a large amount of point cloud data may be realized.

Abstract: A three-dimensional object data generation apparatus includes an obtaining unit that obtains three-dimensional object data representing a three-dimensional object with plural voxels, for each of which a physical property value is set, a setting unit that sets a three-dimensional threshold matrix in which thresholds are arranged in a three-dimensional space in accordance with a predetermined basic shape, and a calculation unit that calculates whether to form each of the plural voxels on a basis of the physical property value of the voxel and the three-dimensional threshold matrix.

Abstract: Techniques for interactive scorekeeping and animation generation are described, including evaluating a play to form an event datum associated with execution of the play, using the event datum to form an event packet, generating an animation using the event packet, the animation being associated with the execution of the play, and presenting the animation on an endpoint.

Abstract: This virtual make-up apparatus extracts an object portion image of a virtual make-up from a facial image captured by a camera, applies, on the object portion image, a color corresponding to an item in accordance with designation of the item for the virtual make-up, and adds a texture component different for each item, to a part of the object portion image. The virtual make-up apparatus displays, on a display unit, a virtual make-up image in which a virtual make-up using an item is applied on the facial image, by using the object portion image to which color is applied, an image in which a texture component is added to the part of the object portion image, and the object portion image of the virtual make-up of the facial image.

Abstract: The present disclosure relates to a method for transmitting metadata of an omnidirectional image by a transmission apparatus, the method comprising the steps of: projecting an omnidirectional image into a planar image based on a 3-dimensional (3D) geometry corresponding to the omnidirectional image; and transmitting metadata including type information of the 3D geometry, information for a region on the projected planar image, and information for an area on the omnidirectional image which is mapped to the region.

Abstract: A method and system for generating a three-dimensional (3D) virtual scene are disclosed. The method includes: identifying a two-dimensional (2D) object in a 2D picture and the position of the 2D object in the 2D picture; obtaining the three-dimensional model of the 3D object corresponding to the 2D object; calculating the corresponding position of the 3D object corresponding to the 2D object in the horizontal plane of the 3D scene according to the position of the 2D object in the picture; and simulating the falling of the model of the 3D object onto the 3D scene from a predetermined height above the 3D scene, wherein the position of the landing point the model of the 3D object in the horizontal plane is the corresponding position of the 3D object in the horizontal plane of the 3D scene.

Abstract: The disclosure relates to a system for providing guidance for positioning a body. The system may include a video display, one or more digital cameras configured to generate a depth video stream and a visual video stream, and a computing device including, a memory, and a processor. The processor may control the one or more digital cameras to generate the depth video stream including a depth image of the body and the visual video stream including a color image of the body. The processor identifies at least a part of the body within the images using a first trained learning machine to segment the images and isolate the body. The processor may crop both the visual image and the depth image based on the identified body. The processor may estimate a position of a plurality of joints of the body by applying a second trained learning machine to the identified and isolated part of the body. The processor may generate a current pose estimate by connecting estimated positions of the plurality of joints.

Abstract: A virtuality-reality overlapping method is provided. A point cloud map related to a real scene is constructed. Respective outline border vertexes of a plurality of objects are located by using 3D object detection. According to the outline border vertexes of the objects, the point cloud coordinates of the final candidate outline border vertexes are located according to the screening result of a plurality of projected key frames. Then, the point cloud map is projected to the real scene for overlapping a virtual content with the real scene.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for animating a pull-to-refresh gesture. The program and method provide for receiving a pull gesture in a messaging application; selecting, in response to receiving the pull gesture, a set of users corresponding to contacts in the messaging application; and displaying a set of images for each user in the set of users, in association with refreshing screen content.

Abstract: Aspects of the present disclosure relate to a method for producing an output image representing a scene. The method comprises rendering a plurality of component images. Each component image corresponds to an associated depth within the scene. The method comprises determining one or more elements of a view pose to which an output image is to correspond, and deriving an output image part from each of the plurality of component images based on the determined one or more elements. The method then comprises overlaying each of the output image parts, to produce the output image.

Abstract: A projector includes a projection section that projects a first image on a projection surface, a control section that causes the projection section to project a pattern image for installation including a first pattern that is located at an end of the first image, which overlaps with a second image, and a second pattern that is so disposed that a first straight line section is located in a position separate from the end by a distance, and a correction section that corrects the first image based on a captured image containing an image of a first area of the second image, and the first area is an area that overlaps with an area having a width corresponding to the distance measured from the end of the first image in a state in which the first image and the second image overlap with each other.

Abstract: Techniques are disclosed relating to compression of data stored at different cache levels. In some embodiments, programmable shader circuitry is configured to execute program instructions of compute kernels that write pixel data. In some embodiments, a first cache is configured to store pixel write data from the programmable shader circuitry and first compression circuitry is configured to compress a first block of pixel write data in response to full accumulation of the first block in the first cache circuitry. In some embodiments, second cache circuitry is configured to store pixel write data from the programmable shader circuitry at a higher level in a storage hierarchy than the first cache circuitry and second compression circuitry is configured to compress a second block of pixel write data in response to full accumulation of the second block in the second cache circuitry.

Abstract: In a method of facilitating interaction between a user of an augmented reality (AR) mobile device and a first real-world object, a display device is caused to superimpose digital information on portions of a process control environment within a field of view of a camera of the device. The superimposed information is associated with nodes in a map of the environment, and the nodes correspond to other objects in the environment. The display is caused to indicate a direction to the first object. After detecting a user input that indicates selection of the first object, the display is caused to superimpose, on a portion of the process control environment currently within the field of view, a digital model or image of the first object. A user interface is caused to provide one or more virtual controls and/or one or more displays associated with the first object.

Abstract: The present invention relates to a device for displaying image information, the device comprising: a detection unit (10), which is configured to identify a plurality of admissible display orientations of multiple data sets; a restriction unit (20), which is configured to restrict the plurality of admissible display orientations of at least one of the multiple data sets to a set of admissible display orientations in common for all the multiple data sets; and/or to restrict a plurality of admissible scrolling directions of at least one of the multiple data sets to a set of admissible scrolling directions that are normal to the restricted admissible display orientations; and a display unit (30), which is configured to display the multiple data sets using the set of the restricted display orientations and/or the set of restricted scrolling directions.

Abstract: A method, a device and a computer-readable storage medium with instructions for controlling a display of an augmented reality head-up display device for a motor vehicle as well as an augmented reality head-up display device for a motor vehicle. In a first step, the position for a representation of a virtual object in front of the motor vehicle is determined (20). The virtual object is then superimposed (21), corresponding to the determined position, onto a projection surface by an imaging unit. To increase the subjective perception of the registration quality on the part of the observer, the virtual object is designed to this effect to be fault-tolerant with regard to registration errors.

Abstract: Systems and methods are disclosed to receive a request for a virtual reality render project that includes information specifying virtual reality video data to be used to create a virtual reality render; determine a plurality of virtual reality jobs required to create the virtual reality render from the virtual reality video data; determine the availability of a plurality of virtual reality nodes across the network; create a virtual reality render map that specifies a processing sequence of the plurality of virtual reality jobs across the one or more virtual reality nodes to create the virtual reality render, the virtual reality render map being created based on at least the availability of the plurality of virtual reality nodes; and process the plurality of virtual reality jobs at the plurality of virtual reality nodes to create the virtual reality.

Abstract: An electronic device according to the present invention includes at least one processor to perform the operations of: a display control unit configured to control a display device to display a part of an image; and a detection unit configured to detect an orientation change of the display device, wherein the display control unit performs first processing relating to changing a position of a part of the image displayed according to the orientation change if the detected orientation change is a pitch or a yaw, and performs second processing relating to reproduction of the image, the second processing being different from the first processing, if the detected orientation change is a roll.

Abstract: Systems and methods for providing digital augmented reality content in a distribution network using physical distribution items as triggers for the Augmented reality content. An interface allows a sender of a physical item to provide augmented reality content to a distribution network, and the distribution network can provide the augmented reality content to a recipient of the physical distribution item.

Abstract: An augmented reality (AR) device includes a memory configured to store instructions of an augmented reality (AR) application. The AR device further includes a processor configured to initiate a first image capture operation to generate first image data and to determine a three-dimensional (3D) map based on the first image data. The 3D map represents a set of locations including a first location. The processor is further configured to initiate a second image capture operation to generate second image data and to execute the instructions to identify, based on the second image data, a second location of the set of locations. The processor is further configured to modify an audio signal to synthesize one or more acoustic characteristics associated with audio sent from the first location to the second location.