Abstract: Techniques for enabling a library of local maps to remain de-coupled from a global map are disclosed. An MR system is determined to be located on a platform that is currently moving or that has an ability to readily move. That platform's type is determined. Based on the determined type for the platform, a 3D boundary that approximates a shape for the platform's type is generated. The 3D boundary is imposed on the platform. Scanning data for the platform is acquired. The bounds for that scanning data is at least initially limited to that of the 3D boundary. The scanning data is used to build or supplement a library of local maps. The library is representative of the platform. That library is prevented from being coupled to a global map.

Abstract: Augmented and virtual reality display systems increase viewer comfort by reducing viewer exposure to virtual content that causes undesirable accommodation-vergence mismatches (AVM). The display systems limit displaying content that exceeds an accommodation-vergence mismatch threshold, which may define a volume around the viewer. The volume may be subdivided into two or more zones, including an innermost loss-of-fusion zone (LoF) in which no content is displayed, and one or more outer AVM zones in which the displaying of content may be stopped, or clipped, under certain conditions. For example, content may be clipped if the viewer is verging within an AVM zone and if the content is displayed within the AVM zone for more than a threshold duration. A further possible condition for clipping content is that the user is verging on that content.

Abstract: In an example, an apparatus comprises logic, at least partially comprising hardware logic, to receive an input from one or more detectors proximate a display to present an output from a graphics pipeline, determine that a user is not interacting with the display, and in response to a determination that the user is not interacting with the display, to reduce a frame rendering rate of the graphics pipeline. Other embodiments are also disclosed and claimed.

Abstract: An electronic device with a dynamic wallpaper is provided. The electronic device includes a touch screen and a processor. The processor is coupled to the touch screen. The processor displays a first dynamic wallpaper mode by the touch screen when determining that the electronic device is in a non-lock screen mode.

Abstract: Systems, methods, and storage media for manifesting a virtual object in a virtual environment are disclosed. Exemplary embodiments may: receive, at a first physical object detector, a first signal, from a first physical object-associated element in a first physical environment; identify, at a first value identification module, based on the first signal, a first value associated with the first signal; identify, at a first virtual object identification module, based on the first value, a first virtual object; and manifest, at a first virtual environment output device, a first manifestation of the first virtual object in a first manifestation of the first virtual environment.

Abstract: Cell-based augmented reality (AR) content positioning systems may include a reference grid of cells, each of which includes a 32-bit intracellular coordinate system based on a respective reference point of the cell. Cell topology is selected such that the intracellular coordinate systems may utilize single-precision floating point numbers while retaining the ability to define content positions with, e.g., millimeter-level precision. Accordingly, rendering of AR content may be performed at a high precision using 32-bit devices and methods.

Abstract: This disclosure relates to methods and systems for encoding or decoding a 3D mesh with predictive coding of boundary geometry information. The example decoding method includes receiving a coded bitstream comprising a geometry patch for a three-dimension mesh; extracting, from the coded bitstream, a reconstructed geometry image for the geometry patch comprising a set of points corresponding to a set of geometry coordinates for a boundary vertex in the three-dimension mesh; deriving based on the set of the geometry coordinates, a 3D geometry coordinate for the boundary vertex; obtaining a prediction residue for the boundary vertex; and reconstructing, by the device, geometry information of the boundary vertex based on the derived 3D geometry coordinate and the prediction residue.

Abstract: Embodiments are disclosed for full body pose estimation using features extracted from multiple wearable devices. In an embodiment, a method comprises: obtaining point of view (POV) video data and inertial sensor data from multiple wearable devices worn at the same time by a user; obtaining depth data capturing the user's full body; extracting two-dimensional (2D) keypoints from the POV video data; reconstructing a full body 2D skeletal model from the 2D keypoints; generating a three-dimensional (3D) mesh model of the user's full body based on the depth data; merging nodes of the 3D mesh model with the inertial sensor data; aligning respective orientations of the 2D skeletal model and the 3D mesh model in a common reference frame; and predicting, using a machine learning model, classification types based on the aligned 2D skeletal model and 3D mesh model.

Abstract: The present disclosure describes a system and method for implementing a virtual shoe try-on feature. The method includes predicting, using a machine learning model, a first plurality of pixels including pixels of an image corresponding to a foot in the image and adding a first virtual cylindrical object to a three-dimensional model of a shoe such that a portion of the first virtual cylindrical object is positioned within the three-dimensional model of the shoe. The method also include determining a set of pixels including pixels of the first plurality of pixels that intersect with the first virtual cylindrical object and removing, from the three-dimensional model of the shoe, a first portion of the three-dimensional model of the shoe that intersects with the set of pixels.

Abstract: This application discloses an artificial intelligence (AI) based animation character drive method. A first expression base of a first animation character corresponding to a speaker is determined by acquiring media data including a facial expression change when the speaker says a speech, and the first expression base may reflect different expressions of the first animation character. After target text information is obtained, an acoustic feature and a target expression parameter corresponding to the target text information are determined according to the target text information, the foregoing acquired media data, and the first expression base. A second animation character having a second expression base may be driven according to the acoustic feature and the target expression parameter, so that the second animation character may simulate the speaker's sound and facial expression when saying the target text information, thereby improving experience of interaction between the user and the animation character.

Abstract: A digital human driving method and apparatus are provided which relate to computer and image processing, and can solve the problem of shaking, joint rotation malposition and partial loss of a digital human during a driving process. The solution includes: capturing video data from multiple angles of view in a real three-dimensional space by multiple video capture devices; determining a first coordinate of a key point of the target human; determining a mapping relationship based on the first coordinate; calculating a second coordinate based on the mapping relationship and the first coordinate; processing the second coordinate according to a key point rotation model to obtain rotation value of the virtual key point in the virtual three-dimensional space; and driving the digital human to move based on the rotation value of the virtual key point in the virtual three-dimensional space.

Abstract: A system for coloring a monochromatic image of a scene, the system comprising a processing circuitry configured to: capture the monochromatic image of the scene utilizing a non-visible spectrum sensor, capable of capturing monochromatic images from a viewpoint having a given position and a given orientation; obtain one or more previously captured color images, covering at least part of the scene; determine a registration between the monochromatic image and the previously captured color images; render one or more rendered images, being the previously captured color images adjusted to the viewpoint by utilizing the registration; and generate a colored image of the scene by changing, for at least one given pixel of the monochromatic image, values of one or more chroma components of the given pixel in accordance with values of one or more chroma components of a corresponding pixel of the rendered images.

Abstract: An output of a first one of a plurality of layers within a neural network is identified. A bitmap is determined from the output, the bitmap including a binary matrix. A particular subset of operations for a second one of the plurality of layers is determined to be skipped based on the bitmap. Operations are performed for the second layer other than the particular subset of operations, while the particular subset of operations are skipped.

Abstract: According to some embodiments, a method performed by an extended reality (XR) system comprises: identifying a space within an XR spatial mapping to which virtual content can be overlaid; determining an amount of static occlusion associated with the identified space; and transmitting an indication of the amount of static occlusion associated with the identified space to a virtual content supply side platform. According to some embodiments, a method performed by an XR system comprises: triggering a digital content display opportunity associated with a space within an XR spatial mapping to which virtual content can be overlaid; determining an amount of dynamic occlusion associated with the space; and transmitting an indication of the amount of dynamic occlusion associated with the identified space to a digital content display opportunity bidding system.

Abstract: The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor.

Abstract: System and method for reconstructing a three-dimensional (3D) face model from an input 2D image of the face, including: feeding the input 2D image of the first face into a hypernetwork (H) to generate weights for an implicit representation network (IRN); generating, by the IRN with the generated weights, multi-view face images of the first face; and generating the 3D model of the first face by feeding the multi-view face images of the first face into a network trained to generate a 3D face model from the multi-view face images.

Abstract: There is disclosed a system and process for creating a graphical representation of a re-development location. The system can perform the process of locating a region based upon a primary criteria. Next the system can then evaluate the region in its current state based upon social criteria, and then evaluate the region in is future re-developed state based upon future social criteria. Next, the system can perform the step of evaluating the region in its current state based upon environmental criteria and also perform the step of evaluating the region in its future re-developed state based upon future environmental criteria. Next, the system can perform the step of evaluating the region in its current state based upon economic criteria, and then perform the step of evaluating the region in its future re-developed state based upon future economic criteria.

Abstract: In one aspect, an example method includes (i) obtaining input data, wherein the input data includes story description text; (ii) providing the obtained input data to a narration model and responsively receiving generated narrative text; (iii) identifying, from among the generated narrative text, a subset of text; (iv) providing the identified subset of text to an image generation model and responsively receiving generated images; (v) providing the generated images to an animation model and responsively receiving generated video segments; (vi) providing the generated narrative text to a text-to-speech model and responsively receiving generated narrative speech; (vii) combining the generated video segments and the generated narrative speech to generate video content; and (viii) outputting for presentation, the generated video content.

Abstract: An offload server includes: an application code analysis section configured to analyze source code of an application; a data transfer designation section configured to, on the basis of a result of the code analysis, designate GPU processing for a loop statement by using at least one selected from the group of directive clauses, of OpenACC, consisting of a ‘kernels’ directive clause, a ‘parallel loop’ directive clause, and a ‘parallel loop vector’ directive clause; and a parallel processing designation section configured to identify loop statements in the application, and, for each of the identified loop statements, specify a statement specifying application of parallel processing by the GPU and perform compilation.

Abstract: A method of 3D motion reconstruction of outdoor, highly flexible moving subjects with multiple cameras on drones is described herein. A multi-drone capturing system is used to remove the restriction of a dedicated virtual reality shooting place, “the hot seat,” so that the actor/target is able to perform agile or long-distance activities outdoor. The subject's 3D pose parameters are estimated by the captured multi-view images by the drones, and the sequence of poses becomes the motion in time to control the animation of a pre-built 3D model. The method is able to be directly integrated into an existing Virtual Reality/Augmented reality (VR/AR) production chain, and the subject is able to be extended to animals that are difficult to be contained in a VR camera mesh space.