Abstract: A method designing computerized systems for a vehicle by a computing device comprising a processor and a memory device, and corresponding apparatus and computer program product, the method comprising: receiving indications to computerized components to be installed in a vehicle; displaying over a display device a three dimensional manipulatable model of the vehicle; receiving indications to locations within the car where the computerized components are to be installed, the indications provided as locations over the illustration; receiving indications to applications to be executed by a car computer, wherein the applications receive input from at least one of the computerized components; automatically determining the required computing resources and required utility components for supporting the computerized components and provisioning the applications; providing specific alternatives conforming with the computerized components; and receiving selections of specific computerized components from the specific alt

Abstract: Wearable systems for privacy preserving expression generation for augmented or virtual reality client applications. An example method includes receiving, by an expression manager configured to communicate expression information to client applications, a request from a client application for access to the expression information. The expression information reflects information derived from one or more sensors of the wearable system, with the client application being configured to present virtual content including an avatar rendered based on the expression information. A user interface is output for presentation which requests user authorization for the client application to access the expression information. In response to receiving user input indicating user authorization, enabling access to the expression information is enabled. The client application obtains periodic updates to the expression information, and the avatar is rendered based on the periodic updates.

Abstract: A computer-implemented method for generating a machine-learned model to generate facial position data based on audio data comprising training a conditional variational autoencoder having an encoder and decoder. The training comprises receiving a set of training data items, each training data item comprising a facial position descriptor and an audio descriptor; processing one or more of the training data items using the encoder to obtain distribution parameters; sampling a latent vector from a latent space distribution based on the distribution parameters; processing the latent vector and the audio descriptor using the decoder to obtain a facial position output; calculating a loss value based at least in part on a comparison of the facial position output and the facial position descriptor of at least one of the one or more training data items; and updating parameters of the conditional variational autoencoder based at least in part on the calculated loss value.

Abstract: A method may include obtaining a dataset including a target Action Unit (AU) combination and labeled images of the target AU combination with at least a first category of intensity for each AU of the target AU combination and a second category of intensity for each AU of the target AU combination. The method may also include determining that the first category of intensity for a first AU has a higher number of labeled images than the second category of intensity for the first AU, and based on the determination, identifying a number of new images to be synthesized in the second category of intensity for the first AU. The method may additionally include synthesizing the number of new images with the second category of intensity for the first AU, and adding the new images to the dataset.

Abstract: A method can include receiving a starting scene for display and an ending scene for display, the starting scene including at least a first graphical element in a first location and a second graphical element in a second location, the ending scene including at least the first graphical element in a third location and the second graphical element in a fourth location; generating multiple individual candidate animations based on the starting scene and the ending scene, each of the multiple candidate animations including display of the first graphical element transitioning from the first location to the second location and display of the second graphical element transitioning from the third location to the fourth location; for each of the multiple individual candidate animations, determining a score; selecting one of the individual candidate animations based on the determined scores for the individual candidate animations; and presenting the selected individual candidate animation.

Abstract: A mixed reality system is disclosed that displays 3D content in a container referred to as a “prism,” and also displays a related content item, such as an interactive menu for interacting with the 3D content. To maintain the content item accessible to the user, the system repositions the content item relative to the prism as the user moves relative to the prism. For example, in the context of an annotation toolbar, the system may move the toolbar from one surface of the prism to another in response to the user walking around the prism, entering the prism, or changing a head pose in the prism. In some embodiments, the content item is displayed in a reserved region in which the 3D content is not displayable, such that the 3D content does not interfere with the user's ability to view and access the content item.

Abstract: For displaying a window in an augmented reality view, a processor detects a new augmented reality placetime that includes a new augmented reality position and/or a new augmented reality time of an augmented reality device. The processor calculates new window characteristics for a window at the new augmented reality placetime based on previous window characteristics. The processor further displays the window with the new window characteristics.

Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.

Abstract: A method for simulating setting of a projector by augmented reality (AR) includes: activating an AR application on a terminal device; performing, through an image capturing element of the terminal device, dimension measurement on a space where a projector is to be disposed to obtain a space dimension; selecting a placement reference point of the projector and a display reference point of a projection picture; generating, according to the space dimension, the placement reference point, and the display reference point, a simulation picture on the terminal device when the projector projects the projection picture in the space; adjusting the projection picture and/or the projector in the simulation picture to generate an adjusted simulation picture; and comparing the adjusted simulation picture with projector parameter data of projector models to recommend at least one projector model to a user for selection or inputting, by the user, a custom projector model.

Abstract: Systems and methods for utilizing Augmented Reality (AR) processes to track cables among a tangled bundle of cables are provided. An AR method, according to one implementation, includes a step of obtaining an initial captured image showing a bundle of cables. The AR method also includes the step of processing the initial captured image to distinguish a selected cable from other cables of the bundle of cables. Also, the AR method includes displaying the initial captured image on a display screen while visually augmenting an image of the selected cable to highlight the selected cable with respect to the other cables.

Abstract: A method for inserting objects from a 2D image into another environment while keeping the spatial relationships of the objects in the 2D image intact is provided. A device comprising circuitry configured to carry out the method and a computer program product adapted to carry out the method are also provided.

Abstract: A computer-implemented method, including receiving, through an editor for designing augmented-reality effects, a plurality of shader programs each for an augmented-reality to be rendered for an augmented-reality effect; compiling each of the shader programs of augmented-reality object separately into corresponding shader modules; generate a merged shader module based on the shader modules; analyzing, according to one or more criteria, the merged shader module to identify fragment-shader instructions and vertex-shader instructions; splitting the merged shader module into a single fragment-shader module comprising the identified fragment-shader instructions and a single vertex-shader module comprising the identified vertex-shader instructions; and providing the single fragment-shader module and the single vertex-shader module to a graphics processing unit (GPU) to render the augmented-reality objects.

Abstract: Methods and systems for re-mastering animation files used in a video game includes identifying a rig used for representing a virtual character of the video game. Virtual markers are applied to the rig to generate a modified rig. Animation files for the virtual character are executed using the modified rig and a virtual camera is activated to capture images of the animation of the modified rig. Images of the modified rig are used to define performance data. The performance data is applied to a new rig of the virtual character to generate re-mastered animation files. The re-mastered animation files are used in the video game to generate gameplay data.

Abstract: Embodiments of the technology described herein, make unknown material-maps in a Physically Based Rendering (PBR) asset usable through an identification process that relies, at least in part, on image analysis. In addition, when a desired material-map type is completely missing from a PBR asset the technology described herein may generate a suitable synthetic material map for use in rendering. In one aspect, the correct map type is assigned using a machine classifier, such as a convolutional neural network, which analyzes image content of the unknown material map and produce a classification. The technology described herein also correlates material maps into material definitions using a combination of the material-map type and similarity analysis. The technology described herein may generate synthetic maps to be used in place of the missing material maps. The synthetic maps may be generated using a Generative Adversarial Network (GAN).

Abstract: The exemplary embodiments disclose a method, a computer program product, and a computer system for enhancing a user's appetite with one or more augmented reality devices. The exemplary embodiments may include collecting data of the user, the user's environment, and one or more consumable items, extracting one or more features from the collected data, determining one or more augmented reality appetite enhancements based on the extracted one or more features and one or more models, and enhancing the user's appetite by way of the one or more augmented reality devices according to the determined one or more augmented reality appetite enhancements.

Abstract: One aspect of the disclosure is a non-transitory computer-readable storage medium including program instructions. Operations performed by execution of the program instructions include obtaining an input image that depicts a face of a subject, having an initial facial expression and an initial pose, determining a reference shape description based on the input image, determining a target shape description based on the reference shape description, a facial expression difference, and a pose difference, generating a rendered target shape image using the target shape description, and generating an output image based on the input image and the rendered target shape using an image generator, wherein the output image is a simulated image of the subject of the input image that has a final expression that is based on the initial facial expression and the facial expression difference, and a final pose that is based on the initial pose and the pose difference.

Abstract: A data processing method is provided. In the method, a historical walk vertex adjacent to a target walk vertex is determined. An edge transition probability between the target walk vertex and each of a set of next possible vertexes in a first out-neighbor set is determined according to first out-edge information. A to-be-reached vertex of the set of next possible vertexes in the first out-neighbor set is determined according to the edge transition probabilities. Second out-edge information corresponding to the target walk vertex is generated based on the first out-neighbor set. Walking from the target walk vertex to the to-be-reached vertex is performed. The second out-edge information is transmitted to the to-be-reached vertex. Further, a random walk sequence corresponding to the target walk vertex is generated based on a walk quantity corresponding to the target walk vertex reaching a preset threshold for walk steps.

Abstract: In various example embodiments, a variational technique is provided for texturing a polygon mesh based on source images of a scene. The technique combines information from multiple source images to generate a texture map with patches that are the most similar to corresponding patches of the source images. The texture map may be the direct result of an optimization that jointly searches for the texture map and patch correspondence, which is initially unknown. The optimization may use a variational formulation that scores every possible texture map using an energy function that includes a matching term that quantifies how similar patches of the texture map are to the corresponding patches of the source images, and a regularization term that quantifies how complex the patch correspondence is.

Abstract: The present disclosure provides an image generating device configured to acquire an image captured by an imaging device to be installed in a water-surface movable body, place a virtual camera based on positional information and posture information, place additional display information as a 3D virtual reality object, place a virtual projection screen subdivided by a mesh distorted in the opposite direction of lens distortion in the captured image, convert vertexes of the virtual reality object and of the mesh faces by a vertex shader based on a position and a direction of the virtual camera into positions in a 2D virtual screen, place image pieces of the captured image to the corresponding mesh by a pixel shader based on the positions of the vertexes in the virtual screen, and generate a synthesized image where a graphic rendering the virtual reality object is synthesized with the captured image.

Abstract: Swimming pools can be visualized according to some aspects described herein. In one example, a system can receive a user selection of a particular liner from among a plurality of liner options for a virtual swimming pool. The system can generate a virtual swimming pool having the particular liner. The virtual swimming pool can be a three-dimensional (3D) rendering of a swimming pool with the particular liner. The system can then output the virtual swimming pool for display on a display device.