Abstract: The invention is related to a method of presenting a digital information related to a real object, comprising determining a real object, providing a plurality of presentation modes, wherein the plurality of presentation modes comprises an augmented reality mode, and at least one of a virtual reality mode and an audio mode, providing at least one representation of a digital information related to the real object, determining a spatial relationship between a camera and a reference coordinate system under consideration of an image captured by the camera, selecting a presentation mode from the plurality of presentation modes according to the spatial relationship, and presenting the at least one representation of the digital information using the selected presentation mode.

Abstract: A scene update control method and apparatus, an electronic device, and a storage medium are provided. A scene is divided into a plurality of region blocks, each region block including a plurality of position coordinate pairs. A voxel file of a region block includes all voxels on the region block, and voxel files of the plurality of region blocks are stored on a magnetic disk according to an order in which the plurality of region blocks are to be updated in the scene. The voxel files of the plurality of region blocks are read from the magnetic disk and stored to a memory in advance. The scene is updated based on the voxel files of the plurality of region blocks from the memory.

Abstract: A method of automatically producing maps and measures that visualize and quantify placement and progress of construction elements, such as walls, ducts, etc. in images. From a set of images depicting a scene, element confidences per pixel in each of the images are produced using a classification model that assigns such confidences. Thereafter, element confidences for each respective one of a set of 3D points represented in the scene are determined by aggregating the per-pixel element confidences from corresponding pixels of each of the images that is known to observe the respective 3D points. These element confidences are then updated based on primitive templates representing element geometry to produce a 3D progress model of the scene.

Abstract: The point cloud scan image data first is structured with a x-y-z coordinate system, then split into smaller Cluster Bounds (CB) volumes and a CB x-y-z is imposed on the CB centroid. The Euclidean x-y-z distance (ED) is calculated for each data point. Only points within Radial Distance (RD cylinder) are retained/processed. Data points within RD are weighted; points closer to centroid having higher weights. Each data point has Weighted Value WV (square of the inverse of the x-y-z distance). Each x,y,z has Weighted Average (WAV) per axes. WAV is sum of each original point coordinate times WV, divided by sum all WVs. Resultant is one subsampled point per axis. One WAV per CB is selected based upon axis nearly orthogonal to x,y,z WAV points. All CBs subsampled in parallel. Subsampled output comma separated coordinate file for CAD program.

Abstract: Methods and systems are disclosed for performing operations for generating a custom sticker. The operations include receiving, by a messaging application implemented on a first device, an image. The operations include receiving, by the messaging application, input that selects a region of the image. The operations include generating, by the messaging application, a graphical element comprising the region of the image selected by the input. The operations include applying, by the messaging application, one or more visual effects to the graphical element. The operations include causing the graphical element to be animated according to a given animation pattern selected from a plurality of animation patterns to generate an animated custom graphic. The operations include sending the animated custom graphic with the one or more visual effects from the first device to a second device.

Abstract: A display in a commercial passenger vehicle can an option to be locked or unlock to enhance security. An example system for securing an in-vehicle entertainment (IVE) display in a commercial passenger vehicle comprises a mobile device and a computer. The mobile device comprises a first processor configured to secure a display located in the commercial passenger vehicle, where the first processor is configured to: obtain a payload; generate a first digitally signed payload as a first output of a first mathematical computation performed on the payload with a secret key; and send a first message comprising the first digitally signed payload and a lock command to instruct the display to lock the display. The computer is communicably coupled with the display and comprises a second processor configured to send a first instruction to cause the display to lock in response to a reception of the lock command.

Abstract: A talking head digital identity immutable dual authentication method for use over a distributed network, comprising: downloading talking head and talking head show files from nodes of a distributed network; downloading hash values of a talking head and talking head show from a blockchain; sending a hash of a publisher's identification from the blockchain to a name lookup service; retrieving and confirming the identity of the publisher from the name look up service; recalculating hash values of the talking head and talking head show; comparing the recalculated hash values of the talking head and talking head show with the hash values of the talking head and talking head show retrieved from the blockchain; starting playback of the talking head show if the hash values received from the blockchain match the recalculated hash values of the talking head and the talking head show retrieved from the nodes of the distributed network.

Abstract: One embodiment provides for a graphics processing unit comprising a processing cluster to perform multi-rate shading via coarse pixel shading and output shaded coarse pixels for processing by a post-shader pixel processing pipeline.

Abstract: Systems and methods for retrieval of augmented parameters for an artificial intelligence (AI)-based character are provided. An example method includes receiving, from a user via a user interface, at least one keyword describing the AI-based character; retrieving, from at least one data source and based on the at least one keyword, the augmented parameters describing the AI-based character; and generating, based on the augmented parameters, an AI-based character model corresponding to the AI-based character. The at least one data source includes a database configured to store records associated with the AI-based character, an online search service, and a set of clusters associated with a type of a feature of the AI-based character and at least one hidden prompt corresponding to the type of the feature. The type of the feature includes one of the following: a voice, a dialog style, an emotional state, an age, and temperament.

Abstract: Embodiments of the present disclosure provide a video processing method, a video processing apparatus, an electronic device and a computer-readable storage medium. The video processing method includes: displaying an initial image which includes a first-style image; in response to a first trigger event, displaying an image switching animation which is used for presenting a dynamic process of the switching from the initial image to a target image which includes a second-style image; and in response to completion of the displaying of the image switching animation, displaying the target image. A switching image in the image switching animation includes a first image area, a second image area and a third image area, and the first image area covers the entire image area of the image switching animation by means of position movement and in a time-sharing manner, and has a change in shape during a position movement process.

Abstract: Methods and systems are described. A system includes a redundant shader pipe array that performs rendering calculations on data provided thereto and a shader pipe array that includes a plurality of shader pipes, each of which performs rendering calculations on data provided thereto. The system also includes a circuit that identifies a defective shader pipe of the plurality of shader pipes in the shader pipe array. In response to identifying the defective shader pipe, the circuit generates a signal. The system also includes a redundant shader switch. The redundant shader switch receives the generated signal, and, in response to receiving the generated signal, transfers the data for the defective shader pipe to the redundant shader pipe array.

Abstract: Disclosed is a system for encoding and/or rendering animations without temporal or spatial restrictions. The system may encode an animation as a point cloud with first data points having a first time value and different positional and non-positional values, and second data points having a second time value and different positional and non-positional values. Rendering the animation may include generating and presenting a first image for the first time value of the animation based on the positional and non-positional values of the first data points, and generating and presenting a second image for the second time value of the animation by changing a visualization at a first position in the first image based on the positional values of a data point from the second data points corresponding to the first position and the data point non-positional values differing from the visualization.

Abstract: A computer-implemented method that allows users evaluate the densities of images and search for abnormalities in three-dimensional space. The voxel buildup uses a series of two-dimensional images and evaluates every pixel based on the user described predetermined threshold value at runtime. A singular optimized voxel-generated mesh is spawned to represent the combined locations of every pixel.

Abstract: Technologies for 3D virtual environment placement of 3D models based on 2D images are disclosed. At least an outline of a 3D virtual environment may be generated. A 2D image of one or more 2D images may be identified. A first product from the first 2D image may be identified. At least one 3D model of one or more 3D models based, at least, on the first product may be determined. A first location for placement of the first product in the 3D virtual environment may be identified. The at least one 3D model may be added within the 3D virtual environment based, at least, on the first location. The 3D virtual environment may be rendered into a visually interpretable form. A second product may be identified from the first 2D image, forming a first grouping of products. A starting element for the first grouping of products may be determined.

Abstract: Embodiments of the present disclosure provide a method for audio-driven character lip sync, a model for audio-driven character lip sync, and a training method therefor. A target dynamic image is obtained by acquiring a character image of a target character and speech for generating a target dynamic image, processing the character image and the speech as image-audio data that may be trained, respectively, and mixing the image-audio data with auxiliary data for training. When a large amount of sample data needs to be obtained for training in different scenarios, a video when another character speaks is used as an auxiliary video for processing, so as to obtain the auxiliary data. The auxiliary data, which replaces non-general sample data, and other data are input into a model in a preset ratio for training. The auxiliary data may improve a process of training a synthetic lip sync action of the model, so that there are no parts unrelated to the synthetic lip sync action during the training process.

Abstract: Systems and methods disclosed provided a virtual reality experience, including: a set of motorized pads for coupling to feet of a user; a means of communication between the set of motorized pads and a computing environment operating a virtual reality headset; such that the set of motorized pads are configured to provide pressure on a user's feet as an avatar within a virtual environment traverses the environment. Systems and methods disclosed further provide a multiuser virtual reality experience. Systems and methods disclosed further provide a multiuser experience including generation of a common environment viewable in the virtual reality headsets; and recording a tour including audio data as the first user describes the common environment.

Abstract: The technology described in this document can be embodied in a method of displaying images of portions of a human body on a display device. The method includes receiving a representation of a plurality of images that includes images of at least two different modalities, and location information corresponding to at least a subset of the plurality of images. A first image of a first modality is displayed on the display device in accordance with the corresponding location information. A second image of a second modality is overlaid on the first image in accordance with corresponding location information. At least a third image is overlaid on the first image in accordance with corresponding location information, the third image being of the second modality, and the second and third images being displayed concurrently for at least a period of time.

Abstract: A display method, a displaying device, electronic equipment and a storage medium. The display method comprises: acquiring menu data, target display position data of the menu data on a display screen, and source data, wherein the source data includes N channels of first display data, and the first display data has a preset size; conducting format conversion on the menu data to obtain M channels of second display data with a preset size; fusing the first display data with the second display data according to the target display position to obtain third display data; and displaying the third display data on the display screen.

Abstract: Systems and methods to improve machine learning by explicitly over-fitting environmental data obtained by an imaging system, such as a monocular camera are disclosed. The system includes training self-supervised depth and pose networks in monocular visual data collected from a certain area over multiple passes. Pose and depth networks may be trained by extracting data from multiple images of a single environment or trajectory, allowing the system to overfit the image data.

Abstract: Systems and methods disclosed provided a virtual reality experience, including: a set of motorized pads for coupling to feet of a user; a means of communication between the set of motorized pads and a computing environment operating a virtual reality headset; such that the set of motorized pads are configured to provide pressure on a user's feet as an avatar within a virtual environment traverses the environment. Systems and methods disclosed further provide a multiuser virtual reality experience. Systems and methods disclosed further provide a multiuser experience including generation of a common environment viewable in the virtual reality headsets; and recording a tour including audio data as the first user describes the common environment.