Abstract: Systems and methods provided for presenting supplemental content in an augmented reality environment where an object within a field of view of an augmented reality device of a user is identified and processed to detect a reference related to a participant in an event. A user profile or user social network is searched to identify a message from the user about the participant. The message may be combined with the object in the augmented reality field of view.

Abstract: A system for generating three-dimensional models of a physical environment such as a room. In some cases, the system may utilize a two-dimensional floor, room, or house plan to generate, close and/or orthogonalize wall segments. The system may then generate a three-dimensional model by projecting the wall segments into a three-dimensional space and inserting objects.

Abstract: Disclosed are example embodiments of systems and methods for virtual try-on of articles of clothing. An example method of virtual try-on of articles of clothing includes selecting a garment from a pre-existing database. The method also includes loading a photo of a source model wearing the selected garment. Additionally, the method includes generating a semantic segmentation of the model image. The method also includes extracting the selected garment from the photo of the model. Additionally, the method includes determining a correspondence between a target model and the source model by performing a feature point detection and description of the target model and the source model, and performing feature matching and correspondence validation. The method also includes performing garment warping and alignment of the extracted garment. Additionally, the method includes overlaying and rendering the garment.

Abstract: Systems, apparatuses (or devices), methods, and computer-readable media are provided for generating virtual content. For example, a device (e.g., an extended reality device) can obtain an image of a scene of a real-world environment, wherein the real-world environment is viewable through a display of the extended reality device as virtual content is displayed by the display. The device can detect at least a part of a physical hand of a user in the image. The device can generate a virtual keyboard based on detecting at least the part of the physical hand. The device can determine a position for the virtual keyboard on the display of the extended reality device relative to at least the part of the physical hand. The device can display the virtual keyboard at the position on the display.

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

Abstract: There is provided a method of discrete optimisation comprising: receiving an optimisation objective function; performing a continuous optimisation based upon the optimisation objective function to generate an initial continuous value; generating a plurality of candidate discrete values based upon the initial continuous value; evaluating the plurality of candidate discrete values based upon the optimisation objective function, wherein the evaluation of the plurality of candidate discrete values is carried out in parallel; and outputting a candidate discrete value based upon the evaluation.

Abstract: This specification describes systems and methods for refining point cloud data. Methods can include receiving point cloud data for a physical space, iteratively selecting points along an x, y, and z dimension, clustering the selected points into 2D histograms, determining a slope value for each 2D histogram, and removing, based on the slope value exceeding a predetermined value, points from the point cloud data. Methods can also include iteratively voxelizing each 2D histogram into predetermined mesh sizes, summating points in each voxelized 2D histogram, removing, based on determining the summation is below a predetermined sum value, points from the point cloud data, keeping, based on determining that a number of points in each voxelized 2D histogram exceeds a threshold value, a center point, selecting, for each histogram, a point, identifying, nearest neighbors in the point cloud data, removing the identified nearest neighbors from the data, and returning remaining points.

Abstract: The subject technology receives at least one signal from a computing device, the at least one signal comprising at least one of a current time, battery power, sensor information, or location information. The subject technology generates a digital sticker, the digital sticker including graphical content indicating information based at least in part based on the at least one signal and media content including an image of a target face, the image of the target face being modified based on at least one of sets of source pose parameters to mimic at least one of positions of a head of a source actor and at least one of facial expressions of the source actor. The subject technology provides augmented reality content for display on a computing device, the augmented reality content including the digital sticker as an overlay on at least a portion of the augmented reality content.

Abstract: An electronic device is provided. The electronic device includes a sensor module, a communication module, a display, a memory, and at least one processor configured to identify a plurality of states based on at least one of information obtained through the sensor module, information received from an external electronic device through the communication module, or information associated with a function of the electronic device, identify priorities of the plurality of states, identify a first state among the plurality of states based on the identified priorities, identify whether there is a second state mergeable with the first state, and control the display to display, a first character object corresponding to the first state or a third character object corresponding to merge of the first state and the second state, based on whether there is the second state mergeable with the first state.

Abstract: Systems and methods for continuously updating emotional states of artificial intelligence (AI) characters using emotional state models are provided. An example method includes providing an emotional state model trained to predict an emotional state of an AI character generated by an AI character model in a virtual environment; continuously monitoring a context of an interaction involving the AI character; generating, based on the context, an input for the emotional state model; providing the input to the emotional state model; obtaining, from the emotional state model, the emotional state of the AI character based on the input; and adjusting, based on the emotional state, parameters of the AI character model, thereby causing the AI character to act according to the emotional state.

Abstract: A technology is described for using a medical implement or a fluoroscopic image with reference to an image data set and a body of a person. A method may include detecting visual image data of a body of a patient and a medical implement. The optical codes on the body of the patient and on the medical implement may be identified. One operation is aligning the image data set with the body of the person using one or more optical codes on the body of the person and the fixed position of an image visible marker with respect to the optical code. A position of the medical implement with respect to the body of the person may be determined using one or more optical codes on the medical implement and the body of the person to reference the medical implement to the image data set and the body of the person.

Abstract: A prediction device f includes an acquisition unit and a prediction unit. The acquisition unit is configured to acquire attribute data pertaining to the plurality of exhibits and the number of visitors to each of the plurality of exhibits during a first period in the display area in which the plurality of exhibition articles are exhibited. The prediction unit is configured to predict a future flow of persons to the plurality of exhibits by a prediction model. The prediction model is generated using attribute data for a second period that is a period previous to the first period, graph time-series data pertaining to a change over time in a movement pattern for each of the plurality of visitors to the plurality of exhibits during the second period, the number of visitors to the exhibits, and the number of visitors to each of the plurality of exhibits.

Abstract: A method includes extracting, using a backbone of a machine learning model, a plurality of features from an image of a foot and predicting, using a first portion of the machine learning model and based on one or more features of the plurality of features, a first aspect of the foot. The method also includes predicting, using a second portion of the machine learning model and based on one or more features of the plurality of features, a second aspect of the foot different from the first aspect, generating, using at least the first aspect and the second aspect, a two-dimensional model of a shoe, and superimposing the two-dimensional model of the shoe onto the image of the foot.

Abstract: Various implementations disclosed herein include devices, systems, and methods that present a view of a device user's face portion, that would otherwise be blocked by an electronic device positioned in front of the face, on an outward-facing display of the user's device. The view of the user's face portion may be configured to enable observers to see the user's eyes and facial expressions as if they were seeing through a clear device at the user's actual eyes and facial expressions. Various techniques are used to provide views of the user's face that are realistic, that show the user's current facial appearance, and/or that present the face portion with 3D spatial accuracy, e.g., each eye appearing to be in its actual 3D position. Some implementations combine live data with previously-obtained data, e.g., combining live data with enrollment data.

Abstract: An intelligent simulation system for jacket towing system includes a distributed collaborative simulation subsystem configured to provide a communication interface for each subsystem, a comprehensive management and evaluation subsystem configured to generate and issue a simulation subject, an operation control simulation subsystem configured to generate operation instructions, a motion simulation subsystem configured to receive parameters of the subject and the operation instructions, simulate a motion state of the jacket, a tugboat and a towrope in real time, and transmit the simulated motion states to the visual simulation subsystem, and a visual simulation subsystem configured to perform a three-dimensional display for the real-time simulation of the motion states of the jacket, the tugboat and the towrope.

Abstract: In one embodiment, a method includes rendering a first output image comprising one or more augmented-reality (AR) objects for displays of an AR rendering device of an AR system associated with a first user. The method further includes accessing sensor signals associated with the first user. The one or more sensor signals may be captured by sensors of the AR system. The method further includes detecting a change in a context of the first user with respect to a real-world environment based on the sensor signals. The method further includes rendering a second output image comprising the AR objects for the displays of the AR rendering device. One or more of the AR objects may be adapted based on the detected change in the context of the first user.

Abstract: A display device according to an embodiment may include a controller and a display unit. The controller may perform tone mapping for adjusting luminance of input image data, and the display unit may display an image according to output image data whose luminance is adjusted by the tone mapping. The controller may generate a base mapping curve for an entire region from the input image data, extract information for each local region of the entire region, and generate a local mapping curve reflecting the information for each local region with respect to each local region to perform tone mapping.

Abstract: Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.

Abstract: A method performed by a computer is disclosed. The method comprises receiving color data for input pixels of an input image and an input set of features used to render the input image of a three-dimensional animation environment, wherein the input pixels are of a first resolution. The computer may then load into memory a generator of a generative adversarial network including a neural network used to scale the input image, the neural network trained using training data comprising color data of training input images and training output images and a training set of the features used to render the training input images. After the generator is loaded into memory, the computer may generate an output image having a second resolution that is different than the first resolution by passing the color data and the input set of features through the generator.

Abstract: According to an example method, a system receives first data representing a polygon mesh. The polygon mesh includes a plurality of interconnected vertices forming a plurality of triangles. The system generates second data representing the polygon mesh. Generating the second data includes traversing the vertices of the polygon mesh according to a traversal order, partitioning the plurality of triangles into a set of ordered triangle groups in accordance with the traversal order, and encoding, in the second data, the set of ordered triangle groups. The system outputs the second data. A position each of the vertices in the transversal order is determined based on (i) a number of previously encoded triangles that are incident to that vertex, and/or (ii) a sum of one or more angles formed by the previously encoded triangles that are incident to that vertex.