Abstract: A method for image generation, preferably including: generating a set of mission parameters for a UAV mission of the UAV associated with aerial scanning of a region of interest; controlling the UAV to perform the mission; generating an image subassembly corresponding to the mission; and/or rendering the image subassembly at a display.

Abstract: In some embodiments, an electronic device concurrently presents a navigation user interface element with a respective physical location designated and a content element including content corresponding to the respective physical location. In some embodiments, an electronic device presents navigation from a first physical location to a second physical location with reduced visual prominence in a content element in response to an input corresponding to a request to present content corresponding to the second physical location.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating digital chain pull paintings in digital images. The disclosed system generate, utilizing a neural network, a plurality of matrices over an ambient space for a plurality of polygons of a three-dimensional mesh based on a plurality of features of the plurality of polygons associated with the three-dimensional mesh. The disclosed system determines a gradient field based on the plurality of matrices of the plurality of polygons. The disclosed system generates a mapping for the three-dimensional mesh based on the gradient field and a differential operator corresponding to the three-dimensional mesh.

Abstract: A method to enhance security screening includes generating an augmented reality (AR) interface incorporating scan results from scanning a target in a security scanner. The method displays, to a user of an AR interface, the AR interface mapped to the target and determines guidance including an action relevant to addressing the scan results. The method displays, to the user via the AR interface, the guidance including the action for the user to carry out and monitors user actions. The method displays, to the user via the AR interface, confirmation that the user has carried out the action.

Abstract: A computing device for supporting an Augmented-Reality (AR) software application is provided. The computing device is operative to select a physical location for placing a current virtual object, where the current virtual object appears to be placed when overlaid onto a video sequence capturing a physical scene in the surroundings of a user, based on an expected physical location which the user assumes in response to displaying the physical scene and the overlaid current virtual object to the user, and an attribute which is spatially dependent and which has an impact on a user experience of the AR software application. Taking the spatially-dependent attribute at the expected physical location of the user into consideration in selecting physical locations for placing virtual objects is advantageous in that virtual objects may be deployed at physical locations so as to provide an improved, or at least satisfactory, user experience to the users.

Abstract: Systems and methods for dynamically controlling a knowledge scope of artificial intelligence (AI) characters are provided. An example method includes associating a knowledge store with an AI character generated by an AI character model, where the AI character is a virtual character in a virtual world; determining context parameters for the AI character; defining, based on the context parameters, a scope of knowledge available to the AI character from a knowledge store; constricting access of the AI character to the knowledge store based on the defined scope of knowledge; monitoring changes in the context parameters; and dynamically adjusting the scope of knowledge based on the changes in the context parameters.

Abstract: The subject technology selects a set of augmented reality content generators from a plurality of augmented reality content generators. The subject technology causes display, at a client device, of a graphical interface comprising a plurality of selectable graphical items. The subject technology receives, at the client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, at least one augmented content reality item generated by the first augmented reality content generator.

Abstract: Methods and systems are disclosed for performing generating AR experiences on a messaging platform. The methods and systems perform operations including: receiving, from a client device, a request to access an augmented reality (AR) experience; adding one or more AR elements to a first image captured by the client device, the first image depicting a real-world object; storing data representing a position of the one or more AR elements relative to the real-world object, the data being maintained after the AR experience is terminated; receiving a request to resume the AR experience after the AR experience has been terminated; and in response to receiving the request to resume the AR experience, accessing the data that was stored prior to termination of the AR experience to generate a display of the AR experience that depicts the one or more AR elements at a particular position within a second image.

Abstract: A method of extracting and displaying postural measurements from patient data includes retrieving, by a processor of a computing device, the patient data from memory. The patient data includes a geometric mesh representation of a patient, including a plurality of data points corresponding to spatial coordinates of a plurality of vertices in three dimensions. The method also includes determining, by the processor, a reference geometry along the geometric mesh representation in a fixed position with respect to the spatial coordinates; determining, by the processor, a landmark corresponding to one of skeletal or soft tissue anatomy for the patient; and determining, by the processor, a postural deviation of a body portion of the patient by comparing the reference geometry and the landmark. The method further includes displaying, by a display of the computing device, a graphical user interface indicating a characteristic related to the postural deviation.

Abstract: An electronic device and method for rendering a virtual world for facilitating transactions between users is provided. The electronic device controls a display device to render a virtual world with a set of virtual elements to represent a set of real-world locations of a geographical area. The electronic device selects a virtual element from the set of virtual elements and further controls the display device based on the selection to render a set of objects inside the virtual world. The set of objects represents a set of offerings that is transactable and available with a seller associated the selected virtual element. The electronic device receives a selection of an object of the set of objects and executes, for the object in the received selection, a transaction between the seller and a customer associated with the electronic device.

Abstract: Systems, methods, and apparatus are provided for intelligent dynamic rendering of an augmented reality (AR) display. An AR device may capture an image of a physical environment. Feature extraction combined with deep learning may be used for object recognition and detection of changes in the environment. Contextual analysis of the environment based on the deep learning outputs may enable improved integration of AR rendering with the physical environment in real time. A BLE beacon feed may provide supplemental information regarding the physical environment. The beacon feed may be extracted, classified, and labeled based on user interests using machine learning algorithms. The beacon feed may be paired with the AR advice to incorporate customized location-based graphics and text into the AR display.

Abstract: A control system for construction machinery includes an upper camera installed in a driver cabin of a rear vehicle body to photograph the front of the driver cabin, a lower camera installed in a front vehicle body rotatably connected to the rear vehicle body to photograph the front of the front vehicle body, an angle information detection portion configured to detect information on a refraction angle of the front vehicle body with respect to the rear vehicle body, an image processing device configured to synthesize first and second images captured from the upper and lower cameras, and configured to determine a position of a transparency processing area in the synthesized image according to the refraction angle information and transparency-process at least one of the first and second images in the transparency processing area, and a display device configured to display the synthesized image transparency-processed by the image processing device.

Abstract: A method for AR-guided depth estimation is described. The method includes identifying a virtual object rendered in a first frame that is generated based on a first pose of an augmented reality (AR) device, determining a second pose of the AR device, the second pose following the first pose, identifying an augmentation area in the second frame based on the virtual object rendered in the first frame, and the second pose, determining depth information for the augmentation area in the second frame, and rendering the virtual object in the second frame based on the depth information.

Abstract: A method and system creates a spatial, multi-dimensional presentation file (i.e., a VR file) from a two-dimensional (2D) presentation file. The system may include a server to receive the 2D file and identify axis points in the 2D file. The one or more axis points and supplemental information related to one or more of the axis points are provided to a VR conversion engine. The VR conversion engine creates a VR file that includes the 2D file and supplemental information relating to the one or more axis points.

Abstract: Described herein are technologies for generating and providing a virtual experience. The virtual experience includes digital elements that are generated and provided according to settings as well as user feedback and feedback from sensors in an environment that is being represented by the virtual experience. The virtual experience includes a real world image of the environment and virtual objects overlapping the real world image.

Abstract: An improved human-computer interface (“HCI”) is disclosed herein for viewing a three-dimensional (“3D”) representation of a real-world environment from different, changing, and/or multiple perspectives. An AR device may capture, in real-time, a 3D representation of a scene using a surface reconstruction (“SR”) camera and a traditional Red Green & Blue (“RGB”) camera. The 3D representation may be transmitted to and viewed on a user's computing device, enabling the user to navigate the 3D representation. The user may view the 3D representation in a free-third-person mode, enabling the user to virtually walk or fly through the representation captured by the AR device. The user may also select a floor plan mode for a top-down or isomorphic perspective. Enabling a user to view a scene from different perspectives enhances understanding, speeds trouble-shooting, and fundamentally improves the capability of the computing device, the AR device, and the combination thereof.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying object names in association with augmented reality content. The program and method provide for receiving, by a messaging application running on a device, a first request to identify plural objects based on an image captured by a camera of the device; identifying, in response to receiving the first request, the plural objects based on the image; for each of the plural objects, determining at least one attribute of the object, and calculating a number of augmented reality content items, from plural augmented reality content items, corresponding to the at least one attribute of the object; selecting, from the plural objects, an object with a largest calculated number of corresponding augmented reality content items; and displaying a name for each of the plural objects based on the selecting.

Abstract: A processor for an endoscope includes: an endoscopic image acquisition unit that acquires an endoscopic image of a patient from the endoscope; a virtual endoscopic image acquisition unit that acquires a virtual endoscopic image reconstructed on the basis of a three-dimensional medical image obtained by capturing an image of the patient in advance; a virtual endoscopic image reconstruction unit that reconstructs a corrected virtual endoscopic image that matches most with the endoscopic image on the basis of the degree of matching between the virtual endoscopic image and the endoscopic image; and a diagnosis support information output unit that outputs diagnosis support information based on a feature parameter corrected according to a correspondence between each pixel of the endoscopic image and a distance image obtained from the corrected virtual endoscopic image.

Abstract: A mixed reality space sharing system is provided with which 3D information regarding a target real space can be shared between a plurality of MR terminals while keeping the information updated, without spending a long processing time. A shared information management server includes an information management unit for creating a room by associating, with each other, 3D information and anchor information that are transmitted from a first terminal, which is at least one of a plurality of mixed reality terminals, and managing the 3D information, and a sharing unit for transmitting the 3D information and the anchor information to a second terminal different from the first terminal. The second terminal downloads the 3D information and the anchor information transmitted from the shared information management server and creates a mixed reality space using the downloaded information.

Abstract: Content is displayed to a user of augmented reality device. In response to receiving an indication of an increased level of risk, the degree of content being displayed to the user is reduced. The indication of increased level of risk may be generated by or received from an associated transportation device. The adjustment of the display of the degree of content may include moving one or more content elements out of a central field of view of the augmented reality device, reducing the size or visual characteristics of a content element, or eliminating a content element from the display.