Abstract: A medical image processing device a reference image that is a medical image with which boundary line information related to a boundary line that is a boundary between an abnormal region and a normal region and landmark information related to a landmark that is a characteristic structure of the subject are associated and a captured image that is the medical image captured in real time, detects the landmark from the captured image, calculates a ratio of match between the landmark included in the reference image and the landmark included in the captured image, estimates a correspondence relationship between the reference image and the captured image on the basis of the ratio of match and information regarding the landmarks included in the reference image and the captured image, and generates a superimposition image in which the boundary line associated with the reference image is superimposed on the captured image on the basis of the correspondence relationship.

Abstract: A method starts with a processor receiving, at a computing system from a client device, descriptive text data from a descriptive text interface displayed on the client device, the descriptive text data associated with a media content item displayed on the client device, analyzing the descriptive text data to identify at least one data characteristic within the descriptive text data, and accessing a plurality of personalized media overlay icons each comprising at least one media overlay icon characteristic. The processor determines whether the identified data characteristic is associated with any of the at least one media overlay icon characteristics of each of the plurality of personalized media overlay icons, generates a personalized overlay icon interface which includes a selection of the plurality of personalized media overlay icons that include at least one media content icon characteristic associated with the data characteristic.

Abstract: A wearable display system includes one or more emissive micro-displays, e.g., micro-LED displays. The micro-displays may be monochrome micro-displays or full-color micro-displays. The micro-displays may include arrays of light emitters. Light collimators may be utilized to narrow the angular emission profile of light emitted by the light emitters. Where a plurality of emissive micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, e.g., an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.

Abstract: In one embodiment, a method includes accessing multiple 3D photos to be concurrently displayed through multiple frames positioned in a virtual space, each of the of 3D photos having an optimal viewing point in the virtual space and determining a reference point based on a head pose of a viewer within the virtual space. The method may further include adjusting each 3D photo by rotating the 3D photo so that the optimal viewing point of the 3D photo points at the reference point, translating the rotated 3D photo toward the reference point, and non-uniformly scaling the rotated and translated 3D photo based on a scaling factor determined using the reference point and a position of the frame through which the 3D photo is to be viewed. The method may further include rendering an image comprising the adjusted multiple 3D photos as seen through the multiple frames.

Abstract: A method performed by a vehicle feature evaluation system for enabling evaluation of a simulated vehicle-related feature. The vehicle feature evaluation system determines in relation to a road-driven vehicle, with support from a tracking system, an orientation of a head-mounted display, HMD, adapted to be worn by an occupant on-board the road-driven vehicle or position and gaze direction of the occupant. The vehicle feature evaluation system further determines a simulated vehicle design feature to be evaluated in the road-driven vehicle.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: Examples of the disclosure describe systems and methods for presenting virtual content on a wearable head device. In some embodiments, a state of a wearable head device is determined by minimizing a total error based on a reduced weight associated with a reprojection error. A view reflecting the determined state of the wearable head device is presented via a display of the wearable head device. In some embodiments, a wearable head device calculates a preintegration term based on the image data received via a sensor of the wearable head device and the inertial data received via a first IMU and a second IMU of the wearable head device. The wearable head device estimates a position of the device based on the preintegration term, and the wearable head device presents the virtual content based on the position of the device.

Abstract: A computer system displays a first view of a three-dimensional environment, including a first user interface object having a first surface at a first position in the three-dimensional environment. While displaying the first view of the three-dimensional environment, the computer system detects a change in biometric data of a first user, and in response, changes an appearance of the first surface in the first user interface object in accordance with the change in biometric data of the first user. While displaying the first user interface object with the appearance that has been changed based on the change in the biometric data of the first user, the computer system detects first movement of the first user, and in response, changes the appearance of the first user interface object in accordance with the first movement of the first user.

Abstract: A system aligns a 3D model of an environment with image frames of the environment and generates a visualization interface that displays a portion of the 3D model and a corresponding image frame. The system receives LIDAR data collected in the environment and generates a 3D model based on the LIDAR data. For each image frame, the system aligns the image frame with the 3D model. After aligning the image frames with the 3D model, when the system presents a portion of the 3D model in an interface, it also presents an image frame that corresponds to the portion of the 3D model.

Abstract: An example computing system is configured to (i) receive a request to generate a cross-sectional view of a three-dimensional drawing file, where the cross-sectional view is based on a location of a cross-section line within the three-dimensional drawing file and includes an intersection of two meshes within the three-dimensional drawing file; (ii) generate the cross-sectional view of the three-dimensional drawing file; (iii) add, to the generated cross-sectional view, dimensioning information involving at least one of the two meshes; (iv) generate one or more controls for adjusting a location of the cross-section line within the three-dimensional drawing file; and (v) based on an input indicating a selection of the one or more controls, adjust the location of the cross-section line within the three-dimensional drawing file, update the cross-sectional view based on the adjusted location of the cross-section line, and update the dimensioning information to correspond to the updated cross-sectional view.

Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

Abstract: A system configured for full-body tracking with magnetic fields in virtual reality (“VR”) and augmented reality (“AR”) applications includes at least one tracker, at least one wearable article, and a computational device. Each of the at least one trackers hosts a joint sensor suite. The joint sensor suite is configured to track positions, orientations, and joint angles of a joint along a body. Each of the at least one trackers is configured to be attached to the body. Each of the at least one wearable articles is configured to enable one of the at least one trackers to be fastened to the joint along the body. The computational device is configured to capture real-time user generated movements via each of the at least one trackers and digitize user poses and body positions.

Abstract: An exemplary method includes a proximity detection system that accesses information associated with a virtual location marker positioned in relation to a geographic area. The information defines a location-based field of view (“LFOV”) that extends directionally from the virtual location marker. The proximity detection system further tracks a location of a mobile computing device at the geographic area and determines, based on the information associated with the virtual location marker and the location of the mobile computing device, that the mobile computing device has entered the LFOV that extends directionally from the virtual location marker.

Abstract: Methods, apparatuses, devices, and computer program products are disclosed for improved sanitization. An example device includes a sanitizing element that outputs a sanitizing agent. The device also includes a scanning device that generates scanning data of the physical form of the object. The device further includes a controller operatively coupled to the sanitizing element and the scanning device. The controller determines the output of the sanitizing agent during operation of the scanning device, receives the scanning data generated by the scanning device, and determines one or more areas of the object failing to receive sufficient contact with the sanitizing agent based upon the scanning data and sanitizing agent output.

Abstract: In an approach for creating synthetic visual inspection data sets for training an artificial intelligence computer vision deep learning model utilizing augmented reality, a processor enables a user to capture a plurality of images of an anchor object using a camera on a user computing device. A processor receives the plurality of images of the anchor object from the user. A processor generates a baseline model of an anchor object. A processor generates a training data set. A processor trains the baseline model of the anchor object. A processor creates a trained Artificial Intelligence (AI) computer vision deep learning model. A processor enables the user to interact with the trained AI computer vision deep learning model in an access mode.

Abstract: A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.

Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Abstract: An augmented reality (“AR”) device applies smooth correction methods to correct the location of the virtual objects presented to a user. The AR device may apply an angular threshold to determine whether a virtual object can be moved from an original location to a target location. An angular threshold is a maximum angle by which a line from the AR device to the virtual object can change within a timestep. Similarly, the AR device may apply a motion threshold, which is a maximum on the distance that a virtual object's location can be corrected based on the motion of the virtual object. Furthermore, the AR device may apply a pixel threshold to the correction of the virtual object's location. A pixel threshold is a maximum on the distance that a pixel projection of the virtual object can change based on the virtual object's change in location.

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, one or more environmental sensors, and a display. The method includes displaying computer-generated content on the display. The method includes determining a first positional value associated with a physical object, based on environmental data from the one or more environmental sensors. The method includes identifying a portion of the computer-generated content that satisfies an occlusion criterion with respect to a corresponding portion of the physical object, based on the first positional value. The method includes, in response to identifying that the occlusion criterion is satisfied, generating a mesh associated with the physical object based on the first positional value, and displaying the mesh on the display. The mesh overlaps with the portion of the computer-generated content.

Abstract: An example computing system is configured to (i) generate a cross-sectional view of a three-dimensional drawing file; (ii) receive a first user input indicating a selection of a first mesh, wherein the selection comprises a selection point that establishes a first end point; (iii) generate a first representation indicating an alignment of the first end point with at least one corresponding geometric feature of the first mesh and a second representation indicating a set of one or more directions; (iv) receive a second user input indicating a given direction; (v) based on receiving the second user input, generate a dynamic representation of the dimensioning information along the given direction; (vi) receive a third user input indicating that the second user input is complete; (vii) based on receiving the third user input, add the dimensioning information to the cross-sectional view between the first end point and the second end point.