Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: Systems and methods are provided to aid in planning at least a portion of a total knee arthroplasty procedure. The system and method automatically aligns the implant components and the bones according to a desired clinical alignment goal with minimum user input. The system and method further allows the user to adjust the position and orientation of the femur, tibia, or implant in a clinical direction regardless of a pre-adjusted position and orientation of the femur, tibia, or implant. The graphical user interface is provided that includes a three-dimensional (3-D) view window, a view options window, a patient information window, an implant family window, a workflow-specific tasks window, and a limb and knee alignment measures window.

Abstract: Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (smart phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event.

Abstract: The technology described herein can be embodied in a method that includes obtaining a representation of a first image of a surgical scene using electromagnetic radiation of a first wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the first wavelength range received from a first tissue type is lower than that received for a second tissue type. The method also includes obtaining a representation of a second image using electromagnetic radiation of a second wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the second wavelength range received from the second tissue type is substantially different from that received for the first tissue type. The visual representation of the surgical scene is rendered on the one or more displays using the representation of the first image and the representation of the second image.

Abstract: In an example, a system is disclosed for registering an anatomical model to an anatomical structure of a patient. The system includes an anatomical measurement wire (“AMW”) configured to be navigated within the anatomical structure, the AMW comprising at least one sensor. A tracking system is configured to provide tracking data representing multiple positions of the sensor in a spatial coordinate system. A computing device is configured to generate a tracking point cloud based on the tracking data. The computing device is configured to register the predetermined anatomical model with the anatomical structure of the patient by matching the tracking point cloud with the model point cloud with respect to the predetermined anatomical model based on a quality metric.

Abstract: Described are improved systems and methods for navigation and manipulation of interactable objects in a 3D mixed reality environment. Improved systems and methods are provided to implement physical manipulation for creation and placement of interactable objects, such as browser windows and wall hangings. A method includes receiving data indicating a selection of an interactable object contained within a first prism at the start of a user interaction. The method also includes receiving data indicating an end of the user interaction with the interactable object. The method further includes receiving data indicating a physical movement of the user corresponding to removing the interactable object from the first prism between the start and the end of the user interaction. Moreover, the method includes creating a second prism to contain the data associated with the interactable object at the end of the user interaction with the interactable object.

Abstract: A method of generating an augmented reality lens comprises: causing to display a list of lens categories on a display screen of a client device; receiving a user choice from the displayed list; causing to prepopulate a lens features display on the display device based on the user choice, wherein each lens feature comprises image transformation data configured to modify or overlay video or image data; receiving a user selection of a lens feature from the prepopulated lens display; receiving a trigger selection that activates the lens feature to complete the lens; and saving the completed lens to a memory of a computer device.

Abstract: Disclosed is a mobile terminal that provides an augmented reality navigation screen in a state of being hold in a vehicle, the mobile terminal including: at least one camera configured to obtain a front image; a display; and at least one processor configured to calibrate the front image, and to drive an augmented reality navigation application so that the augmented reality navigation screen including at least one augmented reality (AR) graphic object and the calibrated front image is displayed on the display.

Abstract: Even under a situation where an object to be presented has movement, the object can be presented as display information in a more favorable mode.

Abstract: An imaging apparatus captures a rear area behind a vehicle and generates an image, and displays on the image at a position in the image corresponding to the position between the vehicle and a detection object a recognition image extending a predetermined distance in a height direction with respect to road surface and having transmittance that increases with height distance from the road surface. A display control apparatus simultaneously displays a bird's-eye view image of a vehicle, a rear area image behind the vehicle, and a guide image extending rearward and being spaced apart in the width direction of the vehicle, and displays an image on lower right or left of the bird's-eye view image based on a position of an obstacle existing on right or left rear side of the vehicle, and a second image on right edge or on left edge of the image outside the guide image.

Abstract: An example method includes obtaining, a virtual model of a portion of an anatomy of a patient obtained from a virtual surgical plan for an orthopedic joint repair surgical procedure to attach a prosthetic to the anatomy; identifying, based on data obtained by one or more sensors, positions of one or more physical markers positioned relative to the anatomy of the patient; and registering, based on the identified positions, the virtual model of the portion of the anatomy with a corresponding observed portion of the anatomy.

Abstract: A method of presenting media content is disclosed. A plurality of assets is received at a mobile device comprising a display and an orientation sensor. The plurality of assets comprises a first video asset associated with a first aspect ratio, and a second video asset associated with a second aspect ratio, different from the first aspect ratio. A desired aspect ratio is determined based on an output of the orientation sensor. In accordance with a determination that the desired aspect ratio is closer to the first aspect ratio than to the second aspect ratio, the first video asset is selected. In accordance with a determination that the desired aspect ratio is closer to the second aspect ratio than to the first aspect ratio, the second video asset is selected. The selected video is presented at the desired aspect ratio via the display.

Abstract: Systems and methods for virtual reality (VR) training of medical events are described herein. In one aspect, a method for generating a VR medical training environment can include displaying a medical event through a VR headset, receiving, from a user of the VR headset, a set of verbal responses corresponding to the user reacting to the medical event, determining a timestamp for at least one verbal response received from the user, determining a medical event score for the user based on the set of verbal responses and the timestamp, and displaying a summary of the medical event score via the VR headset or a display screen.

Abstract: A system for generating an image display comprising a digital camera for capturing digital images, a computer for automatically selecting a digital image template having a designated location for disposing one of the captured digital images, and the computer for selecting one of the captured digital images to be disposed therein, an electronic display for displaying the digital template with the captured digital image disposed in the designated location, and a transmission channel for transmitting to the electronic display the captured digital images.

Abstract: A surgical system includes an XR headset and an XR headset controller. The XR headset is configured to be worn by a user during a surgical procedure and includes a see-through display screen configured to display an XR image for viewing by the user. The XR headset controller is configured to receive a plurality of two-dimensional (“2D”) image data associated with an anatomical structure of a patient. The XR headset controller is further configured to generate a first 2D image from the plurality of 2D image data based on a pose of the XR headset. The XR headset controller is further configured to generate a second 2D image from the plurality of 2D image data based on the pose of the XR headset. The XR headset controller is further configured to generate the XR image by displaying the first 2D image in a field of view of a first eye of the user and displaying the second 2D image in a field of view of a second eye of the user.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising: receiving a monocular image that includes a depiction of a body of a user in a given pose; detecting a plurality of skeletal joints of the body depicted in the monocular image; generating an outline of the body of the user based on the plurality of skeletal joints; retrieving a mask that represents a target pose; comparing the outline of the body depicted in the monocular image with the mask that represents the target pose; and determining that the given pose of the body of the user matches the target pose in response to comparing the outline of the body with the mask.

Abstract: Provided are a display device and an operating method therefor. The display device include a user input interface configured to receive a signal from a remote control device, a wireless communication interface configured to receive image data from an external device and control data of the external device, a display configured to output a screen of the external device by using the received image data, and a controller configured to control the display to change a pointer display mode of the remote control device based on the control data of the external device received while outputting the screen of the external device.

Abstract: An embodiment of a graphics apparatus may include a context engine to determine contextual information, a recommendation engine communicatively coupled to the context engine to determine a recommendation based on the contextual information, and a configuration engine communicatively coupled to the recommendation engine to adjust a configuration of a graphics operation based on the recommendation. Other embodiments are disclosed and claimed.

Abstract: The disclosed wearable may include (1) a plurality of electrodes dimensioned to interface with a skin surface of a user of an artificial reality system, wherein the electrodes are spaced a known distance from one another, (2) a signal generator communicatively coupled to one of the electrodes, wherein the signal generator injects a test signal into the skin surface of the user via the one of the electrodes, (3) at least one sensor communicatively coupled to another one of the electrodes, wherein the sensor measures the test signal as received by the another one of the electrodes, and (4) at least one processing device communicatively coupled to the sensor, wherein the processing device determines a current impedance of the skin surface based at least in part on the known distance and the measurement of the test signal. Various other systems and methods are also disclosed.

Abstract: An example method includes registering, via a visualization device, a virtual model of a portion of an anatomy of an ankle of a patient to a corresponding portion of the anatomy of the ankle viewable via the visualization device, the virtual model obtained from a virtual surgical plan for an ankle arthroplasty procedure to attach a prosthetic to the anatomy. The example method also comprises displaying, via the visualization device and overlaid on the portion of the anatomy, a virtual guide that guides at least one of preparation of the anatomy for attachment of the prosthetic or attachment of the prosthetic to the anatomy.