Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.

Abstract: An example method includes displaying, via a visualization device and overlaid on a portion of an anatomy of a patient viewable via the visualization device, a virtual model of the portion of the anatomy obtained from a virtual surgical plan for an orthopedic joint repair surgical procedure to attach a prosthetic to the anatomy; and displaying, via the visualization device and overlaid on the portion of the anatomy, a virtual guide that guides at least one of preparation of the anatomy for attachment of the prosthetic or attachment of the prosthetic to the anatomy.

Abstract: Systems, apparatuses and methods may provide away to render augmented reality (AR) and/or virtual reality (VR) sensory enhancements using ray tracing. More particularly, systems, apparatuses and methods may provide a way to normalize environment information captured by multiple capture devices, and calculate, for an observer, the sound sources or sensed events vector paths. The systems, apparatuses and methods may detect and/or manage one or more capture devices and assign one or more the capture devices based on one or more conditions to provide observer an immersive VR/AR experience.

Abstract: Disclosed are various embodiments for selecting augmenting reality (AR) objects based on contextual cues associated with an image captured by a camera associated with electronic device. Contextual cues are obtained at an electronic device and AR objects are identified from a memory associated with the electronic device. The electronic device implements a processor employing image segmentation techniques to combine the identified AR objects with the captured image and render the combined image for display at a display associated with the electronic device.

Abstract: An information processing device is configured to acquire a position of the information processing device and a position of a base station device, and to control a viewing device based on the position of the information processing device and the position of the base station device such that a user visually recognizes an image superimposed on a real space and indicating presence of the base station device or the user visually recognizes a real space image in which a base station image indicating the presence of the base station device is included in an image indicating the real space or a virtual reality image in which the real space is reproduced.

Abstract: A display device includes: a display panel including: a first area defined by an area corresponding to an opening in the display panel, the first area configured not to display an image; and a display area surrounding the first area and configured to display an image; and a first electronic module disposed in the opening of a lower part of the display panel overlapping the first area, wherein the display device is configured to display a first boundary image in a part of the display area adjacent to a boundary between the first area and the display area, and wherein the display device is configured to provide predetermined information to a user through a combination of the first area and the first boundary image.

Abstract: A digital element located within a region near a device is identified. The digital element is located at a dynamically updated location. It is determined that the digital element is to be rendered. A representation of the digital element is generated in a rendered view of at least a portion of the region. Content of the digital element is provided upon receiving an indication that the digital element has been selected.

Abstract: A decade from now, a visit to the supermarket will be a very different experience than the familiar experiences of decades past. Product packaging will come alive with interactivity—each object a portal into a rich tapestry of experiences, with contributions authored by the product brand, by the store selling the product, and by other shoppers. The present technology concerns arrangements for authoring and delivering such experiences. A great variety of other features and technologies are also detailed.

Abstract: A system configured to present virtual content in an interactive space may comprise one or more of a light source, an optical element, one or more physical processors, non-transitory electronic storage, and/or other components.

Abstract: A system for modelling a portion of a patient includes a processing unit, a manipulator, a sensor, and a display device. The processing unit is configured to receive patient data and to process the patient data to generate a model of the portion of the patient. The sensor is configured to capture manipulator data. The processing unit is configured to receive the manipulator data from the sensor and to process the manipulator data to determine a position of the manipulator, an orientation of the manipulator, or both. The display device is configured to display the model on or in the manipulator.

Abstract: Methods, devices, and systems related to a computing device for capturing and displaying an augmented reality (AR) image are described. An example method can include capturing a first three-dimensional (3D) figure of a user at a mobile device. The method further includes accessing the first 3D figure of a user at the mobile device. The method further includes receiving, at the mobile device, a selection of a product to display on the 3D figure. The method further includes displaying, on the mobile device, the product to display on the first 3D figure as an augmented reality (AR) image.

Abstract: An image processing method and device is provided. The method includes: performing brightness adjustment on each frame of image in a video; performing offset compensation on each frame of image after the brightness adjustment; and performing time domain filtering on each frame of image after the offset compensation.

Abstract: Medical devices and related augmented reality systems and methods are provided. A method of operating an infusion device involves analyzing one or more images captured by an imaging device to identify image content indicative of an activity capable of influencing the physiological condition of the patient and in response to identifying the activity based at least in part on the one or more images, automatically adjusting delivery of the fluid to the patient based at least in part on the activity. An expected nutritional characteristic for a meal is determined based at least in part on the image content, and a delivery adjustment for delivering the fluid is determined based on the expected nutritional characteristic. A graphical indication of the delivery adjustment may also be provided using augmented reality.

Abstract: A platform comprises one or more sensors that collect information about an environment as sensor data. A processor is in communication with the one or more sensors, wherein the processor executes enhancement engines that processes the sensor data into enhanced characterization data having a reduced amount of data compared to the sensor data. An output device electronically communicate the enhanced characterization data to a user, wherein the sensor and the output device comprise an assisted perception module worn by the user during an incident. A command interface device remote from the user to enable a person of authority to manage the incident and the user by receiving and displaying the enhanced characterization data, and by transmitting data and commands back to the assisted perception module.

Abstract: The present disclosure provides systems and methods for calibration-free instant motion tracking useful, for example, for rending virtual content in augmented reality settings. In particular, a computing system can iteratively augment image frames that depict a scene to insert virtual content at an anchor region within the scene, including situations in which the anchor region moves relative to the scene. To do so, the computing system can estimate, for each of a number of sequential image frames: a rotation of an image capture system that captures the image frames; and a translation of the anchor region relative to an image capture system, thereby providing sufficient information to determine where and at what orientation to render the virtual content within the image frame.

Abstract: The present invention is a mixed-reality system including a server and a portable terminal device, the portable terminal device having a display for displaying a virtual object to a user present in a predetermined real space and having a photographing device that photographs the real space, the mixed-reality system serving to display, on the display, a mixed-reality image in which the virtual object is superimposed on a photographed image of the real space, wherein, at each of one or more predefined positions on a real object present in the predetermined space, an MR marker constituted of an identification code containing position information corresponding to that position and an alignment marker having a polygonal shape is disposed. The server includes a virtual-space-data storage unit and an application storage unit, and the portable terminal device includes a browser unit, a marker recognition unit, a position determination unit, and an image generation unit.

Abstract: A force measurement system and a motion base used therein is disclosed herein. The force measurement system includes a force measurement assembly configured to receive a subject, a motion base for displacing the force measurement assembly, and one or more data processing devices operatively coupled to the force measurement assembly and an actuation system of the motion base. The motion base includes a support structure; a displaceable carriage coupled to the force measurement assembly; and an actuation system, the actuation system including one or more actuators operatively coupling the displaceable carriage to the support structure, the one or more actuators configured to displace the displaceable carriage with the force measurement assembly relative to the support structure, the displaceable carriage being suspended below a portion of the support structure.

Abstract: Disclosed are techniques for modifying Augmented Reality (AR) device user interfaces to improve accessibility for individuals with tremors in their hands and/or fingers. A historical data set of finger movements is generated using circuitry printed onto fingernails of an individual. The historical data set is used to determine patterns for tremors in the fingers and hands of the individual. These patterns are then used to modify interactive elements of a user interface displayed by an AR device operated by the individual according to their individual pattern. Modifications to the interactive elements include modifying depth of the interactive elements to prevent unintended activation of the interactive elements through gesture-based controls resulting from the tremors.

Abstract: A number of illustrative variations may include a method of relative localization via the use of simultaneous location and mapping gear sets.

Abstract: Examples are disclosed that relate to providing information regarding nearby locations that may be familiar to a user to help inform the user of a current location within an area. One disclosed example provides a computing device comprising a display, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to form a list of familiar locations for a user based upon a user history regarding the familiar locations, determine that the user is within a threshold proximity to a nearby familiar location on the list of familiar locations, and in response, output directional information indicating a relative position of the nearby familiar location on the list of familiar locations.