Abstract: One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: A surgical system includes a surgical tool, a tracking system configured to obtain tracking data indicative of positions of the surgical tool relative to an anatomical feature, an indicator light configured to emit light, and a computer system programmed to control the indicator light to change a color of the light based on the tracking data.

Abstract: A method for facilitating surgery using an augmented reality system, comprises retrieving patient data relating to a surgical procedure on a patient, generating virtual content comprising a virtual three-dimensional (3D) anatomical model based on the patient data, and displaying the virtual content, such that, when viewed by the first user, the virtual 3D anatomical model appears to be fixed at a physical location, whereby the virtual 3D anatomical model may be viewed by the first user from any angle or orientation merely by walking around the physical location.

Abstract: A method of generating resection data for use in planning an arthroplasty procedure on a patient bone covered at least partially in cartilage includes receiving a three-dimensional patient bone model comprising a bone model surface, and correlated with a position and orientation of the patient bone via a navigation system. The method further includes identifying a target region on the bone model surface of the model for intra-operative registration, and receiving location data for a first plurality of points based on the intra-operative registration of the cartilage on the patient bone in locations corresponding to points within the target region on the bone model surface. The method further includes determining resection depth based at least in part on the location data for the first plurality of points; and generating resection data using the resection depth, the resection data configured to be utilized by the navigation system during the arthroplasty procedure.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: Various methods and apparatus are described herein for enabling one or more users to interface with virtual or augmented reality environments. An example system includes a computing network having computer servers interconnected through high bandwidth interfaces to gateways for processing data and/or for enabling communication of data between the servers and one or more local user interface devices. The servers include memory, processing circuitry, and software for designing and/or controlling virtual worlds, as well as for storing and processing user data and data provided by other components of the system. One or more virtual worlds may be presented to a user through a user device for the user to experience and interact. A large number of users may each use a device to simultaneously interface with one or more digital worlds by using the device to observe and interact with each other and with objects produced within the digital worlds.

Abstract: A method includes generating an anatomical model corresponding to an anatomical feature of a patient, proposing a component for coupling to the anatomical feature of the patient, positioning a virtual model corresponding to the component in a proposed location relative to the anatomical model, generating a planned resection geometry based on a virtual relationship between the virtual model and the anatomical model, tracking movement of a surgical instrument relative to the anatomical feature, and simultaneously displaying the planned resection geometry, the anatomical model, and a graphic corresponding to the surgical instrument on a display based in part on the tracked movement of the surgical instrument relative to the anatomical feature.

Abstract: A system for verifying a tool for use in a surgical procedure includes a mechanical interface configured to be affixed to a portion of a patient's anatomy, wherein the mechanical interface comprises at least a first portion having a first diameter and a second portion having a second diameter. The system further includes a probe configured to be inserted into the mechanical interface to establish a checkpoint location, and a computing system configured to determine a location of a portion of the probe when the probe is inserted a maximum distance into the mechanical interface, wherein the location of the portion of the probe establishes the checkpoint location. The computing system is further configured to verify a surgical tool by comparing the checkpoint location to a location of a portion of the surgical tool when the surgical tool is inserted a maximum distance into the mechanical interface.

Abstract: A surgical system includes a robotic device configured to facilitate performance of a procedure and a computer system communicable with the robotic device. The computer system is programmed to associate a virtual object with an anatomical feature, adjust the virtual object associated with the anatomical feature in response to movement of the anatomical feature during the procedure by monitoring detected movement of the anatomical feature and adjusting the virtual object in response to the detected movement, and control the robotic device based on a relationship between at least one point associated with the robotic device and the virtual object during the procedure.

Abstract: A surgical system includes a surgical tool, a tracking system configured to obtain tracking data indicative of positions of the surgical tool relative to an anatomical feature, an acoustic device, and a computer system programmed to control the acoustic device to provide acoustic feedback to a user based on the tracking data.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: A method of retrieving data comprises receiving a user input in the form of a command, determining that the user input is a gesture, sending a request to a cloud server based on the determined gesture, receiving data from a knowledge base connected to the cloud server based on the request, and displaying virtual content at the user device based on the received data.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.

Abstract: Methods and systems are disclosed for presenting virtual objects on a limited number of depth planes using, e.g., an augmented reality display system. A farthest one of the depth planes is within a mismatch tolerance of optical infinity. The display system may switch the depth plane on which content is actively displayed, so that the content is displayed on the depth plane on which a user is fixating. The impact of errors in fixation tracking is addressed using partially overlapping depth planes. A fixation depth at which a user is fixating is determined and the display system determines whether to adjust selection of a selected depth plane at which a virtual object is presented. The determination may be based on whether the fixation depth falls within a depth overlap region of adjacent depth planes. The display system may switch the active depth plane depending upon whether the fixation depth falls outside the overlap region.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.