Abstract: Technology for augmenting reality using image matching is described. The technology can receive a captured image, determine location information relating to the received image, and transmit the location information to a server computing device. The technology may then receive one or more tags from the server computing device, wherein each tag can include one or more patches and supplementary information corresponding to at least one of the patches and each patch can be associated with the location information. The technology can then determine using an image matching process whether at least one of the received one or more patches appears in the received image, and if a patch appears in the received image, render the supplementary information corresponding to the patch.

Abstract: A surgical sheath for use in endoscopic trans-nasal or intra-ocular surgery has an angle section joined to a conical section, with the conical section having a central axis not parallel to a central axis of the angle section. A body section is joined to the angle section, with the body section having a length at least twice the length of the angle section. The conical section, the angle section and the body section may be a flexible or compliant material. The sheath reduces collateral trauma to the tissues in the surgical pathway.

Abstract: The present technology is directed to motion and video capture for tracking and evaluating robotic surgery. In one embodiment, the system includes at least one tracking device coupled to a remote surgical tool. The tracking device is configured to use one or more sensors to sense one or more physical variables such as movement and electrical contact. In some embodiments, the data from multiple individual sensors is synchronized, received, and stored by a digital information system. The digital information system is configured to analyze the data to objectively assess surgical skill.

Abstract: A surgical shield protects collateral soft tissue from damage during a trans-orbital surgical procedure in the head of a patient. The shield may be provided as an elongated flexible sheath having one or more thin flexible sidewalls that can conform to the tissue around or bearing on the shield. Other areas or sidewalls of the shield may be thicker to better resist perforation by surgical instruments, and/or to better maintain the access lumen of pathway to the surgical site.

Abstract: Technology for augmenting reality using image matching is described. The technology can receive a captured image, determine location information relating to the received image, and transmit the location information to a server computing device. The technology may then receive one or more tags from the server computing device, wherein each tag can include one or more patches and supplementary information corresponding to at least one of the patches and each patch can be associated with the location information. The technology can then determine using an image matching process whether at least one of the received one or more patches appears in the received image, and if a patch appears in the received image, render the supplementary information corresponding to the patch.

Abstract: A surgical sheath for use in endoscopic trans-nasal or intra-ocular surgery has an angle section joined to a conical section, with the conical section having a central axis not parallel to a central axis of the angle section. A body section is joined to the angle section, with the body section having a length at least twice the length of the angle section. The conical section, the angle section and the body section may be a flexible or compliant material. The sheath reduces collateral trauma to the tissues in the surgical pathway.

Abstract: Local surgical cockpits comprising local surgical consoles that can communicate with any desired remote surgical module (surgical robot), for example via a shared Transmission Control Protocol/Internet Protocol (TCP/IP) or other unified open source communication protocol or other suitable communication system. The systems and methods, etc., herein can also comprise a modular approach wherein multiple surgical consoles can network supporting collaborative surgery regardless of the physical location of the surgeons relative to each other and/or relative to the surgical site. Thus, for example, an operator operating a local surgical cockpit can teleoperate using a remote surgical module on a patient in the same room as the surgeon, or surgeons located in multiple safe locations can telemanipulate remote multiple surgical robots on a patient in or close to a war zone.

Abstract: Organization systems for surgical instruments input devices and associated methods and systems are disclosed herein. In one aspect, a surgical instrument input device organization system can include a first interface configured to receive input from a user and a second interface communicatively coupled to the first interface via a link. The second interface can include a module sized to receive a surgical input instrument device and an actuator configured to engage a movable surface of the surgical instrument input device in response to input received from the user at the first interface.

Abstract: Methods, articles of manufacture, and devices related to generating haptic feedback for point clouds are provided. A computing device receives depth data about an environment. The computing device generates a point cloud from the depth data. The computing device determines a haptic interface point (HIP). The computing device determines a haptic interface point (HIP). The computing device determines a force vector between the HIP and point cloud. The computing device sends an indication of haptic feedback based on the force vector.

Abstract: This document discusses, among other things, a mechanism for providing motion having two degrees of freedom and centered on a single point within a sphere. Methods to design the mechanism consistent with specified parameters are also described.

Abstract: An introducer and method provides a surgical tool with a pathway through tissue to a surgical site, wherein the surgical tool includes at least one surgical instrument. The introducer comprises a flexible sheath having a distal portion including a distal end and is arranged for receiving the surgical tool. A tissue separation tip at the distal portion of the sheath advances the sheath into the tissue towards the surgical site. The tissue separation tip is arranged to form a tissue gap and provide the at least one surgical instrument access to the tissue gap for performing a medical procedure consonant with the formation of the tissue gap or the performance of work at the surgical site.

Abstract: An introducer and method provides a surgical tool with a pathway through tissue to a surgical site, wherein the surgical tool includes at least one surgical instrument. The introducer comprises a flexible sheath having a distal portion including a distal end and is arranged for receiving the surgical tool. A tissue separation tip at the distal portion of the sheath advances the sheath into the tissue towards the surgical site. The tissue separation tip is arranged to form a tissue gap and provide the at least one surgical instrument access to the tissue gap for performing a medical procedure consonant with the formation of the tissue gap or the performance of work at the surgical site.

Abstract: The present technology is directed to motion and video capture for tracking and evaluating robotic surgery. In one embodiment, the system includes at least one tracking device coupled to a remote surgical tool. The tracking device is configured to use one or more sensors to sense one or more physical variables such as movement and electrical contact. In some embodiments, the data from multiple individual sensors is synchronized, received, and stored by a digital information system. The digital information system is configured to analyze the data to objectively assess surgical skill.

Abstract: A soft tissue protection surgical shield protects collateral soft tissue from damage during a surgical procedure within a surgical space of a body. The shield comprises an elongated flexible shield having a proximal end and a distal end. The proximal end has a first opening and the distal end has a second opening. The shield further comprises a side wall between the proximal and distal ends that defines the first and second openings. The side wall is conformal to the surgical space and arranged to resist perforation by surgical instruments in use during the surgical procedure, and also to define and maintain the access pathway to the surgical site.

Abstract: An introducer and method provides a surgical tool with a pathway through tissue to a surgical site, wherein the surgical tool includes at least one surgical instrument. The introducer comprises a flexible sheath having a distal portion including a distal end and is arranged for receiving the surgical tool. A tissue separation tip at the distal portion of the sheath advances the sheath into the tissue towards the surgical site. The tissue separation tip is arranged to form a tissue gap and provide the at least one surgical instrument access to the tissue gap for performing a medical procedure consonant with the formation of the tissue gap or the performance of work at the surgical site.

Abstract: Local surgical cockpits comprising local surgical consoles that can communicate with any desired remote surgical module (surgical robot), for example via a shared Transmission Control Protocol/Internet Protocol (TCP/IP) or other unified open source communication protocol or other suitable communication system. The systems and methods, etc., herein can also comprise a modular approach wherein multiple surgical consoles can network supporting collaborative surgery regardless of the physical location of the surgeons relative to each other and/or relative to the surgical site. Thus, for example, an operator operating a local surgical cockpit can teleoperate using a remote surgical module on a patient in the same room as the surgeon, or surgeons located in multiple safe locations can telemanipulate remote multiple surgical robots on a patient in or close to a war zone.

Abstract: A surgical device comprises an external sheath having a proximal end and a distal end for insertion through an opening of a body and a plurality of tool components extending from the distal end of the external sheath. The tool components are independently deflectable with respect to each other and with respect to the external sheath and removable from the device without requiring withdrawal of the sheath through the opening of the body. The external sheath is flexible and deflectable intermediate the distal and proximal ends. This permits the device to be steered in a curvilinear manner towards a surgical target.

Abstract: A collateral soft tissue protection surgical device protects collateral soft tissue from damage during a surgical procedure within a surgical space of a body. The device comprises an elongated flexible sheath having a proximal end and a distal end. The proximal end has a first opening and the distal end has a second opening. The sheath further comprises a side wall between the proximal and distal ends that defines the first and second openings. The side wall is conformal to the surgical space and arranged to resist perforation by surgical instruments in use during the surgical procedure, and also to define and maintain the access pathway to the surgical site.

Abstract: Technology for augmenting reality using image matching is described. The technology can receive a captured image, determine location information relating to the received image, and transmit the location information to a server computing device. The technology may then receive one or more tags from the server computing device, wherein each tag can include one or more patches and supplementary information corresponding to at least one of the patches and each patch can be associated with the location information. The technology can then determine using an image matching process whether at least one of the received one or more patches appears in the received image, and if a patch appears in the received image, render the supplementary information corresponding to the patch.

Abstract: Software tools, methods and apparatus for objectively assessing surgical and medical procedural skills are described. Data corresponding to performance of a manipulative task by a subject is modeled using Markov modeling techniques and compared with stored models corresponding to each of a plurality of proficiency levels. A particular proficiency level is selected based on proximity of the subject data relative to each of the stored models.