Abstract: Systems and methods for designing and implementing patient-specific surgical procedures and/or medical devices are disclosed. In some embodiments, a method includes receiving a patient data set of a patient. The patient data set is compared to a plurality of reference patient data sets, wherein each of the plurality of reference patient data sets is associated with a corresponding reference patient. A subset of the plurality of reference patient data sets is selected based, at least partly, on similarity to the patient data set and treatment outcome of the corresponding reference patient. Based on the selected subset, at least one surgical procedure or medical device design for treating the patient is generated.

Abstract: Methods, apparatuses, and systems for autonomous surgical robot evolution and handoff for manual operation are disclosed. A robotic surgical system performs surgery and is controlled jointly by an artificial intelligence (AI) and a surgeon. The surgeon can perform the entire surgery or can alternatively allow the AI to control the surgical robot to perform a part of or the entirety of the surgery. The AI is trained using data from previous surgeries, can provide indication to the surgeon when it has been sufficient trained to take over parts of a surgery, and can prompt the surgeon when there is insufficient training data for the AI to continue. Alternatively, a supervising surgeon can manually take back control of the surgical robot from the AI.

Abstract: Haptic feedback from a robotic surgical tool can be adjusted based on intra-operative assessment of the accuracy of a pre-operative surgical navigational plans. Navigational reference points are identified in at least one pre-operative image. At least one haptic response is identified for interactions between at least one robotic surgical tool and at least one navigational reference point. At least one intra-operative image is compared to the pre-operative image to determine the relative position of at least two corresponding navigational reference points in the images. The reference points' relative position determines a confidence level in the accuracy of the pre-operative navigational reference point. The haptic response is adjusted in timing, location, type, or amplitude based upon the confidence level. Tolerances and surgical navigation plan may also be updated and altered based on the confidence level.

Abstract: Methods, apparatuses, and systems for automated disease detection using multiple-wavelength imaging are disclosed. The disclosed system uses multiple imaging modalities for assessing a medical condition. Data collected from multiple cameras and imaging modalities is processed to identify common structures. The common structures are used to scale and align images, which are analyzed to detect one or more medical conditions. Each acquired image is assessed, and the resulting probabilities are consolidated. The images can be assessed together by using artificial intelligence and machine learning.

Abstract: Technologies for providing assistance to a surgeon during a surgical procedure are disclosed. An example method includes identifying a medical condition of a patient and recommending surgical procedures for treatment. An optimal surgical procedure is then determined based on correlations between the medical condition of the patient and outcomes of previous surgical procedures for other patients previously suffering from the medical condition. A 3D model of the patient may be created using current images of an affected area of the patient. Successively, a surgeon is trained using a Virtual Reality simulation. During the training, the surgeon may be allowed to provide annotations. Further, the recommended surgical procedures are based on medical data of the patient, including medical images.

Abstract: Methods, apparatuses, and systems for performing robotic joint arthroscopic surgery are disclosed. The disclosed systems use a surgical robot to perform robotic joint arthroscopic surgery for soft tissue. The disclosed systems enable a surgeon or physician to perform a virtual surgical procedure in a virtual environment, storing robotic movements, workflow objects, user inputs, or a description of tools used. The surgical robot filters the stored data to determine a surgical workflow from the stored data. The surgical robot displays information describing a surgical step in the surgical workflow, enabling the surgeon or physician to optionally adjust the surgical workflow. The surgical robot stores the optional adjustments and performs the surgical procedure on a patient by executing surgical actions of the surgical workflow.

Abstract: The present disclosure provides a method for a surgical robot with extended operational range in which a user inputs the surgical robot's movements and locations in a CAD environment through a surgical robot network and the surgical robot movements and locations are stored as a data file. The surgical robot network sends the surgical robot movements and locations data files to the surgical robot which extracts the data file containing the surgical robot movements and locations. The surgical robot then executes the data files containing the surgical robot movements and locations and sends a completion status of the movements and locations and the surgical robot executes a data file containing the robotic movements to perform aspects of the surgical procedure.

Abstract: Methods, apparatuses, and systems for performing robotic surgery in an extended-reality (XR) surgical simulation environment are disclosed. The disclosed systems provide a surgical metaverse in which a surgical robot network receives medical images of a patient. A digital twin is generated from the medical images that enables generation of a virtual surgical simulation environment for performing a surgical procedure. Necessary workflow objects for the procedure are selected and surgical actions are performed on the digital twin. Data of the workflow objects and actions in relation to the digital twin are stored. The surgical robot network generates a surgical workflow based on the workflow objects and actions and compares the surgical workflow to historical workflows to allow adjustment of the workflow in the surgical simulation virtual environment. The workflow, workflow objects, and actions in relation to the digital twin are sent to the surgical robot.

Abstract: Methods, apparatuses, and systems for digital image analysis for device navigation in tissue are disclosed. The disclosed system uses real-time angiography and artificial intelligence to navigate an end effector of a surgical robot through a patient's vasculature to provide a surgical intervention. Digital imaging is performed that enables three-dimensional mapping of the patient's vasculature. Locations and movement of the end effector of the surgical robot are determined. The end effector is used to perform an intervention such as the removal of a blood clot or delivery of a drug for dissolving a blood clot.

Abstract: Methods, apparatuses, and systems for performing a virtual reality based robotic telesurgical demonstration, training, and credentialing are disclosed. A user may select from a variety of procedure simulations and perform a surgical procedure in a virtual environment. A virtual reality surgical simulation allows the user to demonstrate, train, or earn credentials based upon the user's performance. The simulations may provide the user with points, rankings, rewards, or credentials, in which the user can track their performance and progression as well as practice or fine tune their skills in a safe environment.

Abstract: Methods, systems, and apparatus for surgical equipment monitoring are disclosed. In some embodiments, an electronic health records database and a database of surgical tools is provided. At least one sensor and at least one surgical tool are used before, during, or after a surgical procedure. The at least one sensor associated with the at least one surgical tool is monitored for at least one parameter. The monitored data is compared to the expected value of that parameter for the current step in the surgical procedure from the surgical tools database. In response to determining a potential surgical complication, the system generates a notification indicating the potential surgical complication.

Abstract: Methods, apparatuses, and systems for performing a virtual reality based robotic telesurgical demonstration, training, and credentialing are disclosed. A user may select from a variety of procedure simulations and perform a surgical procedure in a virtual environment. A virtual reality surgical simulation allows the user to demonstrate, train, or earn credentials based upon the user's performance. The simulations may provide the user with points, rankings, rewards, or credentials, in which the user can track their performance and progression as well as practice or fine tune their skills in a safe environment.

Abstract: Systems and methods for designing and implementing patient-specific surgical procedures and/or medical devices are disclosed. In some embodiments, a method includes receiving a patient data set of a patient. The patient data set is compared to a plurality of reference patient data sets, wherein each of the plurality of reference patient data sets is associated with a corresponding reference patient. A subset of the plurality of reference patient data sets is selected based, at least partly, on similarity to the patient data set and treatment outcome of the corresponding reference patient. Based on the selected subset, at least one surgical procedure or medical device design for treating the patient is generated.

Abstract: Systems and methods for designing and implementing patient-specific surgical procedures and/or medical devices are disclosed. In some embodiments, a method includes receiving a patient data set of a patient. The patient data set is compared to a plurality of reference patient data sets, wherein each of the plurality of reference patient data sets is associated with a corresponding reference patient. A subset of the plurality of reference patient data sets is selected based, at least partly, on similarity to the patient data set and treatment outcome of the corresponding reference patient. Based on the selected subset, at least one surgical procedure or medical device design for treating the patient is generated.

Abstract: The disclosed technology provides for printing a 3D structure in-situ within a patient during a surgical procedure. The disclosed technology can include generating instructions for a 3D printer of a surgical robot to print a structure within the patient's body, simulating and verifying the instructions, and autonomously or semi-autonomously executing the instructions, once verified, during a surgical procedure. Generating the instructions for printing the 3D structure within the patient can be based on image data of the patient. Generating the instructions can also include selecting substrate materials that are both safe for the patient and having desired properties of the final printed structure. Modifications can be made to the instructions based on results from the simulation. The disclosed technology provides for application of safe substrate material directly to hard and/or soft tissues within the patient's body via an additive manufacturing process, such as 3D printing.

Abstract: Methods, apparatuses, and systems for digital image analysis for device navigation in tissue are disclosed. The disclosed system uses real-time angiography and artificial intelligence to navigate an end effector of a surgical robot through a patient's vasculature to provide a surgical intervention. Digital imaging is performed that enables three-dimensional mapping of the patient's vasculature. Locations and movement of the end effector of the surgical robot are determined. The end effector is used to perform an intervention such as the removal of a blood clot or delivery of a drug for dissolving a blood clot.

Abstract: Systems and methods for assisting a surgeon with implant during a surgery are disclosed. A method includes defining areas of interest in diagnostic data of a patient and defining an implant type. Post defining the areas of interest, salient points are determined for the areas of interest. Successively, an XZ angle, an XY angle, and a position entry point for an implant are determined based on the salient points of the areas of interest. In spinal procedures, a maximum screw diameter and a length of the spinal screw are successively determined based on the salient points. Based on determined length and diameter, a spinal screw and a matching screw guide is determined. Thereafter, the spinal screw and the screw guide is printed using a Three-Dimensional (3D) printer. Such printed spinal screw and screw guide could be used by the surgeon during the spinal surgery.

Abstract: The present disclosure provides a method for a surgical robot with extended operational range in which a user inputs the surgical robot's movements and locations in a CAD environment through a surgical robot network and the surgical robot movements and locations are stored as a data file. The surgical robot network sends the surgical robot movements and locations data files to the surgical robot which extracts the data file containing the surgical robot movements and locations. The surgical robot then executes the data files containing the surgical robot movements and locations and sends a completion status of the movements and locations and the surgical robot executes a data file containing the robotic movements to perform aspects of the surgical procedure.

Abstract: Methods, apparatuses, and systems for performing robotic surgery in an extended-reality (XR) surgical simulation environment are disclosed. The disclosed systems provide a surgical metaverse in which a surgical robot network receives medical images of a patient. A digital twin is generated from the medical images that enables generation of a virtual surgical simulation environment for performing a surgical procedure. Necessary workflow objects for the procedure are selected and surgical actions are performed on the digital twin. Data of the workflow objects and actions in relation to the digital twin are stored. The surgical robot network generates a surgical workflow based on the workflow objects and actions and compares the surgical workflow to historical workflows to allow adjustment of the workflow in the surgical simulation virtual environment. The workflow, workflow objects, and actions in relation to the digital twin are sent to the surgical robot.

Abstract: Methods, apparatuses, and systems for transcribing and performing analysis on patient data are disclosed. Data is collected from one or more medical professionals as well as sensors and imaging devices positioned on or oriented towards a patient. An analysis is performed on the patient data and the data is presented to a medical professional via a verbal interface in a conversational manner, allowing the medical professional to provide additional data such as observations or instructions which may be used for further analysis or to perform actions related to the patient's care.