Abstract: A surgical action to be performed during a surgical procedure is predicted using machine learning based on images and surgical instrumentation data. An image/video capture device such as an endoscope, a wearable camera, a stationary camera, etc., can be used to capture the image(s). A surgeon can be provided an augmented visualization of the surgical procedure by displaying one or more graphical overlays based on the findings of the machine learning to enhance the surgeon's information.

Abstract: An aspect includes a computer-implemented method that accesses input data including spatial data and/or sensor data temporally associated with a video stream of a surgical procedure. One or more machine-learning models predict a state of the surgical procedure based on the input data. The one or more machine-learning models detect one or more surgical instruments at least partially depicted in the video stream based on the input data. A state indicator and one or more surgical instrument indicators temporally correlated with the video stream are output.

Abstract: The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.

Abstract: The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.

Abstract: Techniques are described for improving computer-assisted surgical (CAS) systems, particularly, to recognize surgical phases in a video of a surgical procedure. A CAS system includes cameras that provide video stream of a surgical procedure. According to one or more aspects the surgical phases are automatically detected in the video stream using a machine learning model. Particularly, the machine learning model includes a boundary aware cascade stage network to perform surgical phase recognition.

Abstract: A computer implemented method is provided for a virtual training system. A virtual surgical simulation associated with a type of surgical procedure is accessed. Image data associated with a controller and a workspace is received. Controller data corresponding to a controller interaction is received. A first interaction of the controller within the workspace based on at least one of the image data and the controller data is determined. Using the set of one or more transformation rules, the first interaction of the controller is transformed to a manipulation of a virtualized surgical tool in the virtual surgical simulation. A representation is output of the manipulation of the virtualized surgical tool.

Abstract: The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.

Abstract: The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.

Abstract: The present disclosure relates to processing data streams from a surgical procedure using multiple interconnected data structures to generate and/or continuously update an electronic output. Each surgical data structure is used to determine a current node associated with a characteristic of a surgical procedure and present relevant metadata associated with the surgical procedure. Each surgical data structure includes at least one node interconnected to one or more nodes of another data structure. The interconnected nodes between one or more data structures includes relational metadata associated with the surgical procedure.

Abstract: The present disclosure relates to processing data streams from a surgical procedure using multiple interconnected data structures to generate and/or continuously update an electronic output. Each surgical data structure is used to determine a current node associated with a characteristic of a surgical procedure and present relevant metadata associated with the surgical procedure. Each surgical data structure includes at least one node interconnected to one or more nodes of another data structure. The interconnected nodes between one or more data structures includes relational metadata associated with the surgical procedure.

Abstract: The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.

Abstract: The present disclosure relates to systems and methods that use computer-vision processing systems to improve patient safety during surgical procedures. Computer-vision processing systems may train machine-learning models using machine-learning techniques. The machine-learning techniques can be executed to train the machine-learning models to recognize, classify, and interpret objects within a live video feed. Certain embodiments of the present disclosure can control (or facilitate control of) surgical tools during surgical procedures using the trained machine-learning models.

Abstract: The present disclosure relates to processing data streams from a surgical procedure using multiple interconnected data structures to generate and/or continuously update an electronic output. Each surgical data structure is used to determine a current node associated with a characteristic of a surgical procedure and present relevant metadata associated with the surgical procedure. Each surgical data structure includes at least one node interconnected to one or more nodes of another data structure. The interconnected nodes between one or more data structures includes relational metadata associated with the surgical procedure.

Abstract: A set of virtual images can be generated based on one or more real images and target rendering specifications, such that the set of virtual images correspond to (for example) different rendering specifications (or combinations thereof) than do the real images. An image style can be transferred to the at least some of the virtual images of the set of virtual images to generate a stylized virtual image. A machine-learning model can be trained using a plurality of stylized virtual images. Another real image can then be processed using the trained machine-learning model. The processing can include segmenting the other real image to detect whether and/or which objects are represented (and/or a state of the object). The object data can then be used to identify (for example) a state of a procedure.

Abstract: A computer implemented method is provided for a virtual training system. A virtual surgical simulation associated with a type of surgical procedure is accessed. Image data associated with a controller and a workspace is received. Controller data corresponding to a controller interaction is received. A first interaction of the controller within the workspace based on at least one of the image data and the controller data is determined. Using the set of one or more transformation rules, the first interaction of the controller is transformed to a manipulation of the virtualized surgical tool in the virtual surgical simulation. A representation is output of the manipulation of the virtualized surgical tool.

Abstract: The present disclosure relates to processing data streams from a surgical procedure using multiple interconnected data structures to generate and/or continuously update an electronic output. Each surgical data structure is used to determine a current node associated with a characteristic of a surgical procedure and present relevant metadata associated with the surgical procedure. Each surgical data structure includes at least one node interconnected to one or more nodes of another data structure. The interconnected nodes between one or more data structures includes relational metadata associated with the surgical procedure.

Abstract: A set of virtual images can be generated based on one or more real images and target rendering specifications, such that the set of virtual images correspond to (for example) different rendering specifications (or combinations thereof) than do the real images. An image style can be transferred to the at least some of the virtual images of the set of virtual images to generate a stylized virtual image. A machine-learning model can be trained using a plurality of stylized virtual images. Another real image can then be processed using the trained machine-learning model. The processing can include segmenting the other real image to detect whether and/or which objects are represented (and/or a state of the object). The object data can then be used to identify (for example) a state of a procedure.

Abstract: A set of virtual images can be generated based on one or more real images and target rendering specifications, such that the set of virtual images correspond to (for example) different rendering specifications (or combinations thereof) than do the real images. A machine-learning model can be trained using the set of virtual images. Another real image can then be processed using the trained machine-learning model. The processing can include segmenting the other real image to detect whether and/or which objects are represented (and/or a state of the object). The object data can then be used to identify (for example) a state of a procedure.

Abstract: A set of virtual images can be generated based on one or more real images and target rendering specifications, such that the set of virtual images correspond to (for example) different rendering specifications (or combinations thereof) than do the real images. A machine-learning model can be trained using the set of virtual images. Another real image can then be processed using the trained machine-learning model. The processing can include segmenting the other real image to detect whether and/or which objects are represented (and/or a state of the object). The object data can then be used to identify (for example) a state of a procedure.