Abstract: Al-based systems and methods to annotate images and video from a surgical procedure may include extracting feature points (FP) from a still image (SI) of the procedure and each frame of a group of frames (GOF) from a procedure video and comparing FPs of the SI to FPs of each frame of the GOF to determine a match between the SI and a given frame from the video and a location in the video where the match occurred. Then the portion of the video containing the matched image is copied to create a video clip (VC) having a selected duration. Frames in the VC are analyzed to identify image features (IF), where a fidelity of IF identification is substantially unaffected when the IF is non-localizable or obscured. Then the SI and/or VC is annotated with information from the procedure, the information including or derived from the IFs.

Abstract: Various embodiments provide probes, systems and methods to assist an arthroscopic, endoscopic or other surgical procedure by the placement of digital landmarks in selected locations in a surgical field of view. Many embodiments utilize a specialized probe having a tip with a spherical or other selected geometry of known dimensions to assist with placement of the landmark. The probe is placed at a desired anatomical location and imaged by an arthroscopic/endoscopic video camera. Embodiments may use a deep learning network to analyze the image data encoded by the camera, identify the probe and generate a segmented outline. Then, computer vision/shape fitting algorithms are used to generate a refined outline of the probe wherein the dimensions of the probe tip are used to improve the accuracy of the image including the tip. The improved tip image accuracy in turn improves the accuracy of the placement of a landmark using the tip.

Abstract: Various embodiments of the invention provide systems and methods to assist or guide an arthroscopic surgery or other surgical procedure e.g., surgery of the shoulder, knee or hip. The method comprises steps of receiving an image from an interventional imaging device, identifying a feature in the image using an image recognition algorithm, overlaying the features on a video feed on a display device and making recommendations or suggestions to an operator based on the identified feature in the image.

Abstract: Various embodiments of the invention provide systems and methods to assist or guide an arthroscopic surgery (e.g., surgery of the shoulder, knee or hip) or other surgical procedure by the placement of arbitrary landmarks in one or more locations in surgical field of view. The systems and methods comprise steps of receiving a video stream from an arthroscopic or other imaging device; receiving one or more sets of coordinates of one or more landmarks; overlaying the one or more landmarks on the video stream; and displaying the overlay on one or more display devices intraoperatively so as to be used by an operator during the arthroscopic or other medical procedure.

Abstract: Various embodiments of the invention provide systems and methods to assist or guide an arthroscopic surgery (e.g., surgery of the shoulder, knee, hip or spine) or other surgical procedure by providing measurements intraoperatively. The systems and methods comprise steps of receiving a video stream from an arthroscopic imaging device; receiving one or more sets of coordinates of one or more points, paths, or area; calculating a length, a surface area, or a volume measurement based at least in part on the one or more sets of coordinates; overlaying the selected one or more sets of coordinates and the measurement on the video stream or on an expanded view of a region of surgery; and displaying the overlay on one or more display devices intraoperatively so as to be used by an operator during the arthroscopic procedure.

Abstract: A system and method for removing personally identifiable information (PII) from medical data and ensuring strict compliance with privacy laws and regulations. The PII removal tool removes, deletes or redacts sensitive personally identifiable information, which may comprise any health care data that may be linked to any individual. The system and method is preferably applied to medical data, images, video, or other electronic media captured from medical procedures, endoscopes, or arthroscopic surgery. Artificial intelligence powered software and models are applied to the medical data for the detection of PII comprising patient names, medical history, faces, account numbers, digital identities, biometric data, or other sensitive personal information which may be linked to an individual. Medical data is re-written without PII and the system generates metadata describing the deleted PII.

Abstract: A system and method for providing merchants and service providers automated identification of proximate clients to provide relevant client data and to authorize transactions. Whereupon a client is discreetly identified by the system through facial recognition, thumbprint, voice sample, iris scan, or other biometric sample. Multi-level authorization and authentication are provided using client metadata, such as email, phone number, mobile device, location, and payment information. The service provider is shown client preferences and transaction history in order to facilitate personalized service. The client is provided with relevant options for available goods or services as recommended by the system. The system provides client sentiment analysis to generate dynamic personalization, customer feedback, and intention projection. Service providers and merchants in the network are curated such that they may be presented to a customer in an orderly fashion.