Abstract: A system and methods for artificially intelligent medical procedure assessment and intervention are provided. A system may acquire image data from a camera targeting a location where healthcare is administered. The system may receive sensor data from a sensor attached to a care provider during performance of a procedure. The system may generate gesture features based on the sensor data. The system may generate image features based on the image data. The system may determine, based on the image features and a machine learning model, a step identifier for a step in a multi-step surgical procedure. The system may access text descriptive of an instruction to perform the step. The system may display the text on a display accessible to the care provider. The system may determine, based on the gesture information and a second machine learning model, a performance metric that measures performance of the care provider.