Abstract: Apparatus and associated methods relate to invoking an alert based upon a behavior of a patient as determined by a machine-learning model operating on a video stream of the patient. Video data, audio data, and semantic text data are extracted from a video stream of the patient. The video data are analyzed to identify first, second, and third features sets of video, audio, and semantic text features, respectively, which have been identified by a computer-implemented machine-learning engine as being indicative of at least one of a set of alerting behaviors corresponding to a patient classification of the patient. Using a computer-implemented machine-learning model, a patient behavior of the patient is determined based on the first, second, and/or third features sets. The patient's behavior is compared with the set of alerting behaviors, and, when the patient's behavior is determined to be included therein, the alert is automatically invoked.

Abstract: Apparatus and associated methods relate to predicting a health outcome of a patient by a machine learning model operating on a video stream of the patient. Video data, audio data, and semantic text data are extracted from a video stream of the patient. The video data are analyzed to identify a first feature set. The audio data are analyzed to identify a second feature set. The semantic text data are analyzed to identify a third feature set. Using a computer-implemented machine-learning model, a health outcome of the patient is predicted based on the first, second, and/or third features sets. The health outcome that is predicted is then reported.

Abstract: Apparatus and associated methods relate to assessing a confidence level of a verbal communication of a person as determined by a machine learning model operating on a video stream of the person. Video data, audio data, and semantic text data are extracted from a video stream of the person. The video data are analyzed to identify a first feature set. The audio data are analyzed to identify a second feature set. The semantic text data are analyzed to identify a third feature set. Using a computer-implemented machine-learning model, a confidence level of the verbal communication of the person is assessed. The confidence level is then associated with a time of the video stream to which the confidence level pertains. The confidence level and the associated time of the video stream are then reported.

Abstract: Apparatus and associated methods relate to enhancing care of a patient using video and audio analytics. Video data, audio data, and semantic text data are extracted from a video stream of the patient. The video data are analyzed to identify a first feature set. The audio data are analyzed to identify a second feature set. The semantic text data are analyzed to identify a third feature set. Using a computer-implemented machine-learning model, a health outcome of the patient is predicted based on the first, second, and/or third features sets. The health outcome that is predicted is compared with the set of health outcomes of the training patients classified with the patient classification of the patient. Differences are identified between the feature sets corresponding to the patient and feature sets of the training patients who have better health outcomes the patient's predicted health outcome. The differences identified are then reported.

Abstract: Apparatus and associated methods relate to invoking an alert based upon a behavior of a patient as determined by a machine learning model operating on an audio stream of the patient. Audio data, and semantic text data are extracted from an audio stream of the patient. The audio data are analyzed to identify a first feature set. The semantic text data are analyzed to identify a second feature set. Using a computer-implemented machine-learning model, a patient behavior of the patient is determined based on the first and/or second features sets. The patient behavior is compared with a set of alerting behaviors corresponding to a patient classification of the patient. The alert is automatically invoked when the patient behavior is determined to be included in the set of alerting behaviors corresponding to the patient classification of the patient.