Abstract: A system for remotely determining the potential presence of depression in a user. The system includes a virtual agent that administers one or more tasks to the user. The user performs the tasks and the performance is captured by a camera. The captured audiovisual data is sent to a server that derives objective metrics which are then applied to a classifying algorithm. If certain metrics meet certain thresholds, the system determines that the user is exhibiting depression symptoms. In embodiments, the system can further determine whether a user has been taking depression medication.
Type:
Grant
Filed:
October 24, 2023
Date of Patent:
January 13, 2026
Assignee:
Modality.AI, Inc.
Inventors:
Michael Neumann, Hardik Kothare, William Burke, Doug Habberstad, Jackson Liscombe, Oliver Roesler, David Suendermann-Oeft, David Pautler, Andrew Cornish, Vikram Ramanarayanan
Abstract: A system for identifying efficacious markers comprises memory storing collected multimodal digital markers from a first cohort experiencing a sign onset and a second cohort experiencing a non-sign onset. The system further comprises selection logic that identifies a subset of markers that best capture differences between the sign and non-sign onsets. The system further comprises responsiveness logic that determines a responsiveness parameter that specifies a rate of change in the subset. The system further comprises time to detect change logic that determines a time parameter that specifies a time required to detect change in the subset. The system further comprises sample size logic that determines how the responsiveness parameter and the time parameter change depending on sample size. The system further comprises sensitivity logic that determines a sensitivity parameter that specifies whether the subset detects condition deterioration during intervals when no changes are reported in an external standard.
Type:
Grant
Filed:
August 20, 2024
Date of Patent:
October 14, 2025
Assignee:
Modality.AI, Inc.
Inventors:
Hardik Kothare, Michael Neumann, Vikram Ramanarayanan
Abstract: A computer-implemented method of generating interpretable, composite marker indexes that are discriminative and noise-robust is provided. The method comprises storing remotely collected multimodal digital markers from a first cohort and a second cohort. The method further comprises grouping multicollinear features in the multimodal digital markers into clusters, and then selecting representative features for the clusters for multiple classification tasks that require discrimination between the first cohort and the second cohort. The method further comprises linearly combining the representative features into an interpretable, composite marker index such that relative contributions of each of the representative features to the interpretable, composite marker index are known.
Type:
Grant
Filed:
August 20, 2024
Date of Patent:
September 9, 2025
Assignee:
Modality.AI, Inc.
Inventors:
Michael Neumann, Hardik Kothare, Vikram Ramanarayanan
Abstract: A system for identifying efficacious markers comprises memory storing collected multimodal digital markers from a first cohort experiencing a sign onset and a second cohort experiencing a non-sign onset. The system further comprises selection logic that identifies a subset of markers that best capture differences between the sign and non-sign onsets. The system further comprises responsiveness logic that determines a responsiveness parameter that specifies a rate of change in the subset. The system further comprises time to detect change logic that determines a time parameter that specifies a time required to detect change in the subset. The system further comprises sample size logic that determines how the responsiveness parameter and the time parameter change depending on sample size. The system further comprises sensitivity logic that determines a sensitivity parameter that specifies whether the subset detects condition deterioration during intervals when no changes are reported in an external standard.
Type:
Application
Filed:
August 20, 2024
Publication date:
August 7, 2025
Applicant:
Modality.AI, Inc.
Inventors:
Hardik KOTHARE, Michael NEUMANN, Vikram RAMANARAYANAN
Abstract: A computer-implemented method of generating interpretable, composite marker indexes that are discriminative and noise-robust is provided. The method comprises storing remotely collected multimodal digital markers from a first cohort and a second cohort. The method further comprises grouping multicollinear features in the multimodal digital markers into clusters, and then selecting representative features for the clusters for multiple classification tasks that require discrimination between the first cohort and the second cohort. The method further comprises linearly combining the representative features into an interpretable, composite marker index such that relative contributions of each of the representative features to the interpretable, composite marker index are known.
Type:
Application
Filed:
August 20, 2024
Publication date:
August 7, 2025
Applicant:
Modality.AI, Inc.
Inventors:
Michael NEUMANN, Hardik KOTHARE, Vikram RAMANARAYANAN