Abstract: A method of assessing the psychological or physiological state by analyzing language cues captured from a patient. The language cues may be semantic cues (speech or written text) or visual cues (expression or body language). Key features are extracted from the language cues and compiled into a data file which is submitted to one or more pre-taught machine learning algorithms. The output of the machine learning algorithms are combined to determine the psychological or physiological state of the patient. The method of teaching the machine learning algorithms is also described. In the preferred form there are three machine learning algorithms including a support vector machine, a decision tree learning algorithm and a neural network.