Abstract: This disclosure relates generally to method and system for predicting distance of gazed objects using IR camera. Eye tracking technology is widely used to study human behavior and patterns in eye movements. Existing gaze trackers focus on predicting gaze point and hardly analyzes distance of the gazed object from the gazer or directly classify region of focus. The method of the present disclosure predicts gazed objects distance using a pair of IR cameras placed on either side of a smart glass. The gaze predictor ML model predicts distance at least one gazed object positioned from eye of each subject during systematic execution of a set of tasks. From each pupillary information of each pupil a set of features are extracted which are utilized to classify the gazed object of the subject based on the distance into at least one of a near class, an intermediate class, and a far class.

Abstract: This disclosure relates to analyzing effect of a secondary cognitive load task on a primary executive task. Human random sequence generation is a marker to study cognitive functions and inability to generate random sequences (RS) can reveal underlying impairments. Traditionally, ‘call out’ or ‘write down’ procedures are used to obtain human generated numbers, wherein short term memory and number of previously generated entities visible to a subject plays a major role. Also precise trial-wise or response-wise analysis may not be possible. In the present disclosure, the human generated random numbers are digitized into RS and a cognitive load (CL) inducing task is imposed on the executive task. The CL demanding task disrupts randomization performance. Deviation from randomness, load index based on gaze data and deviation from pupillometry data of healthy subjects are provided as indicators of an interference effect imposed by the CL and thereby indicative of underlying impairments.

Abstract: An important task in several wellness applications is detection of emotional valence from speech. Two types of features of speech signals are used to detect valence: acoustic features and text features. Acoustic features are derived from short frames of speech, while text features are derived from the text transcription. Present disclosure provides systems and methods that determine the effect of text on acoustic features. Acoustic features of speech segments carrying emotion words are to be treated differently from other segments that do not carry such words. Only specific speech segments of the input speech signal are considered based on a dictionary specific to a language to assess emotional valence. A model trained (or trained classifier) for specific language either by including the acoustic features of the emotion related words or by omitting it is used by the system for determining emotional valence in an input speech signal.

Abstract: This disclosure relates generally to a method and system for assessment of sustained visual attention of a target. The conventional methods utilize various markers for assessment of attention, however, blink rate variability (BRV) series signal is not explored yet. In an embodiment, the disclosed method utilizes BRV series signal for assessing sustained visual attention of a target. A gaze data of the target is recorded using an eye tracker and a set of uniformly sampled BRV series signal is reconstructed from each of the BRV series. One or more frequency domain features, including pareto frequency, are extracted from the set of uniformly sampled BRV series signal. The values of frequency domain features extracted from the set of BRV series signals are compared with corresponding threshold values to determine visual sustained attention of the target.

Abstract: Unlike state of art eye blink detection techniques that are generalized for usage across individuals affecting accuracy of eye blink prediction from subject to subject, embodiments of the present disclosure provide a method and system for personalized eye blink detection using passive camera-based approach. The method first generates a subject specific annotation data, which is then further processed to derive subject specific personalized blink threshold values. The method disclosed provides three unique approaches to compute the personalized blink threshold values which is one time calibration process. The personalized blink threshold values are then used to generate a binary decision vector (D) while analyzing input test images (video sequences) of the subject of interest. Further, values taken by elements of the decision vector (D) are analyzed for a predefined time period to predict possible eye blinks of the subject.

Abstract: This disclosure relates generally to a method and a system for determining quality of PPG signal. The PPG signals are extensively used for deducing health parameters of patients to infer the physiological conditions of heart, blood pressure, breathing patterns of the patients. However, analysis based on PPG signals is extremely challenging and is accurate only on high quality PPG signals. However, the existing techniques for determining quality of PPG signal (that are collected using wearable devices) require huge training or use complicated algorithms and cannot be used for real-time analysis. The disclosed methods and system for PPG quality assessment is based on the frequency domain analysis, wherein heart and respiratory components in the frequency spectrum are used effectively to derive the quality checker metric which is further used to estimate a plurality of optimal thresholds that is used for determining the quality of PPG signals at real-time.

Abstract: This disclosure relates generally to a method and system for classification of cognitive load (CL) using data obtained from wearable sensors. The disclosed method uses a multi-modal based approach using wrist-worn sensors for real time monitoring of CL in real world scenarios and improves the accuracy of detection of CL. A set of distinguishing features are selected from physiological signals received from the wrist-worn sensors. These features are used for training a classification model for classifying the CL of a patient into a no load or a high load. The set of distinguishing features are selected from domain specific features and signal property based generic features of the physiological signals. The disclosed method is used for classification of CL in scenarios such as to check how the cognitive load of a candidate varies during interviews, to assess the participants workload during online meetings and so on.

Abstract: System and method for digitized digit symbol substitution test (DSST) are disclosed. In an example, a display area of a digitized DSST device is partitioned into multiple bins. Further, a series of number symbol pairs is displayed as a lookup table on top of the display, termed as a lookup area. Furthermore, a question and answer (QA) pair corresponding to the series of number symbol pairs to an examinee in multiple trials. In addition, feature values for the QA pair are computed in each of the multiple bins in the trials, wherein the feature values comprise a response time and an accuracy of response by the examinee. Moreover, probabilities of the feature values are determined in each of the multiple bins. Also, an entropy value based on the probabilities of the feature values is computed in each of the multiple bins providing information on distribution.

Abstract: A method and system is provided for assessing the learning experience of the person by monitoring the mental state of the person. The method involves measuring the brain signal, skin conductance using GSR device, and heart rate variability using the pulse oximeter. These physiological signals are measured when the person is performing an activity such as the modified Stroop test. Once the activity is performed, an offline questionnaire is also filled by the person. Based on the comparison of the offline questionnaire and the physiological signals, a model is generated. This model is used to assess the learning experience of the person. According to another embodiment, a method is also provided for maintaining the steady flow state of a person while performing any activity.

Abstract: An important task in several wellness applications is detection of emotional valence from speech. Two types of features of speech signals are used to detect valence: acoustic features and text features. Acoustic features are derived from short frames of speech, while text features are derived from the text transcription. Present disclosure provides systems and methods that determine the effect of text on acoustic features. Acoustic features of speech segments carrying emotion words are to be treated differently from other segments that do not carry such words. Only specific speech segments of the input speech signal are considered based on a dictionary specific to a language to assess emotional valence. A model trained (or trained classifier) for specific language either by including the acoustic features of the emotion related words or by omitting it is used by the system for determining emotional valence in an input speech signal.

Abstract: This disclosure relates generally to a method and system for assessment of sustained visual attention of a target. The conventional methods utilize various markers for assessment of attention, however, blink rate variability (BRV) series signal is not explored yet. In an embodiment, the disclosed method utilizes BRV series signal for assessing sustained visual attention of a target. A gaze data of the target is recorded using an eye tracker and a set of uniformly sampled BRV series signal is reconstructed from each of the BRV series. One or more frequency domain features, including pareto frequency, are extracted from the set of uniformly sampled BRV series signal. The values of frequency domain features extracted from the set of BRV series signals are compared with corresponding threshold values to determine visual sustained attention of the target.

Abstract: A method and system is provided for pre-processing of an electroencephalography (EEG) signal for cognitive load measurement. The present application provides a method and system for pre-processing of electroencephalography signal for cognitive load measurement of a user, comprises of capturing the electroencephalography signal from the head of the user, detecting the plurality of system artifacts in the captured electroencephalography signal, detecting and removing noisy window from the captured electroencephalography signal, detecting an eye blink region and filtering out said detected eye blink region from the captured electroencephalography signal, utilizing the filtered electroencephalography signal for measuring the cognitive load of the user and subsequently computing different levels of mental workloads on the user using variation of spatial distribution of frontal scalp EEG electrodes for measured cognitive load.

Abstract: Traditional cognitive load estimation techniques rely on raw pupil size alone which is often prone to confound with changes in illumination, errors associated with sensor devices and irregular oscillations of pupil under constant light conditions. Estimation of cognitive load finds application in many domains including optimum work allocation, assessing a work environment and medical diagnosis. The present disclosure employs frequency domain analysis of pupil size variations to estimate load imposed by a cognitive task. A cognitive load metric based on power and frequency relations at mean frequency of the variation in pupil size addresses cognitive load estimation based on pupil dilation, wherein the pupil dilation is captured by employing low cost non-intrusive nearables.

Abstract: Wellness estimation allows tracking of various health parameters and estimating health condition(s) of the user being monitored. Photophlethysmogram (PPG) based health monitoring systems exist. This disclosure relates generally to PPG based wellness monitoring, and more specifically to a pulse harmonics based wellness estimation. The system collects PPG signals from a user being monitored, as input. The system calculates 12 pulse harmonics from a fundamental frequency of the PPG signal. From the pulse harmonics, further a plurality of key features are extracted, and in turn a wellness metric and a wellness index are calculated, which represents health of the user.

Abstract: System and method for aiding communication for subjects suffering from paralysis of muscles controlled by peripheral nervous system are disclosed. A method for aiding communication for said subjects includes capturing, from a plurality of sensors, sensor data generated based on an interaction of a subject with an interactive UI. The plurality of sensors includes one or more body-parts movement tracking sensors for tracking motion of body-parts of the subject and one or more physiological signal sensors for monitoring physiological signals generated from the subject during the interaction. A plurality of model parameters indicative of characteristics of the subject related to the interaction are determined based on the sensor data. The navigation at the interactive UI is controlled on the plurality of model parameters.

Abstract: A method and system for determining cognitive load of a person using a modified baseline is provided. The person is asked to perform a series of activities including staying in eye closed rest state and baseline state and performing a trial state. Simultaneously, EEG signal and GSR signal of the person are captured. The EEG signal and the GSR signal are preprocessed and segmented. The EEG and GSR signals are then used to determine a first set and a second set of inactive states from the baseline interval and the rest interval. The most inactive window is then identified out of the first set of inactive states. The most inactive window is determined from the rest interval of the person. The inactive window is used as the modified baseline to measure the cognitive load of the person.

Abstract: Metacognitive confidence is defined as the confidence generated from the observation and critical analysis of one's own the decision making process. There are various studies indicative of the importance of measurement of confidence level of the person while doing a task. The existing confidence level measurement methods provide various limitations such invasive and complex experimental setup, noise and artifacts in the signal. A system and method for determining confidence level of a person using electroencephalogram has been provided. The system is configured to build a metric to determine the amount of metacognitive confidence, in presence of different cognitive load condition, directly from brain activity using electroencephalogram signals. The brain activity acquired from the frontal and temporal part of the brain at different frequency bands and combined with suitable weights to form the confidence metric.

Abstract: This disclosure relates to analyzing effect of a secondary cognitive load task on a primary executive task. Human random sequence generation is a marker to study cognitive functions and inability to generate random sequences (RS) can reveal underlying impairments. Traditionally, ‘call out’ or ‘write down’ procedures are used to obtain human generated numbers, wherein short term memory and number of previously generated entities visible to a subject plays a major role. Also precise trial-wise or response-wise analysis may not be possible. In the present disclosure, the human generated random numbers are digitized into RS and a cognitive load (CL) inducing task is imposed on the executive task. The CL demanding task disrupts randomization performance. Deviation from randomness, load index based on gaze data and deviation from pupillometry data of healthy subjects are provided as indicators of an interference effect imposed by the CL and thereby indicative of underlying impairments.

Abstract: System and method for aiding communication for subjects suffering from paralysis of muscles controlled by peripheral nervous system are disclosed. A method for aiding communication for said subjects includes capturing, from a plurality of sensors, sensor data generated based on an interaction of a subject with an interactive UI. The plurality of sensors includes one or more body-parts movement tracking sensors for tracking motion of body-parts of the subject and one or more physiological signal sensors for monitoring physiological signals generated from the subject during the interaction. A plurality of model parameters indicative of characteristics of the subject related to the interaction are determined based on the sensor data. The navigation at the interactive UI is controlled on the plurality of model parameters.

Abstract: Traditional cognitive load estimation techniques rely on raw pupil size alone which is often prone to confound with changes in illumination, errors associated with sensor devices and irregular oscillations of pupil under constant light conditions. Estimation of cognitive load finds application in many domains including optimum work allocation, assessing a work environment and medical diagnosis. The present disclosure employs frequency domain analysis of pupil size variations to estimate load imposed by a cognitive task. A cognitive load metric based on power and frequency relations at mean frequency of the variation in pupil size addresses cognitive load estimation based on pupil dilation, wherein the pupil dilation is captured by employing low cost non-intrusive nearables.