Abstract: A brain-computer interface system includes a video processor for producing a display signal, a temporal controller for producing a plurality of repetitive visual stimulus (RVS) signals with different respective temporal aspects, a display device that receives the display signal and displays a corresponding image on a plurality of different display regions and receives the RVS signals and displays corresponding RVS in respective ones of the display regions, an electroencephalographic (EEG) sensor for sensing a visually-evoked cortical potential (VECP) signal in a user with eyes fixated on a viewed one of the display regions, and a VECP processor for processing the VECP signal to identify the respective temporal aspect of the respective RVS of the viewed display region to estimate the eye fixation location. The RVS are generated independently of the display update/refresh rate and at sufficiently high frequencies to avoid flicker perceptible to the user.

Abstract: Methods and systems are described for delivering psychophysiological self-regulation training in a virtual, augmented, and/or mixed reality environment that simulates a social situation, such as one involving conflict. A user (e.g., a trainee) may interface with a training computing system directly or via an avatar that may interact with other characters in the simulation who may be programmed at one or more levels of threat to or cooperation with the trainee. The system may provide feedback to the trainee regarding their cognitive and emotional states. The feedback may be designed to encourage them to develop the ability to respond in future real environments with appropriately effective states, where the feedback may take the form of the behavior of the characters, with the trainee's interaction based on their effective states being rewarded by desirable character behavior and the trainee's ineffective states being penalized by undesirable character behavior.

Abstract: A brain-computer interface system includes a video processor for producing a display signal, a temporal controller for producing a plurality of repetitive visual stimulus (RVS) signals with different respective temporal aspects, a display device that receives the display signal and displays a corresponding image on a plurality of different display regions and receives the RVS signals and displays corresponding RVS in respective ones of the display regions, an electroencephalographic (EEG) sensor for sensing a visually-evoked cortical potential (VECP) signal in a user with eyes fixated on a viewed one of the display regions, and a VECP processor for processing the VECP signal to identify the respective temporal aspect of the respective RVS of the viewed display region to estimate the eye fixation location. The RVS are generated independently of the display update/refresh rate and at sufficiently high frequencies to avoid flicker perceptible to the user.

Abstract: A dynamic function allocation (DFA) framework balances the workload or achieves other mitigating optimizations for a human operator of a vehicle by dynamically distributing operational functional tasks between the operator and the vehicle's or robot's automation in real-time. DFA operations include those for aviation, navigation, and communication, or to meet other operational needs. The DFA framework provides an intuitive command/response interface to vehicle (e.g., aircraft), vehicle simulator, or robotic operations by implementing a Dynamic Function Allocation Control Collaboration Protocol (DFACCto). DFACCto simulates or implements autonomous control of robot's or vehicle's functional tasks and reallocates some or all tasks between a human pilot and an autonomous system when such reallocation is preferred, and implements the reallocation.

Abstract: A method for determining a human operator's visual attention to an operating panel of a vehicle during vehicle operation is described. The method includes: receiving and processing data indicative of the human operator's gaze direction from at least one monitoring device over a period of time; determining, by the processor, an approximate location of the human operator's gaze on the operating panel at different individual times over the period of time; identifying, by the processor, any individual areas-of-interest (AOI) located at each of the determined approximate locations of the human operator's gaze; and calculating, by the processor, a value for at least one metric using at least the determined approximate locations at different individual times and the identification of any individual AOI at the determined approximate locations to determine the human operator's attention to the operating panel.

Abstract: System and methods for risk and risk precursor identification in commercial aviation operations according to various aspects of the present invention operate in conjunction with a source of operation flight track data, a set of risk determination models containing instructions on how to process a set of received operational flight track data, a risk determination API for activating one or more risk models to process the set of received operational flight track data, and a user interface for communicating with the risk determination API. Each risk model may be trained to analyze flight track data to identify a particular type of risk precursor or identify a type of risk and any precursors that led to the risk. Processed results and identified risk precursors are forwarded to the user interface and displayed to allow users to quickly distinguish between nominal conditions for an aircraft and conditions with elevated levels of risk.

Abstract: A method of providing physiological self-regulation challenges prior to participating in a series of activities or exercises at a series of predefined locations includes determining a physiological goal associated with each location. A sensing device measures a physiological state of a user, and a mobile communication device communicates to a user whether or not the user has achieved the physiological goal for the challenge. The level of difficulty of the physiological goal may be reduced if the user does not meet the goal. The physiological goal may comprise a brain state that is conducive to learning, and the sensing device may be configured to measure brain state values representing cognitive engagement. Upon achievement of each physiological goal, the participant is provided with a reward such as information concerning the current predefined location and/or information concerning the next predefined location.

Abstract: Aspects of the present disclosure are directed to devices, systems, and methods for optimized integration of a human operator with a machine for safe and efficient operation. Accordingly, aspects of the present disclosure are directed to systems, methods, and devices which evaluate and determine a cognitive state of an operator, and allocate tasks to either the machine and/or operator based on the cognitive state of the operator, among other factors.

Abstract: Aspects of the present disclosure are directed to devices, systems, and methods for optimized integration of a human operator with a machine for safe and efficient operation. Accordingly, aspects of the present disclosure are directed to systems, methods, and devices which evaluate and determine a cognitive state of an operator, and allocate tasks to either the machine and/or operator based on the cognitive state of the operator, among other factors.

Abstract: A dynamic function allocation (DFA) framework balances the workload or achieves other mitigating optimizations for a human operator of a vehicle by dynamically distributing operational functional tasks between the operator and the vehicle's or robot's automation in real-time. DFA operations include those for aviation, navigation, and communication, or to meet other operational needs. The DFA framework provides an intuitive command/response interface to vehicle (e.g., aircraft), vehicle simulator, or robotic operations by implementing a Dynamic Function Allocation Control Collaboration Protocol (DFACCto). DFACCto simulates or implements autonomous control of robot's or vehicle's functional tasks and reallocates some or all tasks between a human pilot and an autonomous system when such reallocation is determined to be preferred, and implements the reallocation.

Abstract: A method of providing physiological self-regulation challenges prior to participating in a series of activities or exercises at a series of predefined locations includes determining a physiological goal associated with each location. A sensing device measures a physiological state of a user, and a mobile communication device communicates to a user whether or not the user has achieved the physiological goal for the challenge. The level of difficulty of the physiological goal may be reduced if the user does not meet the goal. The physiological goal may comprise a brain state that is conducive to learning, and the sensing device may be configured to measure brain state values representing cognitive engagement. Upon achievement of each physiological goal, the participant is provided with a reward such as information concerning the current predefined location and/or information concerning the next predefined location.

Abstract: Aspects of the present disclosure are directed to devices, systems, and methods for optimized integration of a human operator with a machine for safe and efficient operation. Accordingly, aspects of the present disclosure are directed to systems, methods, and devices which evaluate and determine a cognitive state of an operator, and allocate tasks to either the machine and/or operator based on the cognitive state of the operator, among other factors.

Abstract: Method and systems are disclosed for training state-classifiers for classification of cognitive state. A set of multimodal signals indicating physiological responses of an operator are sampled over a time period. A depiction of operation by the operator during the time period is displayed. In response to user input selecting a cognitive state for a portion of the time period, the one or more state-classifiers are trained. In training the state-classifiers, the set of multimodal signals sampled in the portion of the time period are used as input to the one or more state-classifiers and the selected one of the set of cognitive states is used as a target result to be indicated by the one or more state-classifiers.

Abstract: Aspects of the present disclosure are directed to devices, systems, and methods for optimized integration of a human operator with a machine for safe and efficient operation. Accordingly, aspects of the present disclosure are directed to systems, methods, and devices which evaluate and determine a cognitive state of an operator, and allocate tasks to either the machine and/or operator based on the cognitive state of the operator, among other factors.

Abstract: A method of providing physiological self-regulation challenges prior to participating in a series of activities or exercises at a series of predefined locations includes determining a physiological goal associated with each location. A sensing device measures a physiological state of a user, and a mobile communication device communicates to a user whether or not the user has achieved the physiological goal for the challenge. The level of difficulty of the physiological goal may be reduced if the user does not meet the goal. The physiological goal may comprise a brain state that is conducive to learning, and the sensing device may be configured to measure brain state values representing cognitive engagement. Upon achievement of each physiological goal, the participant is provided with a reward such as information concerning the current predefined location and/or information concerning the next predefined location.

Abstract: Method and systems are disclosed for training state-classifiers for classification of cognitive state. A set of multimodal signals indicating physiological responses of an operator are sampled over a time period. A depiction of operation by the operator during the time period is displayed. In response to user input selecting a cognitive state for a portion of the time period, the one or more state-classifiers are trained. In training the state-classifiers, the set of multimodal signals sampled in the portion of the time period are used as input to the one or more state-classifiers and the selected one of the set of cognitive states is used as a target result to be indicated by the one or more state-classifiers.

Abstract: Method for physiologically modulating videogames and simulations includes utilizing input from a motion-sensing video game system and input from a physiological signal acquisition device. The inputs from the physiological signal sensors are utilized to change the response of a user's avatar to inputs from the motion-sensing sensors. The motion-sensing system comprises a 3D sensor system having full-body 3D motion capture of a user's body. This arrangement encourages health-enhancing physiological self-regulation skills or therapeutic amplification of healthful physiological characteristics. The system provides increased motivation for users to utilize biofeedback as may be desired for treatment of various conditions.

Abstract: New types of controllers allow a player to make inputs to a video game or simulation by moving the entire controller itself or by gesturing or by moving the player's body in whole or in part. This capability is typically accomplished using a wireless input device having accelerometers, gyroscopes, and a camera. The present invention exploits these wireless motion-sensing technologies to modulate the player's movement inputs to the videogame based upon physiological signals. Such biofeedback-modulated video games train valuable mental skills beyond eye-hand coordination. These psychophysiological training technologies enhance personal improvement, not just the diversion, of the user.

Abstract: Method for physiologically modulating videogames and simulations includes utilizing input from a motion-sensing video game system and input from a physiological signal acquisition device. The inputs from the physiological signal sensors are utilized to change the response of a user's avatar to inputs from the motion-sensing sensors. The motion-sensing system comprises a 3D sensor system having full-body 3D motion capture of a user's body. This arrangement encourages health-enhancing physiological self-regulation skills or therapeutic amplification of healthful physiological characteristics. The system provides increased motivation for users to utilize biofeedback as may be desired for treatment of various conditions.

Abstract: New types of controllers allow players to make inputs to a video game or simulation by moving the entire controller itself. This capability is typically accomplished using a wireless input device having accelerometers, gyroscopes, and an infrared LED tracking camera. The present invention exploits these wireless motion-sensing technologies to modulate the player's movement inputs to the videogame based upon physiological signals. Such biofeedback-modulated video games train valuable mental skills beyond eye-hand coordination. These psychophysiological training technologies enhance personal improvement, not just the diversion, of the user.