Abstract: Described herein is utilization of nontransparent Shock-Absorbing Energy Dissipation Padding (SAEDP) in an autonomous on-road vehicle. In one embodiment, the vehicle includes a side window located at eye level of an occupant who sits in the vehicle. The side window enables the occupant to see the outside environment. A motor is configured to move the SAEDP over a sliding mechanism between first and second states. A processor is configured to command the motor to move the SAEDP from the first state to the second state responsive to an indication that a probability of an imminent collision reaches a threshold. In the first state, the SAEDP does not block the occupant's eye level view to the outside environment, and in the second state, the SAEDP blocks the occupant's eye level view to the outside environment in order to protect the occupant's head against hitting the side window during collision.

Abstract: Manifestation of some physiological responses (e.g., stress, mental workload, or a headache) may involve the emergence of asymmetric thermal patterns on the face. Thus, thermal measurements of the face that are indicative of thermal asymmetry can be useful to detect such physiological responses. In one embodiment, a system includes first and second inward-facing head-mounted thermal cameras (CAM1 and CAM2, respectively) that are located less than 15 cm from the user's face, which take thermal measurements of regions on the right and left sides of the face (THROI1 and THROI2, respectively) of the user. The symmetric overlapping between the regions on the right and left sides (ROI1 and ROI2, respectively) is above 60%, and CAM1 and CAM2 do not occlude ROI1 and ROI2. Optionally, the system includes a computer that detects a physiological response based on thermal asymmetry between THROI1 and THROI2.

Abstract: System and method that identify atypical behavior of a user. One embodiment of the system includes an eye tracker to perform tracking of a user's gaze while viewing items, an inward-facing head-mounted thermal camera to take thermal measurements of a region of interest on the face (THROI) of the user, and a computer. The computer generates feature values based on THROI and the tracking, and utilizes a model to identify atypical behavior of the user based on the feature values. The model may be trained based on previous tracking and previous THROI of the user, taken while viewing other items.

Abstract: A system that detects an irregular physiological response while being exposed to sensitive data includes: a head-mounted display (HMD), an inward-facing head-mounted thermal camera (CAM), and a computer. The HMD exposes sensitive data to the user who wears the HMD. The CAM takes thermal measurements of a region of interest (THROI) on the user's face while the user is exposed to the sensitive data. And the computer detects, based on certain THROI taken while the user was exposed to certain sensitive data, whether the user experienced the irregular physiological response while being exposed to the certain sensitive data.

Abstract: Some aspects of this disclosure include systems, methods, and/or computer programs that may be used to notify a user about a cause of emotional imbalance. Some embodiments described herein involve determining when a user is in a state of emotional imbalance based on a measurement of affective response of the user, which is taken with a sensor. Factors characterizing an event to which the measurement corresponds are examined in order to select a certain factor that, based on a model of the user, has an effect on the user that is congruous with the measurement of affective response. The user is notified about the certain factor in order to make the user more aware of the certain factor and its effect on the user.

Abstract: Described herein are systems and methods for providing a breathing biofeedback session utilizing thermal measurements. In one embodiment, a system includes at least one inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a region below the nostrils (THROI) of a user. THROI are indicative of the exhale stream. Optionally, each CAM is located less than 15 cm from the user's face and above the user's upper lip, and does not occlude any of the user's mouth and nostrils. Optionally, THROI include thermal measurements of at least first and second regions below right and left nostrils of the user. The system also includes a user interface configured to provide feedback, calculated based on THROI, as part of a breathing biofeedback session for the user. Optionally, the system includes a computer that calculates the feedback.

Abstract: Manifestation of some physiological responses (e.g., stress, mental workload, or a headache) may involve the emergence of asymmetric thermal patterns on the face. Thus, thermal measurements of the face that are indicative of thermal asymmetry can be useful to detect such physiological responses. In one embodiment, a system includes first and second inward-facing head-mounted thermal cameras (CAM1 and CAM2, respectively) that are located less than 15 cm from the user's face, which take thermal measurements of regions on the right and left sides of the face (THROI1 and THROI2, respectively) of the user. The symmetric overlapping between the regions on the right and left sides (ROI1 and ROI2, respectively) is above 60%, and CAM1 and CAM2 do not occlude ROI1 and ROI2. Optionally, the system includes a computer that detects a physiological response based on thermal asymmetry between THROI1 and THROI2.

Abstract: Described herein are systems and methods for selecting a trigger of an allergic reaction. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on the nose (THN) of the user. Optionally, CAM weighs below 10 g and is located less than 15 cm from the user's face. The computer detects extents of the allergic reaction based on THN, receives indications of potential triggers of the allergic reaction to which the user was exposed, and selects the trigger, from among the potential triggers, based on the extents and the indications. Optionally, during most of the time the user was affected by the trigger, an effect of the trigger, as manifested via changes to THN, was higher than effects of most of the potential triggers.

Abstract: Described herein are systems and methods for calculating respiratory parameters based on thermal measurements. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region below the nostrils (THROI) of a user, and THROI are indicative of the exhale stream. Optionally, CAM is located above the user's upper lip and less than 15 cm from the user's face, and CAM does not occlude any of the user's mouth and nostrils. The computer generates feature values based on THROI and utilizes a model to calculate a respiratory parameter based on the feature values. The model was trained based on previous THROI of the user taken during different days. Optionally, the respiratory parameter is indicative of the user's breathing rate. Optionally, the computer detects whether the user breathed primarily through the mouth or through the nose.

Abstract: In order to enable collection of data from a head-mounted inward-facing camera, a clip-on device is attached to eyeglasses. The clip-on device optionally weighs less than 40 g and includes: (i) a body that may be attached and detached, multiple times, from a pair of eyeglasses in order to secure and release the clip-on device from the eyeglasses, (ii) an inward-facing camera fixed to the body, and (iii) a wireless communication module fixed to the body.

Abstract: Thermal measurements of the forehead can be indicative of brain activity, and as such, may be useful for conducting brain-related treatments, such as neurofeedback. In one embodiment, a system for conducting a neurofeedback session includes an inward-facing head-mounted thermal camera (CAM) and a user interface. CAM takes thermal measurements of a region on the forehead (THF) of a user, and is located below the middle of the region. The user interface provides, based on THF, the neurofeedback session for the user. Optionally, a computer controls the neurofeedback session by providing the user feedback via the user interface. The computer may generate the feedback based on the similarity between a current THF pattern and a previous THF pattern of the user taken while the user was in a target state.

Abstract: The three-dimensional (3D) shape of the exhale stream from a user's nostrils is often correlated with the user's state (e.g., an emotional state and/or a certain health condition). Thus, identifying the shape of a user's exhale stream can help determine the user's state. In one embodiment, a system that selects a state of a user includes at least one inward-facing head-mounted thermal camera that takes thermal measurements of at least three regions below the nostrils (THS). THS are indicative of shape of the exhale stream (SHAPE). The system also includes a computer that generates feature values based on THS, which are indicative of the SHAPE, and utilizes a model to select the state of the user, from among potential states of the user, based on the feature values. Optionally, the system includes a user interface that present the user's selected state.

Abstract: Described herein are systems and methods for detecting a physiological response based on multispectral data. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a first region of interest (THROI1) on a user's face, and an inward-facing head-mounted visible-light camera (VCAM) that takes images of a second region of interest (IMROI2) on the face. The first and second regions of interest overlap, and the system includes a computer that detects the physiological response based on THROI1, IMROI2, and a model. Optionally, the model was trained based on previous THROI1 and IMROI2 of the user taken during different days. Optionally, the physiological response is indicative of an occurrence of an emotional state of the user, such as joy, fear, sadness or anger.

Abstract: Often the physiological and emotional state of a person can be associated with certain cortical activity that can cause certain thermal patterns on the person's forehead. Thus, thermal measurements of the forehead may be used to differentiate between user states. In one embodiment, a system includes at least one inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of at least first and second regions on the right side of a user's forehead (THR1 and THR2, respectively), and thermal measurements of at least third and fourth regions on the left side of the forehead (THL1 and THL2, respectively). The middles of the first and third regions are at least 1 cm above the middles of the second and fourth regions, respectively. The system also includes a computer that determines, based on THR1, THR2, THL1, and THL2, whether the user is in a normal state or an abnormal state.

Abstract: Brain activity, and in particular which hemisphere is relatively more effective, is correlated with the dominant nostril (i.e., the nostril through which most of the air is exhaled when breathing through the nose). Since each side of the brain plays a different role in different types of activities, it may be better to conduct certain activities when a certain nostril is dominant. Described herein are systems and methods for suggesting activities according to the dominant nostril. In one embodiment, a system includes a sensor and a computer. The sensor takes measurements of a user that are indicative of the user's dominant nostril. The computer predicts, based on the measurements, which of the user's nostrils will be the dominant nostril at a future time and may suggest having a suitable activity accordingly.

Abstract: Described herein are systems and methods for selecting a stressor based on thermal measurements. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on a periorbital area (THROI1) of the user. The computer detects extents of stress based on THROI1, receives indications of potential stressors to which the user was exposed while THROI1 were taken, and selects the stressor, from among the potential stressors, based on the indications and the extents. Optionally, during most of the time the user was affected by the stressor, the effect of the stressor, as manifested via changes to THROI1, was higher than the effects of most of the potential stressors. Optionally, thermal measurements of other regions on the face may also be utilized to detect the extents of stress.

Abstract: Described herein are systems and methods for detecting a physiological response based on thermal measurements while accounting for effects of the environment. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAMin) that takes thermal measurements of a region of interest (THROI) on a user's face, and an outward-facing head-mounted thermal camera (CAMout) that takes thermal measurements of the environment (THENV). CAMin does not occlude the region of interest, and the system further includes a computer that detects the physiological response based on THROI and THENV. Optionally, the computer generates feature values based on sets of THROI and THENV, and utilizes a machine learning-based model to detect, based on the feature values, the physiological response.

Abstract: Described herein are systems and methods for detecting a stress level of a user. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on a periorbital area (THROI1) of the user. The computer generates feature values based on THROI1, and utilizes a model to detect the stress level based on the feature values. The model was trained based on: previous THROI1 taken while the user was under elevated stress, and other previous THROI1 taken while the user was not under elevated stress. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized to detect the stress level.

Abstract: Described herein are systems and methods for personalized detection of an allergic reaction of a user. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on the nose (THN) of a user. The computer generates feature values based on THN and utilizes a model to detect an allergic reaction of the user based on the feature values. The model is trained based on previous THN of the user taken during different days. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized by the computer to generate additional feature values that are used to detect the allergic reaction. In some cases, detection of the allergic reaction may occur following a rise in nasal temperature, even before the user becomes aware of the allergic reaction.

Abstract: Described herein are systems and methods for detecting a physiological response based on facial skin color changes (FSCC) recognizable in images taken with an inward-facing head-mounted visible-light camera (VCAMin). Some examples of physiological responses whose manifestation involves FSCC include emotional responses (which at times may be hidden to the naked eye), and physiological signals such as a heart rate, heart rate variability, and/or a breathing rate. In one embodiment, a system that detects a physiological response based on FSCC includes VCAMin that takes images of a region of interest (IMROI) on a user's face, which is illuminated by ambient light, and a computer that detects the physiological response based on FSCC recognizable in IMROI. Optionally, the system includes an outward-facing head-mounted visible-light camera (VCAMout) that takes images of the environment (IMENV), and the computer detects the physiological response also based on IMENV.