Abstract: Described herein are systems and methods for personalized detection of an allergic reaction of a user. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on the nose (THN) of a user. The computer generates feature values based on THN and utilizes a model to detect an allergic reaction of the user based on the feature values. The model is trained based on previous THN of the user taken during different days. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized by the computer to generate additional feature values that are used to detect the allergic reaction. In some cases, detection of the allergic reaction may occur following a rise in nasal temperature, even before the user becomes aware of the allergic reaction.

Abstract: A wearable system configured to collect thermal measurements related to respiration. The system includes a frame configured to be worn on a user's head, and at least one non-contact thermal camera (e.g., thermopile or microbolometer based sensor). The thermal camera is small and lightweight, physically coupled to the frame, located close to the user's face, does not occlude any of the user's mouth and nostrils, and is configured to take thermal measurements of: a portion of the right side of the user's upper lip, a portion of the left side of the user's upper lip, and a portion of the user's mouth. The thermal measurements are forwarded to a computer that calculates breathing related parameters, such as breathing rate, an extent to which the breathing was done through the mouth, an extent to which the breathing was done through the nostrils, and ratio between exhaling and inhaling durations.

Abstract: Thermal measurements of the forehead can be indicative of brain activity, and as such, may be useful for conducting brain-related treatments, such as neurofeedback. In one embodiment, a system for conducting a neurofeedback session includes an inward-facing head-mounted thermal camera (CAM) and a user interface. CAM takes thermal measurements of a region on the forehead (THF) of a user, and is located below the middle of the region. The user interface provides, based on THF, the neurofeedback session for the user. Optionally, a computer controls the neurofeedback session by providing the user feedback via the user interface. The computer may generate the feedback based on the similarity between a current THF pattern and a previous THF pattern of the user taken while the user was in a target state.

Abstract: Described herein are systems and methods for calculating respiratory parameters based on thermal measurements. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region below the nostrils (THROI) of a user, and THROI are indicative of the exhale stream. Optionally, CAM is located above the user's upper lip and less than 15 cm from the user's face, and CAM does not occlude any of the user's mouth and nostrils. The computer generates feature values based on THROI and utilizes a model to calculate a respiratory parameter based on the feature values. The model was trained based on previous THROI of the user taken during different days. Optionally, the respiratory parameter is indicative of the user's breathing rate. Optionally, the computer detects whether the user breathed primarily through the mouth or through the nose.

Abstract: Described herein are systems and methods for detecting a physiological response based on thermal measurements while accounting for consumption of a confounding substance such as a medication, alcohol, caffeine, or nicotine. In one embodiment, a system includes a computer and an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a region of interest (THROI) on a user's face. The computer receives an indication indicative of the user consuming a confounding substance that affects THROI, and detects the physiological response while the consumed confounding substance affects THROI. The detection is based on THROI, the indication and a model. Optionally, the model was trained on: a first set of THROI taken while the confounding substance affected THROI, and a second set of THROI taken while the confounding substance did not affect THROI.

Abstract: A safety system that provides specific warnings to an occupant of a vehicle engaged in a certain activity that can cause an adverse outcome in an event of a Sudden Decrease in Ride Smoothness (an SDRS event). The safety system includes a sensor that takes measurements of the vehicle compartment, and a computer that estimates, based on the measurements, whether the occupant of the vehicle is engaged in a certain activity that can lead to an adverse outcome in case of an SDRS event. Responsive to receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer provides a specific warning to the occupant. The specific warning describes a specific action related to the certain activity, which the occupant should take.

Abstract: This disclosure describes various systems for collecting thermal measurements of regions of a user's face. Each of the systems includes a frame configured to be worn on the user's head, and one or more lightweight thermal cameras that are coupled to the frame and configured to take thermal measurements of a region of interest on the user's face. Due to their coupling to the frame, the thermal cameras remain pointed at their respective regions of interest even when the user's head performs angular movements. The thermal measurements collected by some embodiments of the systems described herein may be utilized for a variety of applications that involve detecting different types of physiological responses or medical disorders.

Abstract: The three-dimensional (3D) shape of the exhale stream from a user's nostrils is often correlated with the user's state (e.g., an emotional state and/or a certain health condition). Thus, identifying the shape of a user's exhale stream can help determine the user's state. In one embodiment, a system that selects a state of a user includes at least one inward-facing head-mounted thermal camera that takes thermal measurements of at least three regions below the nostrils (THS). THS are indicative of shape of the exhale stream (SHAPE). The system also includes a computer that generates feature values based on THS, which are indicative of the SHAPE, and utilizes a model to select the state of the user, from among potential states of the user, based on the feature values. Optionally, the system includes a user interface that present the user's selected state.

Abstract: Described herein are systems and methods for selecting a trigger of an allergic reaction. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on the nose (THN) of the user. Optionally, CAM weighs below 10 g and is located less than 15 cm from the user's face. The computer detects extents of the allergic reaction based on THN, receives indications of potential triggers of the allergic reaction to which the user was exposed, and selects the trigger, from among the potential triggers, based on the extents and the indications. Optionally, during most of the time the user was affected by the trigger, an effect of the trigger, as manifested via changes to THN, was higher than effects of most of the potential triggers.

Abstract: Described herein are systems and methods for providing a breathing biofeedback session utilizing thermal measurements. In one embodiment, a system includes at least one inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a region below the nostrils (THROI) of a user. THROI are indicative of the exhale stream. Optionally, each CAM is located less than 15 cm from the user's face and above the user's upper lip, and does not occlude any of the user's mouth and nostrils. Optionally, THROI include thermal measurements of at least first and second regions below right and left nostrils of the user. The system also includes a user interface configured to provide feedback, calculated based on THROI, as part of a breathing biofeedback session for the user. Optionally, the system includes a computer that calculates the feedback.

Abstract: Described herein are systems and methods for detecting a physiological response based on thermal measurements while accounting for touching the face. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a region of interest (THROI) on a user's face, and a sensor that provides measurements (M) indicative of times at which the user touches the region of interest (ROI). The system also includes a computer that detects the physiological response based on THROI and M. Optionally, the computer generates feature values based on THROI and M, and utilizes a model to detect, based on the feature values, the physiological response. Optionally, the model was trained based on samples, each including: (i) feature values generated based on previous THROI taken while M indicated touching the ROI, and (ii) a corresponding label indicative of an extent of the physiological response.

Abstract: Described herein are systems and methods for detecting a physiological response based on multispectral data. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a first region of interest (THROI1) on a user's face, and an inward-facing head-mounted visible-light camera (VCAM) that takes images of a second region of interest (IMROI2) on the face. The first and second regions of interest overlap, and the system includes a computer that detects the physiological response based on THROI1, IMROI2, and a model. Optionally, the model was trained based on previous THROI1 and IMROI2 of the user taken during different days. Optionally, the physiological response is indicative of an occurrence of an emotional state of the user, such as joy, fear, sadness or anger.

Abstract: Brain activity, and in particular which hemisphere is relatively more effective, is correlated with the dominant nostril (i.e., the nostril through which most of the air is exhaled when breathing through the nose). Thus, identifying which of the nostrils is dominant may have various applications. Described herein are systems and methods for identifying the dominant nostril. In one embodiment, a system includes at least one inward-facing head-mounted thermal camera (CAM) and a computer. The at least one CAM does not occlude any of the user's mouth and nostrils and is used to take thermal measurements of first and second regions below the right and left nostrils (THROI1 and THROI2, respectively). The computer identifies the dominant nostril based on THROI1 and THROI2. Optionally, the computer detects, utilizing THROI1 and THROI2, the three-dimensional (3D) shape of the exhale stream from at least one of the nostrils.

Abstract: A safety system for an autonomous vehicle that may be used to warn an occupant engaged in a certain activity that involves handling an object that can harm the occupant in an event of a Sudden Decrease in Ride Smoothness (an SDRS event). The safety system includes a camera that takes images of the occupant and a computer that estimates, based on the images, whether the occupant is engaged in the certain activity. The computer receives from an autonomous-driving control system an indication of whether an SDRS event is imminent. Responsive to both receiving an indication of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer commands a user interface to warn the occupant shortly before the SDRS event.

Abstract: Often the physiological and emotional state of a person can be associated with certain cortical activity that can cause certain thermal patterns on the person's forehead. Thus, thermal measurements of the forehead may be used to differentiate between user states. In one embodiment, a system includes at least one inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of at least first and second regions on the right side of a user's forehead (THR1 and THR2, respectively), and thermal measurements of at least third and fourth regions on the left side of the forehead (THL1 and THL2, respectively). The middles of the first and third regions are at least 1 cm above the middles of the second and fourth regions, respectively. The system also includes a computer that determines, based on THR1, THR2, THL1, and THL2, whether the user is in a normal state or an abnormal state.

Abstract: In order to enable collection of data from a head-mounted inward-facing camera, a clip-on device is attached to eyeglasses. The clip-on device optionally weighs less than 40 g and includes: (i) a body that may be attached and detached, multiple times, from a pair of eyeglasses in order to secure and release the clip-on device from the eyeglasses, (ii) an inward-facing camera fixed to the body, and (iii) a wireless communication module fixed to the body.

Abstract: Described herein are systems and methods for selecting a stressor based on thermal measurements. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on a periorbital area (THROI1) of the user. The computer detects extents of stress based on THROI1, receives indications of potential stressors to which the user was exposed while THROI1 were taken, and selects the stressor, from among the potential stressors, based on the indications and the extents. Optionally, during most of the time the user was affected by the stressor, the effect of the stressor, as manifested via changes to THROI1, was higher than the effects of most of the potential stressors. Optionally, thermal measurements of other regions on the face may also be utilized to detect the extents of stress.

Abstract: A Shock-Absorbing Energy Dissipation Padding (SAEDP) is coupled to the compartment of an autonomous on-road vehicle, and is located, during normal driving, at eye level in front of an occupant who sits in a front seat of the vehicle. The vehicle further includes a stiff element that supports the SAEDP and resists deformation during collision in order to reduce compartment intrusion. The stiff element is located, during normal driving, at eye level between the SAEDP and the outside environment. Optionally, a camera takes video of the outside environment in front of the occupant, and a computer generates for the occupant a representation of the outside environment.

Abstract: An autonomous on-road vehicle having an outer nontransparent Shock-Absorbing Energy Dissipation Padding (SAEDP). In one embodiment, the SAEDP is mounted, during normal driving, to the front side of the vehicle at eye level of an occupant who sits in a front seat of the vehicle. A camera is mounted to the vehicle and takes video of the outside environment in front of the occupant. And a computer generates a representation of the outside environment at eye level for the occupant.

Abstract: A large mirroring element is located in front of an occupant who sits in a front seat of an autonomous on-road vehicle. The large mirroring element provides the effect of reflecting light arriving from the occupant's direction. Optionally, a camera takes video of the outside environment in front of the occupant, sends the video to a computer that generates a representation of the outside environment in front of the occupant at eye level, and a display located in front of the occupant presents the representation to the occupant.