Abstract: Described herein are systems and methods for detecting a physiological response based on thermal measurements while accounting for consumption of a confounding substance such as a medication, alcohol, caffeine, or nicotine. In one embodiment, a system includes a computer and an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a region of interest (THROI) on a user's face. The computer receives an indication indicative of the user consuming a confounding substance that affects THROI, and detects the physiological response while the consumed confounding substance affects THROI. The detection is based on THROI, the indication and a model. Optionally, the model was trained on: a first set of THROI taken while the confounding substance affected THROI, and a second set of THROI taken while the confounding substance did not affect THROI.

Abstract: Described herein are systems and methods for detecting a stress level of a user. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on a periorbital area (THROI1) of the user. The computer generates feature values based on THROI1, and utilizes a model to detect the stress level based on the feature values. The model was trained based on: previous THROI1 taken while the user was under elevated stress, and other previous THROI1 taken while the user was not under elevated stress. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized to detect the stress level.

Abstract: Brain activity, and in particular which hemisphere is relatively more effective, is correlated with the dominant nostril (i.e., the nostril through which most of the air is exhaled when breathing through the nose). Thus, identifying which of the nostrils is dominant may have various applications. Described herein are systems and methods for identifying the dominant nostril. In one embodiment, a system includes at least one inward-facing head-mounted thermal camera (CAM) and a computer. The at least one CAM does not occlude any of the user's mouth and nostrils and is used to take thermal measurements of first and second regions below the right and left nostrils (THROI1 and THROI2, respectively). The computer identifies the dominant nostril based on THROI1 and THROI2. Optionally, the computer detects, utilizing THROI1 and THROI2, the three-dimensional (3D) shape of the exhale stream from at least one of the nostrils.

Abstract: Described herein are systems and methods for detecting a physiological response based on facial skin color changes (FSCC) recognizable in images taken with an inward-facing head-mounted visible-light camera (VCAMin). Some examples of physiological responses whose manifestation involves FSCC include emotional responses (which at times may be hidden to the naked eye), and physiological signals such as a heart rate, heart rate variability, and/or a breathing rate. In one embodiment, a system that detects a physiological response based on FSCC includes VCAMin that takes images of a region of interest (IMROI) on a user's face, which is illuminated by ambient light, and a computer that detects the physiological response based on FSCC recognizable in IMROI. Optionally, the system includes an outward-facing head-mounted visible-light camera (VCAMout) that takes images of the environment (IMENV), and the computer detects the physiological response also based on IMENV.

Abstract: Described herein are systems and methods for detecting a physiological response based on thermal measurements while accounting for touching the face. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a region of interest (THROI) on a user's face, and a sensor that provides measurements (M) indicative of times at which the user touches the region of interest (ROI). The system also includes a computer that detects the physiological response based on THROI and M. Optionally, the computer generates feature values based on THROI and M, and utilizes a model to detect, based on the feature values, the physiological response. Optionally, the model was trained based on samples, each including: (i) feature values generated based on previous THROI taken while M indicated touching the ROI, and (ii) a corresponding label indicative of an extent of the physiological response.

Abstract: Some aspects of this disclosure involve ranking types of food based on measurements of affective response of users who consumed the types of food. In one embodiment, a system that ranks types of food includes sensors that take measurements of affective response of users and a computer. The computer receives indications of times at which the users consumed the types of food and selects for each type of food, based on the indications, measurements of at least five of the users taken up to four hours after consuming the type of food. The computer ranks the types of food based on the selected measurements. Optionally, each of the types of food is a different item on a menu comprising food items.

Abstract: One aspect of this disclosure involves a wearable device that includes a frame that is worn on a user's head, and an inward-facing camera (camera) physically coupled to the frame. The optical axis of the camera is either above the Frankfort horizontal plane and pointed upward to capture an image of a region of interest (ROI) above the user's eyes, or the optical axis is below the Frankfort horizontal plane and pointed downward to capture an image of an ROI below the user's eyes. The camera includes a sensor and a lens. The sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image. The Scheimpflug principle is a geometric rule that describes the orientation of the plane of focus of a camera when the lens plane is tilted relative to the sensor plane.

Abstract: Wearable devices for taking symmetric thermal measurements. One device includes first and second thermal cameras physically coupled to a frame worn on a user's head. The first thermal camera takes thermal measurements of a first region of interest that covers at least a portion of the right side of the user's forehead. The second thermal camera takes thermal measurements of a second ROI that covers at least a portion of the left side of the user's forehead. Wherein the first and second thermal cameras are not in physical contact with their corresponding ROIs, and as a result of being coupled to the frame, the thermal cameras remain pointed at their corresponding ROIs when the user's head makes angular movements.

Abstract: A wearable system configured to collect thermal measurements related to respiration. The system includes a frame configured to be worn on a user's head, and at least one non-contact thermal camera (e.g., thermopile or microbolometer based sensor). The thermal camera is small and lightweight, physically coupled to the frame, located close to the user's face, does not occlude any of the user's mouth and nostrils, and is configured to take thermal measurements of: a portion of the right side of the user's upper lip, a portion of the left side of the user's upper lip, and a portion of the user's mouth. The thermal measurements are forwarded to a computer that calculates breathing related parameters, such as breathing rate, an extent to which the breathing was done through the mouth, an extent to which the breathing was done through the nostrils, and ratio between exhaling and inhaling durations.

Abstract: Some aspects of this disclosure involve computation of a preference score for a certain type of food. In some embodiments described herein, measurements of affective response of at least ten users are collected. The measurements may include various values indicative of physiological signals and/or behavioral cues of the at least ten users. Each measurement of a user is taken with a sensor coupled to the user up to four hours after the user consumed the certain type of food. A preference score is computed based on the measurements. The preference score is indicative of how much the at least ten users enjoyed consuming the certain type of food and/or how well they felt after consuming the certain type of food.

Abstract: Described herein are embodiments of systems, method, and computer programs for estimating affective response to a token instance of interest utilizing a predicted affective response to a background token instance. The affective response is computed based on the difference between a measured affective response of the user and the predicted affective response. Where the measured affective response is a measurement of the affective response of the user to a simultaneous exposure to both the background token instance and the token instance of interest.

Abstract: Described herein is utilization of nontransparent Shock-Absorbing Energy Dissipation Padding (SAEDP) in an autonomous on-road vehicle. In one embodiment, the vehicle includes a side window located at eye level of an occupant who sits in the vehicle. The side window enables the occupant to see the outside environment. A motor is configured to move the SAEDP over a sliding mechanism between first and second states. A processor is configured to command the motor to move the SAEDP from the first state to the second state responsive to an indication that a probability of an imminent collision reaches a threshold. In the first state, the SAEDP does not block the occupant's eye level view to the outside environment, and in the second state, the SAEDP blocks the occupant's eye level view to the outside environment in order to protect the occupant's head against hitting the side window during collision.

Abstract: A safety system for an autonomous vehicle that may be used to warn an occupant engaged in a certain activity that involves handling an object that can harm the occupant in an event of a Sudden Decrease in Ride Smoothness (an SDRS event). The safety system includes a camera that takes images of the occupant and a computer that estimates, based on the images, whether the occupant is engaged in the certain activity. The computer receives from an autonomous-driving control system an indication of whether an SDRS event is imminent. Responsive to both receiving an indication of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer commands a user interface to warn the occupant shortly before the SDRS event.

Abstract: This disclosure describes various systems for collecting thermal measurements of regions of a user's face. Each of the systems includes a frame configured to be worn on the user's head, and one or more lightweight thermal cameras that are coupled to the frame and configured to take thermal measurements of a region of interest on the user's face. Due to their coupling to the frame, the thermal cameras remain pointed at their respective regions of interest event when the user's head performs angular movements. The thermal measurements collected by some embodiments of the systems described herein may be utilized for a variety of applications that involve detecting different types of physiological responses or medical disorders.

Abstract: Described herein are embodiments of systems, methods, and computer programs for estimating affective response to a token instance of interest. A measurement of affective response of the user to a temporal window of token instances is taken. A token instance belonging to the window is selected as a token instance of interest based on an attention level of the user, and is removed from the temporal window of token instances. A predicted affective response to the temporal window of token instances from which the token instance of interest is removed is computed. The affective response to the token instance of interest is computed based on the difference between the measured affective response of the user and the predicted affective response.

Abstract: A user may be exposed to multiple token instances representing stimuli that may influence the affective state of the user. Described herein are embodiments of systems, method, and computer programs for estimating affective response to a token instance of interest, selected from among the token instances. The token instance of interest is selected based on attention levels derived from eye-tracking data. In one example embodiment, the token instance of interest is a token instance in which the attention of the user is higher than the attention level of the user in at least one other token instance to which the user is exposed at the same time.

Abstract: Described herein are systems, methods, and computer programs for detecting an allergic reaction. In one embodiment, a system configured to detect an allergic reaction of a user, includes: a frame configured to be worn on the user's head; a thermal camera, weighing less than 5 g, physically coupled to the frame, located less than 10 cm away from the user's face, and configured to take thermal measurements of at least part of the user's nose (THN); and a circuit configured to determine an extent of the allergic reaction based on THN.

Abstract: A user may be exposed to multiple token instances representing stimuli that may influence the affective state of the user. Described herein are embodiments of systems, method, and computer programs for estimating affective response to a token instance of interest, selected from among the token instances. The token instance of interest is selected based on attention levels received from an external source such as, information received from other users, information received from analysis of communications of the users, and/or information received from an external site such as an online retailer or a social network. In one example embodiment, the token instance of interest is a token instance for which attention level of the user is higher than at least one other token instance.

Abstract: Some aspects of this disclosure include systems, methods, and/or computer programs that may be used to reduce power consumed to measure affective response of a user to content presented via a display of a head-mounted system such as an augmented reality system or a virtual reality system. In one embodiment, a controller selects a mode of operation for a sensor coupled to the head-mounted system based on a received indication. The mode of operation is selected from a set comprising first and second modes of operation, and the sensor is configured to consume significantly less power while operating at the first mode of operation compared to the power it is configured to consume while operating at the second mode of operation.

Abstract: Systems and methods for selective transmissions of sensor measurements of affective response to content. In one embodiment, a vote analyzer receives an indication that a user provided, via a voting mechanism, a vote regarding a segment of content consumed by the user. The vote analyzer determines whether the user consumed the segment in a duration that is shorter than a predetermined threshold; the predetermined threshold is selected such that, while consuming the segment in a period of time shorter than the predetermined threshold, the user is likely to have a single dominant emotional response to the segment. Accordingly, a transmitter may send a request to a measuring module to transmit measurements of the affective response of the user, taken by a sensor, which relate to consumption of the segment.