Abstract: One embodiment of an unmanned protective vehicle (UPV) includes a chassis, wheels, an engine, a barrier fixed to the chassis, and an autonomous driving system. The UPV has an opening which enables a manned vehicle to enter a space that is protected by the barrier. And the autonomous driving system is configured to drive the UPV in cooperation with the manned vehicle, while the manned vehicle is located inside the space. Having the manned vehicle inside the space of the UPV improves the survivability of the manned vehicle following a collision, while the manned vehicle is located inside the space, compared to the survivability of the manned vehicle following a collision, while the manned vehicle is not located inside the space.

Abstract: Software agents that correct biases in measurements of affective response. In one embodiment, a sensor takes a measurement of affective response of a user, where the measurement corresponds to an event in which the user has an experience. A computer generates a description of the event that includes factors characterizing the event which correspond to at least one of the following: the user, the experience, and the instantiation of the event. The computer identifies, based on the description, a certain factor characterizes the event, and computes a corrected measurement, which is different from the measurement taken by the sensor. The corrected measurement is computed by modifying the sensor values utilizing a model trained on data comprising: measurements of affective response of the user corresponding to events involving the user having various experiences, and descriptions of the events.

Abstract: Embodiments disclosed herein utilize biometric verification from wearable devices to approve access for shared spaces. Requests to occupy the shared spaces are received and conditional reservations are made pending health checks of the requesters. Prior to occupation, fresh biometric measurements are captured via the user's wearable device, which include physiological signals validating both ongoing good health as well as identity match to the original requester. When recent biometric verification indicates both healthy status and unchanged identity, access to the reserved space is approved. These embodiments securely manage reservations while protecting the health of other occupants through conditional access related to the requester's current health condition.

Abstract: Software agents collect measurements of affective response and provide them in a selective manner that maintains user privacy. In one embodiment, a sensor takes measurements of affective response of the user. A computer receives a request for an affective value indicative of an emotional response to an experience. The computer selects, from among the measurements, a certain measurement of affective response of the user that corresponds to an event in which the user had the experience. The computer then utilizes a model to calculate, based on the certain measurement, the affective value indicative of the emotional response of the user to experience. Optionally, the model is generated based on previously taken measurements of affective response of the user, taken while the user had various experiences, and indications of emotional responses the user had while said previously taken measurements were taken. The computer sends the affective value to fulfil the request.

Abstract: Embodiments disclosed herein involve a wearable-based system that can help determine in a privacy-preserving manner whether a user is healthy (and thus poses low risk of contagiousness), and use determinations of this nature to grant passage through a doorway. In one embodiment, a wearable device takes measurements of a user comprising a photoplethysmogram signal (PPG signal) and a temperature measurement. A computer calculates a health score based on a difference between baseline measurements of the user, measured one or more days earlier, and more current measurements of the user. Additionally, the computer calculates an extent of similarity between characteristics of the PPG signal in the current measurements and characteristics of the PPG signal in the baseline measurements. The computer authorizes the user's passage through the doorway responsive to the health score reaching a first threshold and the extent of the similarity reaching a second threshold.

Abstract: Systems, methods, and computer programs for efficient use of head-mounted cameras in eye tracking. In one embodiment, a system includes a head-mounted device that takes measurements indicative of positions of an eye of a user, and a head-mounted camera that captures images of the eye. A first range of eye positions trackable from the images is narrower than a second range of eye positions trackable from the measurements. A computer calculates the eye positions based on the measurements. When the eye positions fall within the first range, the computer reads images at a first bitrate from the head-mounted camera. And when the eye positions fall outside the first range, the computer refrains from reading images from the head-mounted camera, or reads the images from the head-mounted camera at a second bitrate that is less than half the first bitrate.

Abstract: Systems, methods, and computer programs for eye tracking. In one embodiment, an eye tracking system includes a head-mounted device that takes measurements indicative of a position of the eye of a user. A head-mounted camera captures an image of the eye. A computer calculates the position of the eye based on the measurements, utilizes the position of the eye to crop the image around the pupil, and provides a cropped image to a video-based eye tracker. Optionally, the size of the cropped image is less than a third of the size of its respective uncropped image. Optionally, the head-mounted device includes one or more of the following: a photosensor-oculography device (PSOG), an electrooculography device (EOG), an electromyography device (EMG), an optical flow sensor, and a range sensor. Optionally, the image-based eye tracker calculates, based on the cropped image, at least one of pupil diameter and pupillary response.

Abstract: Systems, methods, and computer programs for eye tracking involving a camera that is operated according to eyelid position. In one embodiment, an inward-facing head-mounted camera captures images of an eye. A head-mounted device emits electromagnetic waves towards the eye and measures reflections of these waves from the eye. The average rate of reflection measurements is at least ten times the average rate of image capture. A computer detects the position of at least one of the eyelids covering the eye based on the reflection measurements. And the camera operation is adjusted according to the eyelid position in a manner that decreases, in the captured images, areas depicting the eyelids, and optionally increases areas depicting the iris.

Abstract: Disclosed herein is utilization of photosensor-oculography along with a video camera to implement a novel form of eye tracking, which can be important for many applications, such as augmented reality (AR) on smartglasses. In one embodiment, an eye tracking system includes a photosensor-oculography device (PSOG) that emits light and takes measurements of reflections of the light from an eye of a user, and a camera that captures images of the eye. A computer calculates values indicative of eye movement velocity (EMV) based on the measurements of the reflections obtained by the PSOG. These values then are used to determine how data is read from the camera, which can save power in some cases: the computer reads data from the camera at a higher bitrate when the values are indicative of the EMV are below a threshold compared to when the values are indicative of the EMV are above the threshold.

Abstract: Disclosed herein is photosensor-based detection of facial landmarks that utilizes images in order to detect and account for sensor shifts. In one embodiment, a system that detects positions of facial landmarks includes a head-mounted device comprising: (i) light sources that emit light towards a first region on a user’s face, and (ii) discrete photosensors, spread over more than 2 cm, which take measurements of reflections of the light from the first region. The system also includes a head-mounted camera that captures images of a second region on the face. A computer calculates, based on the images, values indicative of a location and/or orientation of the device relative to the face, and detects, based on the reflections and the values, positions of facial landmarks at an average rate higher than an average rate at which the images are captured.

Abstract: A novel design for untethered smartglasses with wireless connectivity in which electronic components and electric wiring are mounted in a manner than enables at least a portion of temples of the smartglasses to be bent around the ear to improve the smartglasses' fit. In one embodiment, the smartglasses include a front element that supports lenses and two temples, coupled to the front element through hinges that enable folding and unfolding. At least one of the temples includes: a first portion coupled to the front element with first electronic components, a second portion coupled to the first portion with electric wires, and a third portion coupled to the second portion with second electronic components. The second portion is designed to be bent around a human ear to improve the smartglasses' fit, and the first and third portions are not designed to be bent to improve the smartglasses' fit.

Abstract: Disclosed herein is robust detection of facial expressions that accounts for interferences on the face. In one embodiment, a system includes a head-mounted device that comprises (i) light sources configured to emit light towards a first region on a user's face, and (ii) discrete photosensors, spread over more than 2 cm, which take measurements of reflections of the light from the first region. Additionally, the system includes a head-mounted camera that captures images of a second region on the face. A computer calculates, based on the images, an extent of presence of hair over a portion of the first region. Optionally, the computer calculates extents of other interferences such as perspiration, applied makeup, and skin infection. The computer then detects facial expressions of the user based on the measurements of the reflections and the calculated extent of the hair and/or other interferences.

Abstract: Some aspects of this disclosure involve generation of crowd-based results based on measurements of affective response of users. In some embodiments described herein, sensors are used to take measurements of affective response of at least ten users who were at a certain location. The measurements may include various values indicative of physiological signals and/or behavioral cues of the at least ten users. Some examples of locations in this disclosure include vacation destinations, businesses, establishments that provide entertainment, certain geographical regions, and virtual environments. User interfaces are configured to receive data describing a location score computed based on the measurements of the at least ten users, which represents the affective response of the at least ten users to being at the certain location. The user interfaces may be used to report the location score (e.g., to a user who may be interested in visiting the certain location).

Abstract: One embodiment of an unmanned protective vehicle (UPV) includes a chassis, wheels, an engine, a barrier fixed to the chassis, and an autonomous driving system. The UPV has an opening which enables a manned vehicle to enter a space that is protected by the barrier. And the autonomous driving system is configured to drive the UPV in cooperation with the manned vehicle, while the manned vehicle is located inside the space. Having the manned vehicle inside the space of the UPV improves the survivability of the manned vehicle following a collision, while the manned vehicle is located inside the space, compared to the survivability of the manned vehicle following a collision, while the manned vehicle is not located inside the space.

Abstract: Disclosed herein is robust detection of facial expressions that accounts for interferences on the face. In one embodiment, a system includes a head-mounted device that comprises (i) light sources configured to emit light towards a first region on a user's face, and (ii) discrete photosensors, spread over more than 2 cm, which take measurements of reflections of the light from the first region. Additionally, the system includes a head-mounted camera that captures images of a second region on the face. A computer calculates, based on the images, an extent of presence of hair over a portion of the first region. Optionally, the computer calculates extents of other interferences such as perspiration, applied makeup, and skin infection. The computer then detects facial expressions of the user based on the measurements of the reflections and the calculated extent of the hair and/or other interferences.

Abstract: Disclosed herein is utilization of photosensor-oculography along with a video camera to implement a novel form of eye tracking, which can be important for many applications, such as augmented reality (AR) on smartglasses. In one embodiment, an eye tracking system includes a photosensor-oculography device (PSOG) that emits light and takes measurements of reflections of the light from an eye of a user, and a camera that captures images of the eye. A computer calculates values indicative of eye movement velocity (EMV) based on the measurements of the reflections obtained by the PSOG. These values then are used to determine how data is read from the camera, which can save power in some cases: the computer reads data from the camera at a higher bitrate when the values are indicative of the EMV are below a threshold compared to when the values are indicative of the EMV are above the threshold.

Abstract: Disclosed herein is utilization of windowing for efficient capturing of imaging photoplethysmogram signals (iPPG signals) with head-mounted cameras (e.g., cameras mounted to frames of smartglasses). In order to save power involved in obtaining iPPG signals, in one embodiment, a head-mounted camera with an image sensor that supports changing of its region of interest (ROI) is utilized to capture images of a region comprising skin on a user's head. A computer calculates quality scores for iPPG signals extracted from windows in the images, and selects a proper subset of the iPPG signals whose quality scores reach a threshold. The computer then reads from the camera at least one ROI that covers one or more of the windows from which the proper subset of the iPPG signals is extracted. Optionally, the at least one ROI read from the camera covers below 75% of the skin region's area.

Abstract: One embodiment of an unmanned carrier for carrying urban manned vehicles includes a computer, a motorized lift, an autonomous-driving control system, and a safety frame. The computer synchronizes pick-up of manned vehicles by the unmanned carrier; wherein each manned vehicle is an autonomous on-road vehicle that transports one or more occupants in a compartment, is authorized by law to drive in a residential neighborhood, and is unauthorized by law to drive on the highway on its own because it is not safe enough for highway speed. The motorized lift enables the manned vehicles to get on and get off the unmanned carrier without human intervention. The autonomous-driving control system navigates the unmanned carrier autonomously on a highway. And the safety frame protects the occupants who sit in the carried manned vehicles during a collision at highway speed.

Abstract: Software agents collect measurements of affective response and provide them in a selective manner that maintains user privacy. In one embodiment, a sensor takes measurements of affective response of the user. A computer receives a request for an affective value indicative of an emotional response to an experience. The computer selects, from among the measurements, a certain measurement of affective response of the user that corresponds to an event in which the user had the experience. The computer then utilizes a model to calculate, based on the certain measurement, the affective value indicative of the emotional response of the user to experience. Optionally, the model is generated based on previously taken measurements of affective response of the user, taken while the user had various experiences, and indications of emotional responses the user had while said previously taken measurements were taken. The computer sends the affective value to fulfil the request.

Abstract: Software agents and smart contracts may assist users to control how their measurements of affective response are used and how they are compensated for providing their measurements. In one embodiment, a computer receives a measurement of affective response of a user to an experience, and also receives a request indicative of compensation to be provided to the user for a disclosure of a score for the experience. The score is to be calculated based on the measurement of the user and additional measurements of affective response of other users to the experience. The computer calculates a risk to privacy of the user due to a disclosure of the score. Responsive to the risk being below a first threshold and the compensation reaching a second threshold, the computer signs on behalf of the user, a smart contract that facilitates the disclosure of the score and a transfer of the compensation.