Abstract: Various implementations disclosed herein include devices, systems, and methods that determine an interaction event during presentation of an interaction element. For example, an example process may include obtaining physiological data associated with a pupil during presentation of an interaction element, determining, based on the obtained physiological data, a pupillary response during the presentation of the interaction element, determining that the pupillary response corresponds to attention response characteristics associated with attention of a region of the regions of the interaction element based on the different illumination characteristics of the regions, and determining an interaction event during the presentation of the interaction element based on determining that the pupillary response corresponds to directing attention to the region during the presentation of the interaction element.

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine an attentive state of a user during an experience (e.g., visual and/or auditory content that could include real-world physical environment, virtual content, or a combination of each) based on the user's gaze characteristic(s) to enhance the experience. For example, an example process may include obtaining physiological data associated with a gaze of a user during an experience, determine a gaze characteristic during a segment of the experience based on the obtained physiological data, and determine that the user has a first attentive state during the segment of the experience based on classifying the gaze characteristic of the user during the segment of the experience.

Abstract: Some implementations disclosed herein present multimedia content to a user, identify a comfort state of the user (e.g., happy, unhappy, distressed, etc.) based on body data of the user (e.g., facial expressions, hand movements, physiological data, etc.), and update the multimedia content based on the identified comfort state.

Abstract: Respiration data is measured from point cloud data containing points associated with an upper body of a user. A device may receive the point cloud data via a wired or wireless connection or may generate it from one or more image sensors integrated into the device. Movement of points associated with the upper body, or within a region of interest, may be measured to estimate a breath signal. The estimated breath signal may be further processed to derive values representative of the breath signal. The breath signal may be then provided to a given application or location.

Abstract: Various implementations disclosed herein include devices, systems, and methods that adjust image content to reduce motion sickness during an experience. For example, an example process may include determining a first zone and a second zone of a display, generating images of a three-dimensional (3D) environment, identifying image content of each of the images corresponding to the second zone of the display, and reducing at least one of contrast or spatial frequency of the image content of each of the images corresponding to the second zone of the display.

Abstract: One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.

Abstract: A head-mountable device includes a display portion a facial interface, a stiffness profile modifier, a sensor, and a securement assembly. The display portion includes a display. The facial interface has a variable stiffness profile. The stiffness profile modifier is configured to automatically change the facial interface from having a first stiffness profile to having a second stiffness profile in response to sensor data. The sensor is configured to generate the sensor profile data. The securement assembly is connectable to the display portion. The securement assembly includes a removable strap and a retention band that is connectable to the removable strap. The removable strap includes electronics.

Abstract: A head-mounted device includes a display device that is configured to display content to a user, a support structure including a contact pad configured to engage a face of the user to support the display device with respect to the face of the user, a sensor that generates a sensor output signal, and a tension adjuster configured to move the contact pad relative to the support structure based on the sensor output signal to restrain motion of the display device with respect to the face of the user.

Abstract: Various implementations disclosed herein include devices, systems, and methods that assess physiological data of a user and a scene understanding of a physical environment to determine a retention state. For example, an example process may include obtaining physiological data in an environment during a first period of time. The process may further include identifying one or more of the objects in the environment based on determining a scene understanding of the environment. The process may further include determining, based on the physiological data and the scene understanding, features associated with interaction events for the one or more objects. The process may further include determining, based on the features, a retention state during the first period of time, the retention state associated with retention of a concept associated with an object of the one or more objects. The process may further include providing feedback based on identifying the retention state.

Abstract: One exemplary implementation displays a visual characteristic associated with an object on a display of a device and utilizes a sensor of the device to obtain physiological data associated with a pupillary response of a user to the visual characteristic. The device adjusts the visual characteristic based on the obtained physiological data to enhance pupillary responses of the user to the object and displays the adjusted visual characteristic to the user. For example, the adjusted visual characteristic may be selected based on previously identified pupillary responses of the user to particular visual characteristics.

Abstract: A wearable electronic device may be provided that includes a first image sensor oriented to capture luminance of an area of skin around a user's eye when wearing the wearable electronic device and a second image sensor oriented to capture luminance of an area of skin around the user's nose when wearing the wearable electronic device. The wearable electronic device further includes a processor configured to determine a pulse signal based on changes in luminance captured over time using at least one of the first image sensor or the second image sensor.

Abstract: Various implementations disclosed herein include devices, systems, and methods that adjust image content to reduce motion sickness during an experience. For example, an example process may include determining a first zone and a second zone of a display, generating images of a three-dimensional (3D) environment, identifying image content of each of the images corresponding to the second zone of the display, and reducing at least one of contrast or spatial frequency of the image content of each of the images corresponding to the second zone of the display.

Abstract: One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.

Abstract: Some implementations disclosed herein present a computer-generated reality (CGR) environment in which a user participates in an activity, identify a cognitive state of the user (e.g., working, learning, resting, etc.) based on data regarding the user's body (e.g., facial expressions, hand movements, physiological data, etc.), and update the environment with a surrounding environment that promotes a cognitive state of the user for the activity.

Abstract: A head-mounted device includes a device housing, a support structure that is connected to the device housing to support the device housing with respect to a user, a display device that is connected to the device housing to display content, an optical system that is associated with the display device, and sensors that generate sensor output signals. The head-mounted device also includes a tension controller that determines a tensioning command based on the sensor output signals, and a tension adjuster that applies tension to the user according to the tensioning command in order to restrain motion of the device housing with respect to the user.

Abstract: In accordance with some embodiments, exemplary techniques for transitioning from the physical environment to a computer-generated reality environment on a wearable electronic device is described. In accordance with some embodiments, exemplary techniques for transitioning out of a computer-generated reality environment on a wearable electronic device is described.

Abstract: One exemplary implementation displays a visual characteristic associated with an object on a display of a device and utilizes a sensor of the device to obtain physiological data associated with a pupillary response of a user to the visual characteristic. The device adjusts the visual characteristic based on the obtained physiological data to enhance pupillary responses of the user to the object and displays the adjusted visual characteristic to the user. For example, the adjusted visual characteristic may be selected based on previously identified pupillary responses of the user to particular visual characteristics.

Abstract: Sensor data indicating a user's response to an avatar experience in which the user experiences a rendered avatar model is obtained. A perceptual quality metric value corresponding to the rendered avatar model is determined based on the sensor data and a determined relationship between the sensor data and the perceptual quality metric value. The avatar model is re-rendered for display based on the perceptual quality metric value.

Abstract: Devices, systems, and methods that provide content that distracts a user's attention away from discomfort, for example, occurring due to a prior injury or ongoing medical condition. The content is adjusted over time based on tracking the user's attentiveness towards the content. Specifically, the user's current attentive state may be tracked using physiological sensors and used to adapt content to mitigate the perception of discomfort. In some implementations, the user's stress is also assessed and used an indication of the user's current discomfort level to better track when the user's attentive state is shifting from the content to the discomfort and adjust the content accordingly.

Abstract: Some implementations disclosed herein present a computer-generated reality (CGR) environment in which a user participates in an activity, identify a cognitive state of the user (e.g., working, learning, resting, etc.) based on data regarding the user's body (e.g., facial expressions, hand movements, physiological data, etc.), and update the environment with a surrounding environment that promotes a cognitive state of the user for the activity.