Abstract: Various embodiments set forth systems and techniques for explaining domain-specific terms detected in a media content stream. The techniques include detecting a speech portion included in an audio signal; determining that the speech portion comprises a domain-specific term; determining an explanatory phrase associated with the domain-specific term; and integrating the explanatory phrase associated with the domain-specific term into playback of the audio signal.

Abstract: Embodiments of the present disclosure set forth a computer-implemented method comprising receiving, from at least one sensor, sensor data associated with an environment, generating, based on the sensor data, a set of lane change data values associated with positions of at least two vehicles relative to a first lane position in the environment, determining, based on the set of lane change data values, a collision risk value associated with the at least two vehicles attempting to occupy the first lane position, and generating, based on the collision risk value, an output signal to a first vehicle included in the at least two vehicles.

Abstract: A context-aware safety device includes a wireless transceiver, a memory storing an application, and one or more processors. When executing the application, the one or more processors are configured to determine a context of a safety device, configure an alert based on the determined context, and broadcast the configured alert using the wireless transceiver.

Abstract: In various embodiments, while a self-driving model operates a vehicle, a user monitoring subsystem acquires sensor data associated with a user of the vehicle and a vehicle observation subsystem acquires sensor data associated with the vehicle. The user monitoring subsystem computes values for a psychological metric based on the sensor data associated with the user. Based on the values for the psychological metric, a feedback application determines a description of the user over a first time period. The feedback application generates a dataset based on the description and the sensor data associated with the vehicle. Subsequently, a training application performs machine learning operation(s) on the self-driving model based on the dataset to generate a modified self-driving model. Advantageously, the dataset enables the training application to automatically modify the self-driving model to account for the impact different driving actions have on the user.

Abstract: Embodiments of the present disclosure sets forth a computer-implemented method comprising obtaining a starting location and a destination location, determining a plurality of routes from the starting location to the destination location, obtaining affective-cognitive load (ACL) data associated with the plurality of routes, selecting a route included in the plurality of routes based on the ACL data, and transmitting the selected route for output.

Abstract: Embodiments of the present disclosure sets forth a computer-implemented method comprising receiving, from at least one sensor, sensor data associated with an environment, computing, based on the sensor data, a cognitive load associated with a user within the environment, computing, based on the sensor data, an affective load associated with an emotional state of the user, determining, based on both the cognitive load at the affective load, an affective-cognitive load, determining, based on the affective-cognitive load, a user readiness state associated with the user, and causing one or more actions to occur based on the user readiness state.

Abstract: A system for interactions with an autonomous vehicle includes a proprioceptive device; and a controller. The controller is configured to: detect a first condition external to the autonomous vehicle; generate a first proprioceptive output in response to the first condition, the first proprioceptive output changing a shape of the proprioceptive device; receive a first input force from the proprioceptive device; determine a first user input based on the first input force; and, based on the first user input, cause the autonomous vehicle to perform a navigation action.

Abstract: A system includes a sensing module configured to collect physiological information from a user; an audio input device configured to capture auditory content that is in an environment proximate the user; and one or more processors configured to: determine that a user has entered a state of inwardly focused attention based on first physiological information collected from the user; and in response, record the auditory content captured by the audio input device.

Abstract: A virtual private assistant (VPA) is configured to analyze various types of input that indicate one or more behaviors associated with a user and to determine the emotional state of the user based on the input. The VPA also determines one or more operations to perform on behalf of the user based on the input and the determined emotional state. The VPA then executes the one or more operations and synthesizes an output based on the emotional state of the user and the one or more operations. The synthesized output includes one or more semantic components and one or more emotional components derived from the emotional state of the user. The VPA observes the behavior of the user in response to the synthesized output and then implements various modifications, based on the observed behavior, to improve the effectiveness of future interactions with the user.

Abstract: Embodiments of the present disclosure sets forth a computer-implemented method comprising receiving, from at least one sensor, sensor data associated with an environment, computing, based on the sensor data, a cognitive load associated with a user within the environment, computing, based on the sensor data, an affective load associated with an emotional state of the user, determining, based on both the cognitive load at the affective load, an affective-cognitive load, determining, based on the affective-cognitive load, a user readiness state associated with the user, and causing one or more actions to occur based on the user readiness state.

Abstract: Embodiments of the present disclosure set forth a computer-implemented method comprising detecting an initial phrase portion included in a first auditory signal generated by a user, identifying, based on the initial phrase portion, a supplemental phrase portion that complements the initial phrase portion to form a complete phrase, and providing a command signal that drives an output device to generate an audio output corresponding to the supplemental phrase portion.

Abstract: Embodiments of the present disclosure set forth a computer-implemented method for identifying an object within an environment comprising receiving, via at least one sensor, first sensor data associated with an environment, storing, in a memory, the first sensor data in association with a first scene, and in response to receiving a user request for information associated with the environment, selecting, based on the user request, the first scene, accessing, via the memory, the first sensor data associated with the first scene, and, analyzing the first sensor data to identify a first object included in the first scene, and causing information associated with the first object to be output via at least one output device.

Abstract: In various embodiments, a driver sensing subsystem computes a characterization of a driver based on physiological attribute(s) of the driver that are measured as the driver operates a vehicle. Subsequently, a driver assessment application uses a confidence level model to estimate a confidence level of the driver based on the characterization of the driver. The driver assessment application then causes driver assistance application(s) to modify at least one functionality of the vehicle based on the confidence level. Advantageously, by enabling the driver assistance application(s) to take into account the confidence level of the driver, the driver assessment application can improve driving safety relative to conventional techniques for implementing driver assistance applications that disregard the confidence levels of drivers.

Abstract: Techniques for modifying sound based on a direction of interest include determining a direction of interest associated with a user; receiving a set of audio signals associated with the direction of interest; determining one or more salient frequency bands within the set of audio signals; in response to receiving a command from the user to enhance or suppress the set of audio signals, enhancing or suppressing a portion of the set of audio signals corresponding to the one or more salient frequency bands to create a modified set of audio signals; and outputting the modified set of audio signals.

Abstract: Disclosed embodiments include techniques for providing alerts to a driver of a vehicle. The techniques include detecting a condition that exceeds a threshold hazard potential; detecting a predetermined gesture of a driver, the predetermined gesture indicating that the driver has acknowledged the detected condition; in response to detecting the predetermined gesture, reducing an urgency level for alerting the driver of the detected condition; and determining whether to issue an alert to the driver based on the reduced urgency level.

Abstract: A system may present notifications to an occupant of a vehicle and determine whether the occupant has given attention to the notification. The system oscillates a visual notification at an output frequency. The system captures images of an eye of the occupant to determine an eye pupil oscillation frequency associated with the occupant. The system compares the eye pupil oscillation frequency to the output frequency. The system determines whether attention was given to the notification based on whether the output frequency and the eye pupil oscillation frequency match. If the system determines that attention was not given, the system may cause performance of one or more follow-up operations.

Abstract: Embodiments of the present disclosure sets forth a computer-implemented method comprising obtaining sensor data associated with a driver of a vehicle, determining a state associated with the driver based on the sensor data, and transmitting the state associated with the driver to a teleconference session, wherein the driver is at least one of a participant or an invitee to the teleconference session.

Abstract: One or more embodiments include an emotion analysis system for computing and analyzing emotional state of a user. The emotion analysis system acquires, via at least one sensor, sensor data associated with a user. The emotion analysis system determines, based on the sensor data, an emotional state associated with a user. The emotion analysis system determines a first component of the emotional state that corresponds to media content being accessed by the user. The emotion analysis system applies a first function to the emotional state to remove the first component from the emotional state.

Abstract: One or more embodiments include techniques for providing an alert, based on monitoring of a driver, via a pedestrian-based vehicle-to-pedestrian (V2P) system associated with a pedestrian. A pedestrian-based V2P system receives, from a vehicle-based V2P system, data related to an awareness level of the driver of the vehicle. The data may include data specifying the awareness level of a driver with respect to a pedestrian, metrics that are determinative of the awareness level of the driver, raw measurement data from the internally facing sensors and/or externally facing sensors, alerts in digitized audio or other suitable format to transmit to the pedestrian, and/or the like. The pedestrian-based V2P system generates an alert based on at least one of a location of the vehicle and the awareness level of the driver of the vehicle. The pedestrian-based V2P system transmits the alert to an output device.

Abstract: One or more embodiments include an audio processing system for generating an audio scene for an extended reality (XR) environment. The audio processing system determines that a first virtual sound source associated with the XR environment affects a sound in the audio scene. The audio processing system generates a sound component associated with the first virtual sound source based on a contribution of the first virtual sound source to the audio scene. The audio processing system maps the sound component to a first loudspeaker included in a plurality of loudspeakers. The audio processing system outputs at least a first portion of the component for playback on the first loudspeaker.