Abstract: Embodiments of the present disclosure sets forth a computer-implemented method comprising acquiring image information associated with an environment, acquiring, from one or more sensors, sensor data associated with a gaze of a user, determining a source of interest based on the image information and the sensor data, processing a set of audio signals associated with the environment based on the image information to identify an audio signal associated with the source of interest, enhancing the audio signal associated with the source of interest relative to other audio signals in the set of audio signals, and outputting the enhanced audio signal associated with the source of interest to the user.

Abstract: In various embodiments, a communication application selectively modifies sounds associated with a selected location or entity in one or more images. In operation, the communication application receives an image of an environment of a first device and an audio signal associated with the environment. The communication application receives first user input selecting a location in the image, and modifies a first sound included in the audio signal based on the selected location in the image, where at least a portion of the audio signal is unmodified.

Abstract: A system for interacting with an autonomous vehicle includes a sensor included in the autonomous vehicle and configured to generate sensor data corresponding to a projected hailing area; a projection system included in the autonomous vehicle and configured to generate the projected hailing area on a surface proximate the autonomous vehicle; and a processor included in the autonomous vehicle and configured to execute instructions to: analyze the sensor data to detect the person within the projected hailing area; and in response to detecting the person within the projected hailing area, cause an acknowledgment indicator to be outputted.

Abstract: In various embodiments, a sound modification application selectively modifies one or more sounds included in one or more audio signals. In operation, the sound modification application determines classifications associated with multiple sounds included in one or more audio signals. The sound modification application selects a first frequency sub-band of a first sound included in the multiple sounds based on a first classification associated with the first sound. The sound modification application then modifies the first frequency sub-band of the first sound, without modifying at least a second frequency sub-band of the first sound, to generate a modified audio signal.

Abstract: Various embodiments set forth systems and techniques for explaining domain-specific terms detected in a media content stream. The techniques include detecting a speech portion included in an audio signal; determining that the speech portion comprises a domain-specific term; determining an explanatory phrase associated with the domain-specific term; and integrating the explanatory phrase associated with the domain-specific term into playback of the audio signal.

Abstract: One embodiment of the present disclosure sets forth a technique for delivering audio content to a user. The technique includes analyzing audio content to determine a frequency at which to vibrate an effector. The technique further includes configuring one or more haptic output devices to generate haptic output that generates a haptic trap proximate to the effector. The technique further includes configuring the one or more haptic output devices to modify the haptic output to cause the haptic trap to vibrate the effector at the determined frequency. The effector vibrates to transmit the audio content. In one embodiment, the effector vibrates a skull of a user.

Abstract: In various embodiments, an alert personalization application personalizes in-vehicle alerts. The alert personalization application estimates an increase in a negative emotion associated with an occupant of a vehicle based on at least one characteristic of the occupant. Subsequently, the alert personalization application determines that the increase is associated with a negative reaction to an in-vehicle alert that has a first alert characteristic. In response, the alert personalization application determines that the first alert characteristic should be replaced with a second alert characteristic. The alert personalization causes another in-vehicle alert to be generated that has the second alert characteristic instead of the first alert characteristic. Advantageously, personalizing alert characteristics that influence how and/or when in-vehicle alerts are generated can increase the effectiveness of in-vehicle alerts and can improve driving safety.

Abstract: Techniques for determining a cognitive reaction to a software application update include determining that a software application executing on a computing device has been modified into an updated software application; acquiring, via at least one sensor, sensor data associated with a user of the updated software and determining, based on the sensor data, at least one of a cognitive workload and an emotional state associated with a user interaction with a feature of the updated software application.

Abstract: Techniques for auditory augmented reality using selective noise cancellation include receiving an input signal capturing an ambient auditory environment; separating the input signal into a set of audio signals that includes first and second component signals; and in response to generating the set of audio signals: generating a context-sensitive user interface that displays a plurality of first controls for modifying the first component signal and a plurality of second controls for modifying the second component signal, the plurality of first controls being independent from the plurality of second controls; receiving, from a user, a selection to remove the first component signal; and in response to receiving the selection: removing the first component signal from the set of audio signals to generate a modified set of audio signals that includes the second component signal; and driving an audio output device to generate sound based on the modified set of audio signals.

Abstract: Techniques for communication of autonomous vehicle actions include receiving an intended driving action associated with an autonomous vehicle, determining an intent communication scenario associated with the autonomous vehicle, and based on the intent communication scenario, causing a visualization indicating the intended driving action to be projected onto a roadway.

Abstract: Techniques for modifying sound based on a direction of interest include determining a direction of interest associated with a user; receiving a set of audio signals associated with the direction of interest; determining one or more salient frequency bands within the set of audio signals; in response to receiving a command from the user to enhance or suppress the set of audio signals, enhancing or suppressing a portion of the set of audio signals corresponding to the one or more salient frequency bands to create a modified set of audio signals; and outputting the modified set of audio signals.

Abstract: Disclosed embodiments include techniques for providing alerts to a driver of a vehicle. The techniques include detecting a condition that exceeds a threshold hazard potential; detecting a predetermined gesture of a driver, the predetermined gesture indicating that the driver has acknowledged the detected condition; in response to detecting the predetermined gesture, reducing an urgency level for alerting the driver of the detected condition; and determining whether to issue an alert to the driver based on the reduced urgency level.

Abstract: A system includes a sensing module configured to collect physiological information from a user; an audio input device configured to capture auditory content that is in an environment proximate the user; and one or more processors configured to: determine that a user has entered a state of inwardly focused attention based on first physiological information collected from the user; and in response, record the auditory content captured by the audio input device.

Abstract: Embodiments of the present disclosure set forth a computer-implemented method comprising detecting an initial phrase portion included in a first auditory signal generated by a user, identifying, based on the initial phrase portion, a supplemental phrase portion that complements the initial phrase portion to form a complete phrase, and providing a command signal that drives an output device to generate an audio output corresponding to the supplemental phrase portion.

Abstract: One or more embodiments include techniques for providing an alert, based on monitoring of a driver, via a pedestrian-based vehicle-to-pedestrian (V2P) system associated with a pedestrian. A pedestrian-based V2P system receives, from a vehicle-based V2P system, data related to an awareness level of the driver of the vehicle. The data may include data specifying the awareness level of a driver with respect to a pedestrian, metrics that are determinative of the awareness level of the driver, raw measurement data from the internally facing sensors and/or externally facing sensors, alerts in digitized audio or other suitable format to transmit to the pedestrian, and/or the like. The pedestrian-based V2P system generates an alert based on at least one of a location of the vehicle and the awareness level of the driver of the vehicle. The pedestrian-based V2P system transmits the alert to an output device.

Abstract: Embodiments of the present disclosure sets forth a computer-implemented method comprising obtaining sensor data associated with a driver of a vehicle, determining a state associated with the driver based on the sensor data, and transmitting the state associated with the driver to a teleconference session, wherein the driver is at least one of a participant or an invitee to the teleconference session.

Abstract: Embodiments of the present disclosure set forth a computer-implemented method comprising detecting a speech portion included in a first auditory signal generated by a speaker, determining that the speech portion comprises a factual statement, comparing the factual statement with a first fact included in a first data source, determining, based on comparing the factual statement with the first fact, a fact truthfulness value, and providing a response signal that indicates the fact truthfulness value.

Abstract: In various embodiments, an alert personalization application personalizes in-vehicle alerts. The alert personalization application estimates an increase in a negative emotion associated with an occupant of a vehicle based on at least one characteristic of the occupant. Subsequently, the alert personalization application determines that the increase is associated with a negative reaction to an in-vehicle alert that has a first alert characteristic. In response, the alert personalization application determines that the first alert characteristic should be replaced with a second alert characteristic. The alert personalization causes another in-vehicle alert to be generated that has the second alert characteristic instead of the first alert characteristic. Advantageously, personalizing alert characteristics that influence how and/or when in-vehicle alerts are generated can increase the effectiveness of in-vehicle alerts and can improve driving safety.

Abstract: One or more embodiments include techniques for generating audio for a speaker system worn by a listener. The speaker system analyzes an audio input signal to determine that a sound component of the audio input signal has an apparent location that is at a vertical distance from a listener. The speaker system selects an externally facing speaker included in the speaker system that faces at least partially upward or at least partially downward based on the vertical distance from the listener. The speaker system transmits the sound component to the externally facing speaker.

Abstract: Various embodiments include a computer-implemented method comprising receiving an input signal representing an ambient auditory environment of a user, generating, from the input signal, a set of ambient audio signals that includes a first component signal and a second component signal, generating, based on the first component signal, a first inverse signal that is a polar inverse of the first component signal, removing the first component signal from the set of ambient audio signals, generating a first composite signal that includes at least the first inverse signal and the second component signal, and driving an audio output device to produce soundwaves based on the first composite signal.