Abstract: Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

Abstract: This disclosure relates to systems and techniques for identifying collisions, such as relatively low energy impact collisions involving an autonomous vehicle. Sensor data from a first sensor modality in a first array may be used to determine a first estimated location of impact and second sensor data from a second sensor modality in a second array may be used to determine a second estimated location of impact. A low energy impact event may be configured when the first estimated location of impact corresponds to the second estimated location of impact.

Abstract: Techniques for utilizing microphone or audio data to detect and responding to low velocity impacts to a system such as an autonomous vehicle. In some cases, the system may be equipped with a plurality of microphones that may be used to detect impacts that fail to register on the data captured by the vehicle's inertial measurement units and may go undetected by the vehicle's perception system and sensors. In one specific example, the perception system of the autonomous vehicle may identify a period of time in which a potential low velocity impact may occur. The autonomous vehicle may then utilize the microphone or audio data associated with the period of time to determine if an impact occurred.

Abstract: Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

Abstract: Techniques for adaptive cross-correlation are discussed. A first signal is received from a first audio sensor associated with a vehicle and a second signal is received from a second audio sensor associated with the vehicle. Techniques may include determining, based at least in part on the first signal, a first transformed signal in a frequency domain. Additionally, the techniques include determining, based at least in part on the second signal, a second transformed signal in the frequency domain. A parameter can be determined based at least in part on a characteristic associated with at least one of the vehicle, an environment proximate the vehicle, or one or more of the first or second signal. Cross-correlation data can be determined based at least in part on one or more of the first transformed signal, the second transformed signal, or the parameter.

Abstract: A refrigerator comprises a storage compartment configured to store food, a temperature detector configured to detect an internal temperature of the storage compartment, a cooler configured to supply cool air to the storage compartment, a microphone configured to receive a speech, a display configured to display information, at least one processor configured to be electrically connected to the temperature detector, the microphone, and the display; and a memory configured to be electrically connected to the at least one processor.

Abstract: Techniques for determining information associated with sounds detected in an environment based on audio data are discussed herein. Audio sensors of a vehicle may determine audio data associated with sounds from the environment. Sounds may be caused by objects in the environment such as emergency vehicles, construction zones, non-emergency vehicles, humans, audio speakers, nature, etc. A model may determine a classification of the audio data and/or a probability value representing a likelihood that sound in the audio data is associated with the classification. A direction of arrival may be determined based on receiving classification values from multiple audio sensors of the vehicle, and other actions can be performed or the vehicle can be controlled based on the direction of arrival.

Abstract: Provided is a system, server, and method for speech recognition capable of collectively setting a plurality of setting items for device control through an utterance of a single sentence provided in the form of natural language. The system includes: a home appliance configured to receive a speech command that is generated through an utterance of a single sentence for control of the home appliance; and a server configured to receive the speech command in the single sentence from the home appliance and interpret the speech command of the single sentence through multiple intent determination.

Abstract: Disclosed herein is a cooking system: a cooking apparatus configured to input and output a speech, transmit speech data corresponding to the speech, and cook food in a cooking chamber; a first server configured to perform communication with the cooking apparatus, when speech data is received from the cooking apparatus, perform speech recognition based on the received speech data, transmit response information to the speech recognition to the cooking apparatus, obtain a menu requested by the user based on the received speech data, and transmit a cooking time and a cooking temperature for the obtained menu to the cooking apparatus; and a second server configured to store information about at least one recipe for a plurality of menus, perform communication with the first server, and transmit the information about at least one recipe to the first server.

Abstract: This disclosure relates to systems and techniques for identifying collisions, such as relatively low energy impact collisions involving an autonomous vehicle. Sensor data from a first sensor modality in a first array may be used to determine a first estimated location of impact and second sensor data from a second sensor modality in a second array may be used to determine a second estimated location of impact. A low energy impact event may be configured when the first estimated location of impact corresponds to the second estimated location of impact.

Abstract: Immersive experiences for users are described herein. In an example, audio data from a plurality of audio sensors associated with a vehicle can be received by an audio data processing system. The audio data processing system can combine individual captured audio channels (e.g., from the plurality of audio sensors) into two or more audio channels for output via two or more speakers proximate a user. A first audio channel of the two or more audio channels can be output via a first speaker and second audio channel of the two or more audio channels to be output via a second speaker, wherein output of the first audio channel and the second audio channel causes a resulting sound corresponding to at least a portion of a sound scene associated with the vehicle. In an example, a user computing device operable by the user can receive an input from the user.

Abstract: Techniques for adaptive cross-correlation are discussed. A first signal is received from a first audio sensor associated with a vehicle and a second signal is received from a second audio sensor associated with the vehicle. Techniques may include determining, based at least in part on the first signal, a first transformed signal in a frequency domain. Additionally, the techniques include determining, based at least in part on the second signal, a second transformed signal in the frequency domain. A parameter can be determined based at least in part on a characteristic associated with at least one of the vehicle, an environment proximate the vehicle, or one or more of the first or second signal. Cross-correlation data can be determined based at least in part on one or more of the first transformed signal, the second transformed signal, or the parameter.

Abstract: Techniques for estimating a direction of arrival of sound in an environment are discussed. First and second audio data are received from a first pair of audio sensors associated with a vehicle. A first region of ambiguity associated with the first pair of audio sensors is determined based on the first and second audio data. Third and fourth audio data are received from a second pair of audio sensors. A second region of ambiguity associated with the second pair of audio sensors is determined based on the third and fourth audio data. The regions of ambiguity can be further based on confidence levels associated with sensor or audio data. An area of intersection of the first region of ambiguity and the second region of ambiguity can be determined. A direction of arrival of an audio event can be determined based on the area of intersection.

Abstract: Techniques for determining a direction of arrival of an emergency are discussed. A plurality of audio sensors of a vehicle can receive audio data associated with the vehicle. An audio sensor pair can be selected from the plurality of audio sensors to generate audio data representing sound in an environment of the vehicle. An angular spectrum associated with the audio sensor pair can be determined based on the audio data. A feature associated with the audio data can be determined based on the angular spectrum and/or the audio data itself. A direction of arrival (DoA) value associated with the sound may be determined based on the feature using a machine learned model. An emergency sound (e.g., a siren) can be detected in the audio data and a direction associated with the emergency relative to the vehicle can be determined based on the feature and the DoA value.

Abstract: Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

Abstract: Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

Abstract: Techniques for determining a direction of arrival of an emergency are discussed. A plurality of audio sensors of a vehicle can receive audio data associated with the vehicle. An audio sensor pair can be selected from the plurality of audio sensors to generate audio data representing sound in an environment of the vehicle. An angular spectrum associated with the audio sensor pair can be determined based on the audio data. A feature associated with the audio data can be determined based on the angular spectrum and/or the audio data itself. A direction of arrival (DoA) value associated with the sound may be determined based on the feature using a machine learned model. An emergency sound (e.g., a siren) can be detected in the audio data and a direction associated with the emergency relative to the vehicle can be determined based on the feature and the DoA value.

Abstract: Provided is a system, server, and method for speech recognition capable of collectively setting a plurality of setting items for device control through an utterance of a single sentence provided in the form of natural language. The system includes: a home appliance configured to receive a speech command that is generated through an utterance of a single sentence for control of the home appliance; and a server configured to receive the speech command in the single sentence from the home appliance and interpret the speech command of the single sentence through multiple intent determination.

Abstract: Disclosed herein is a cooking system: a cooking apparatus configured to input and output a speech, transmit speech data corresponding to the speech, and cook food in a cooking chamber; a first server configured to perform communication with the cooking apparatus, when speech data is received from the cooking apparatus, perform speech recognition based on the received speech data, transmit response information to the speech recognition to the cooking apparatus, obtain a menu requested by the user based on the received speech data, and transmit a cooking time and a cooking temperature for the obtained menu to the cooking apparatus; and a second server configured to store information about at least one recipe for a plurality of menus, perform communication with the first server, and transmit the information about at least one recipe to the first server.

Abstract: A refrigerator comprises a storage compartment configured to store food, a temperature detector configured to detect an internal temperature of the storage compartment, a cooler configured to supply cool air to the storage compartment, a microphone configured to receive a speech, a display configured to display information, at least one processor configured to be electrically connected to the temperature detector, the microphone, and the display; and a memory configured to be electrically connected to the at least one processor.