Abstract: Presented herein are techniques to generate a stereo sound signal based on direction of arrival of sound signals. A method includes receiving sound signals at a microphone, outputting a mono sound signal from the microphone, determining a direction of arrival of the sound signals with respect to the microphone, generating, from the mono audio signal, a stereo sound signal having a first channel and a second channel, wherein an amplitude of the first channel and an amplitude of the second channel are weighted, respectively, based on the direction of arrival of the sound signals at the microphone.

Abstract: In one example, a video endpoint obtains, from a vertical microphone array, a first audio signal including audio from a target sound source and audio from a horizontally-displaced sound source. The video endpoint obtains, from a horizontal microphone array, a second audio signal and a third audio signal both including the audio from the target sound source and the audio from the horizontally-displaced sound source. Based on the second audio signal and the third audio signal, the video endpoint determines at least one of a first degree of arrival of the audio from the target sound source or a second degree of arrival of the audio from the horizontally-displaced sound source. Based on the at least one of the first degree of arrival or the second degree of arrival, the video endpoint adjusts a gain of the first audio signal.

Abstract: In one example, a video endpoint obtains, from a vertical microphone array, a first audio signal including audio from a target sound source and audio from a horizontally-displaced sound source. The video endpoint obtains, from a horizontal microphone array, a second audio signal and a third audio signal both including the audio from the target sound source and the audio from the horizontally-displaced sound source. Based on the second audio signal and the third audio signal, the video endpoint determines at least one of a first degree of arrival of the audio from the target sound source or a second degree of arrival of the audio from the horizontally-displaced sound source. Based on the at least one of the first degree of arrival or the second degree of arrival, the video endpoint adjusts a gain of the first audio signal.

Abstract: In one example, a video endpoint obtains, from a vertical microphone array, a first audio signal including audio from a target sound source and audio from a horizontally-displaced sound source. The video endpoint obtains, from a horizontal microphone array, a second audio signal and a third audio signal both including the audio from the target sound source and the audio from the horizontally-displaced sound source. Based on the second audio signal and the third audio signal, the video endpoint determines at least one of a first degree of arrival of the audio from the target sound source or a second degree of arrival of the audio from the horizontally-displaced sound source. Based on the at least one of the first degree of arrival or the second degree of arrival, the video endpoint adjusts a gain of the first audio signal.

Abstract: In one example, a video endpoint obtains, from a vertical microphone array, a first audio signal including audio from a target sound source and audio from a horizontally-displaced sound source. The video endpoint obtains, from a horizontal microphone array, a second audio signal and a third audio signal both including the audio from the target sound source and the audio from the horizontally-displaced sound source. Based on the second audio signal and the third audio signal, the video endpoint determines at least one of a first degree of arrival of the audio from the target sound source or a second degree of arrival of the audio from the horizontally-displaced sound source. Based on the at least one of the first degree of arrival or the second degree of arrival, the video endpoint adjusts a gain of the first audio signal.

Abstract: An endpoint device includes a microphone array and spaced-apart loudspeakers including an active loudspeaker among the loudspeakers that is closest to the microphone array. The endpoint device forms at the microphone array an audio receive beam having a main lobe pointed in a direction from which audio is to be received, and determines which of the loudspeakers are not in the main lobe. The endpoint device identifies at least one additional loudspeaker among the loudspeakers determined not to be in the main lobe and that is farther away from the microphone array than the active loudspeaker. The endpoint device spreads audio energy of input audio associated with, and intended for, the active loudspeaker across the active loudspeaker and the at least one additional loudspeaker, and no other ones of the loudspeakers, using a precedence effect.

Abstract: Systems, methods, and computer-readable media for automatically setting exposure levels in a session based on an active participant. In some embodiments, a method can include detecting faces of one or more participants in one or more images in a captured video feed at a location of the participants illuminated at one or more illumination levels at the location. The one or more detected faces can be associated with brightness levels of the one or more participants based on the one or more illumination levels at the location. Audio input can be received for the one or more participants at the location and a first participant can be identified as an active participant using the audio input. Further, an exposure level of the captured video feed can be set based on the first participant acting as the active participant according to a brightness level in the one or more images associated with a face detection of the first participant in the one or more images.

Abstract: Systems, methods, and computer-readable media for automatically setting exposure levels in a session based on an active participant. In some embodiments, a method can include detecting faces of one or more participants in one or more images in a captured video feed at a location of the participants illuminated at one or more illumination levels at the location. The one or more detected faces can be associated with brightness levels of the one or more participants based on the one or more illumination levels at the location. Audio input can be received for the one or more participants at the location and a first participant can be identified as an active participant using the audio input. Further, an exposure level of the captured video feed can be set based on the first participant acting as the active participant according to a brightness level in the one or more images associated with a face detection of the first participant in the one or more images.

Abstract: A system that automatically configures the behavior of the display devices of a video conference endpoint. The controller may detect, at a microphone array having a predetermined physical relationship with respect to a camera, audio emitted from one or more loudspeakers, each loudspeaker having a predetermined physical relationship with respect to at least one of one or more display devices in a conference room. The controller may then generate data representing a spatial relationship between the one or more display devices and the camera based on the detected audio. Finally, the controller may assign video sources received by the endpoint to each of the one or more display devices based on the data representing the spatial relationship and the content of each received video source, and may also assign outputs from multiple video cameras to an outgoing video stream based on the on the data representing the spatial relationship.

Abstract: Techniques for adaptive noise cancellation for multiple audio endpoints in a shared space are described. According to one example, a method includes detecting, by a first audio endpoint, one or more audio endpoints co-located with the first audio endpoint at a first location. A selected audio endpoint of the one or more audio endpoints is identified as a target noise source. The method includes obtaining, from the selected audio endpoint, a loudspeaker reference signal associated with a loudspeaker of the selected audio endpoint and removing the loudspeaker reference signal from a microphone signal associated with a microphone of the first audio endpoint. The method also includes providing the microphone signal from the first audio endpoint to at least one of a voice user interface (VUI) or a second audio endpoint, wherein the second audio endpoint is located remotely from the first location.

Abstract: An endpoint among a plurality of endpoints, synchronizes a clock across the plurality of endpoints. The endpoint generates a received ultrasonic signal by transducing ultrasonic sound received at a microphone from a spatial region. The ultrasonic sound includes an identical ultrasonic signal transmitted from the plurality of endpoints and echoes from the spatial region. The identical ultrasonic signal is generated with respect to the synchronized clock. The endpoint computes an error signal based on removing the identical ultrasonic signals and the echoes from the received ultrasonic signal. The endpoint detects motion in the spatial region based on a change in the error signal over time.

Abstract: Disclosed is a method that includes receiving an audio video stream, decoding the audio video stream to yield decoded video and decoded audio, transmitting the decoded video on a video cable to a display, transmitting a signal, such as, for example, a signal on an audio channel of the video cable, identifying an impulse response based on a received signal responsive to the transmitting of the signal, identifying a delay amount based on the impulse response and transmitting the decoded audio to a loudspeaker according to the delay amount. The cable can include an HDMI cable with the audio return channel (ARC) capability.

Abstract: Disclosed is a method that includes receiving an audio video stream, decoding the audio video stream to yield decoded video and decoded audio, transmitting the decoded video on a video cable to a display, transmitting a signal, such as, for example, a signal on an audio channel of the video cable, identifying an impulse response based on a received signal responsive to the transmitting of the signal, identifying a delay amount based on the impulse response and transmitting the decoded audio to a loudspeaker according to the delay amount. The cable can include an HDMI cable with the audio return channel (ARC) capability.

Abstract: A system that automatically configures the behavior of the display devices of a video conference endpoint. The controller may detect, at a microphone array having a predetermined physical relationship with respect to a camera, audio emitted from one or more loudspeakers, each loudspeaker having a predetermined physical relationship with respect to at least one of one or more display devices in a conference room. The controller may then generate data representing a spatial relationship between the one or more display devices and the camera based on the detected audio. Finally, the controller may assign video sources received by the endpoint to each of the one or more display devices based on the data representing the spatial relationship and the content of each received video source, and may also assign outputs from multiple video cameras to an outgoing video stream based on the on the data representing the spatial relationship.

Abstract: A system that automatically configures the behavior of the display devices of a video conference endpoint. The controller may detect, at a microphone array having a predetermined physical relationship with respect to a camera, audio emitted from one or more loudspeakers, each loudspeaker having a predetermined physical relationship with respect to at least one of one or more display devices in a conference room. The controller may then generate data representing a spatial relationship between the one or more display devices and the camera based on the detected audio. Finally, the controller may assign video sources received by the endpoint to each of the one or more display devices based on the data representing the spatial relationship and the content of each received video source, and may also assign outputs from multiple video cameras to an outgoing video stream based on the on the data representing the spatial relationship.

Abstract: A system that automatically configures the behavior of the display devices of a video conference endpoint. The controller may detect, at a microphone array having a predetermined physical relationship with respect to a camera, audio emitted from one or more loudspeakers, each loudspeaker having a predetermined physical relationship with respect to at least one of one or more display devices in a conference room. The controller may then generate data representing a spatial relationship between the one or more display devices and the camera based on the detected audio. Finally, the controller may assign video sources received by the endpoint to each of the one or more display devices based on the data representing the spatial relationship and the content of each received video source, and may also assign outputs from multiple video cameras to an outgoing video stream based on the on the data representing the spatial relationship.

Abstract: In one implementation, an apparatus includes a camera, a loudspeaker, a plurality of microphones, and a controller. The apparatus may be a computer, a mobile device such as a smart phone, or a dedicated videoconference device. The plurality of microphones are configured to produce sound data. A first number of the plurality of microphones are arranged on a first side of the loudspeaker, and a second number of the plurality of microphones are arranged on a second side of the loudspeaker. Different quantities of the microphones may be included on each side of the loudspeaker. The controller is configured to calculate a cross-correlation of the plurality of microphones based on the sound data and attenuate the cross-correlation based on a time-delay window and an attenuation factor. A participant location is determined based on the attenuated cross correlation functions.

Abstract: A video conference endpoint includes predefined main and side audio search regions angularly-separated from each other at a microphone array configured to transduce audio received from the search regions. The endpoint includes one or more cameras to capture video in a main field of view (FOV) that encompasses the main audio search region. The endpoint determines if audio originates from any of the main and side audio search regions based on the transduced audio and predetermined audio search criteria. If it is determined that audio originates from the side audio search region, the endpoint automatically switches from capturing video in the main FOV to one or more cameras to capture video in a side FOV that encompasses the side audio search region.

Abstract: In one implementation, an apparatus includes a camera, a loudspeaker, a plurality of microphones, and a controller. The apparatus may be a computer, a mobile device such as a smart phone, or a dedicated videoconference device. The plurality of microphones are configured to produce sound data. A first number of the plurality of microphones are arranged on a first side of the loudspeaker, and a second number of the plurality of microphones are arranged on a second side of the loudspeaker. Different quantities of the microphones may be included on each side of the loudspeaker. The controller is configured to calculate a cross-correlation of the plurality of microphones based on the sound data and attenuate the cross-correlation based on a time-delay window and an attenuation factor. A participant location is determined based on the attenuated cross correlation functions.

Abstract: Techniques for adaptive noise cancellation for multiple audio endpoints in a shared space are described. According to one example, a method includes detecting, by a first audio endpoint, one or more audio endpoints co-located with the first audio endpoint at a first location. A selected audio endpoint of the one or more audio endpoints is identified as a target noise source. The method includes obtaining, from the selected audio endpoint, a loudspeaker reference signal associated with a loudspeaker of the selected audio endpoint and removing the loudspeaker reference signal from a microphone signal associated with a microphone of the first audio endpoint. The method also includes providing the microphone signal from the first audio endpoint to at least one of a voice user interface (VUI) or a second audio endpoint, wherein the second audio endpoint is located remotely from the first location.