Abstract: An embedded light field display architecture to process and display three-dimensional light field data in a light field display is provided. The light field display architecture includes a plurality of hierarchical modules to decode compressed light field data associated with a light field and a plurality of tile modules embedded directly in the light field display to process light field data for display. A plurality of networking modules is also provided to transmit light field data among the hierarchical modules and the tile modules.

Abstract: A computation system comprising an orientation detection device configured to detect position information comprising a position and an orientation of the computation system, a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture environmental input data, wherein the multi-sensor system comprises at least one of an audio capturing system and a three-dimensional (3D) image capturing system, and wherein the environmental input data comprises at least one of audio and an image, and at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the processor is configured to modify the captured environmental input data based on the position information.

Abstract: A computation system comprising an orientation detection device configured to detect position information comprising a position and an orientation of the computation system, a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture environmental input data, wherein the multi-sensor system comprises at least one of an audio capturing system and a three-dimensional (3D) image capturing system, and wherein the environmental input data comprises at least one of audio and an image, and at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the processor is configured to modify the captured environmental input data based on the position information.

Abstract: A position estimation system comprising a plurality of ‘shaped for depth sensing’ lenses comprising a lens profile directly based on distance estimation propagation of errors; a plurality of light sensing devices associated with the plurality of ‘shaped for depth sensing’ lenses; and a position estimator for estimating a position of at least a first object with respect to a second object based on the plurality of ‘shaped for depth sensing’ lenses and the plurality of light sensing devices.

Abstract: A method for time delay estimation performed by a physical computing system includes passing a first input signal obtained by a first sensor through a filter bank to form a first set of sub-band output signals, passing a second input signal obtained by a second sensor through the filter bank to form a second set of sub-band output signals, the second sensor placed a distance from the first sensor, computing cross-correlation data between the first set of sub-band output signals and the second set of sub-band output signals, and applying a time delay determination function to the cross-correlation to determine a time delay estimation.

Abstract: Systems and methods for performing sound source localization are provided. In one aspect, a method for locating a sound source using a computing device subdivides a space into subregions. The method then computes a sound source power for each of subregions and determines which of the sound source energies is the largest. When the volume of the subregion is less than a threshold volume, the method outputs the subregion having the largest sound source power. Otherwise, the stages of partitioning, computing, and determining the subregion having the largest sound source power is repeated.

Abstract: Systems and methods for parallel and distributed processing of audio signals produced by a microphone array are described. In one aspect, a distributed signal processing system includes an array of microphones and an array of processors. Each processor is connected to one of the microphones and is connected to at least two other processors, enabling communication between adjacent connected processors. The system also includes a computing device connected to each of the processors. Each microphone detects a sound and generates an audio signal, and each processor is configured to receive and process the audio signal sent from a connected microphone and audio signals sent from at least one of the adjacent processors to produce a data stream that is sent to the computing device.

Abstract: A computation system comprising an orientation detection device configured to detect position information comprising a position and an orientation of the computation system, a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture environmental input data, wherein the multi-sensor system comprises at least one of an audio capturing system and a three-dimensional (3D) image capturing system, and wherein the environmental input data comprises at least one of audio and an image, and at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the processor is configured to modify the captured environmental input data based on the position information.

Abstract: Disclosed herein are multimedia-conferencing systems and methods enabling local participants to hear remote participants from the direction the remote participants are rendered on a display. In one aspect, a method includes a computing device receives a remote participant's image and sound information collected at a remote site. The remote participant's image is rendered on a display at a local site. When the local participant is in close proximity to the display, sounds generated by the remote participant are played over stereo loudspeakers so that the local participant perceives the sounds as emanating from the remote participant's location rendered on the display.

Abstract: A method for time delay estimation performed by a physical computing system includes passing a first input signal obtained by a first sensor through a filter bank to form a first set of sub-band output signals, passing a second input signal obtained by a second sensor through the filter bank to form a second set of sub-band output signals, the second sensor placed a distance from the first sensor, computing cross-correlation data between the first set of sub-band output signals and the second set of sub-band output signals, and applying a time delay determination function to the cross-correlation to determine a time delay estimation.

Abstract: An embedded light field display architecture to process and display three-dimensional light field data in a light field display is provided. The light field display architecture includes a plurality of hierarchical modules to decode compressed light field data associated with a light field and a plurality of tile modules embedded directly in the light field display to process light field data for display. A plurality of networking modules is also provided to transmit light field data among the hierarchical modules and the tile modules.

Abstract: A position estimation system comprising a plurality of ‘shaped for depth sensing’ lenses comprising a lens profile directly based on distance estimation propagation of errors; a plurality of light sensing devices associated with the plurality of ‘shaped for depth sensing’ lenses; and a position estimator for estimating a position of at least a first object with respect to a second object based on the plurality of ‘shaped for depth sensing’ lenses and the plurality of light sensing devices.

Abstract: Proper estimation of impulse responses is an important and challenging aspect of multichannel echo control. Various embodiments of the present invention are directed to real-time, adaptive acoustic echo cancellation methods in multichannel audio-communication systems. In particular, embodiments of the present invention use a collection of a room's past impulse responses to determine an optimal lower dimensional impulse response space as the underlying search subspace for approximate impulse responses. As a result, embodiments of the present invention mitigate inherent instability of multichannel audio-communication systems and provide stable and accurate echo removal without distorting audio signals.

Abstract: sensors are arranged continuously adjacent along the boundary region of a touch surface. Furthermore, a touch associated with the interior area of the touch surface is detected via at least a plurality of sensors along the boundary region.

Abstract: Systems and methods for performing sound source localization are provided. In one aspect, a method for locating a sound source using a computing device subdivides a space into subregions. The method then computes a sound source power for each of subregions and determines which of the sound source energies is the largest. When the volume of the subregion is less than a threshold volume, the method outputs the subregion having the largest sound source power. Otherwise, the stages of partitioning, computing, and determining the subregion having the largest sound source power is repeated.

Abstract: Systems and methods for parallel and distributed processing of audio signals produced by a microphone array are described. In one aspect, a distributed signal processing system includes an array of microphones and an array of processors. Each processor is connected to one of the microphones and is connected to at least two other processors, enabling communication between adjacent connected processors. The system also includes a computing device connected to each of the processors. Each microphone detects a sound and generates an audio signal, and each processor is configured to receive and process the audio signal sent from a connected microphone and audio signals sent from at least one of the adjacent processors to produce a data stream that is sent to the computing device.

Abstract: Disclosed herein are multimedia-conferencing systems and methods enabling local participants to hear remote participants from the direction the remote participants are rendered on a display. In one aspect, a method includes a computing device receives a remote participant's image and sound information collected at a remote site. The remote participant's image is rendered on a display at a local site. When the local participant is in close proximity to the display, sounds generated by the remote participant are played over stereo loudspeakers so that the local participant perceives the sounds as emanating from the remote participant's location rendered on the display.

Abstract: Embodiments of the present invention are directed to audio-conference communication systems that enable audio-conference participants to identify which of the participants are speaking. In one embodiment, an audio-communication system comprises at least one communications server, a plurality of stereo sound generating devices, and a plurality of microphones. Each stereo sound generating device is electronically coupled to the at least one communications server, and each microphone is electronically coupled to the at least one communications server. Each microphone detects different sounds that are sent to the at least one communications server as corresponding sound signals.

Abstract: Various aspects of the present invention are directed to systems and methods for highlighting participant activities in video conferencing. In one aspect, a method of generating a dynamic visual representation of participants taking part in a video conference comprises rendering an audio-visual representation of the one or more participants at each site taking part in the video conference using a computing device. The method includes receiving a saliency signal using the computing device, the saliency signal identifying the degree of current and/or recent activity of the one or more participants at each site. Based on the saliency signal associated with each site, the method applies image processing to elicit visual popout of active participants associated each site, while maintaining fixed scale and borders interface of the visual representation of the one or more participants at each site.

Abstract: Proper estimation of impulse responses is an important and challenging aspect of multichannel echo control. Various embodiments of the present invention are directed to real-time, adaptive acoustic echo cancellation methods in multichannel audio-communication systems. In particular, embodiments of the present invention use a collection of a room's past impulse responses to determine an optimal lower dimensional impulse response space as the underlying search subspace for approximate impulse responses. As a result, embodiments of the present invention mitigate inherent instability of multichannel audio-communication systems and provide stable and accurate echo removal without distorting audio signals.