Abstract: A communication system (e.g., a speakerphone) includes an array of microphones, a speaker, memory and a processor. The processor may be configured to perform acoustic echo cancellation, to track multiple talkers with highly directed beams, to design beams with nulls pointed at noise sources, to generate a 3D model of the physical environment, to compensate for the proximity effect, and to perform dereverberation of a talker's voice signal. The processor may also be configured to use a standard codec in non-standard ways. The processor may perform a virtual broadside scan on the microphone array, analyze the resulting amplitude envelope for acoustic source angles, examine each of the source angles with a directed beam, combine the beam outputs that show the characteristics of intelligence or speech.

Abstract: A system such as a speakerphone may include a processor, memory and an array of microphones. The processor may be configured (via program instructions stored in the memory) to perform automatic echo cancellation, self calibration and beam forming. In particular, the processor may receive input signals from the microphone array and operate on the input signals with a highly directed virtual beam which is a composite of two or more beams which are restricted to respective frequency ranges. The two or more beams may include beams of different kinds, e.g., superdirective beams and delay-and-sum beams.

Abstract: An edge directed demosaicing algorithm for determining an edge direction from an input color filter array (CFA) sampled image is disclosed. Aspects of the present invention include calculating for a current missing green pixel, interpolation errors in an East-West (EW) direction at known neighboring green pixels, and averaging the EW interpolation errors to obtain an EW error. Interpolation errors are also calculated for the current missing green pixel in a North-South (NS) direction at known neighboring green pixels, and the NS interpolation errors are averaged to obtain a NS error. An EW or NS direction indicated by a minimum of the EW error and the NS error is then selected as the edge direction.

Abstract: In various embodiments, a speakerphone may comprise multiple (e.g., 16) microphones placed in a circular array around a central speaker. Each microphone may be mounted to the speakerphone through a microphone support. The microphone support may be made of a flexible material and have various features designed to minimize interference to the microphone (e.g., from the speaker and/or vibrations external to the speakerphone). The centrally mounted speaker may be coupled to a stiff internal speaker enclosure. The speaker enclosure may be made of a stiff, heavy material (e.g., a dense plastic) to prevent the speaker vibrations from excessively vibrating the speakerphone enclosure (which may affect the microphones).

Abstract: In some embodiments, the components of a videoconferencing system may be incorporated in a unitary housing. For example, an integrated videoconferencing system may include microphones to capture participant audio and a camera to capture participant video (along with corresponding audio processing capabilities) in a unitary housing. The unitary housing may also include speakers to produce audio from conference participants and a display to provide video of conference participants. The integrated videoconferencing system may include a codec for encoding and/or decoding). The integrated videoconferencing system may also perform other conference related functions. The integrated videoconferencing system may be used as a speakerphone (e.g., in audio only calls) and/or a videoconference system. The integrated videoconferencing system may also fold into a compact form for portability.

Abstract: A system may be configured to: receive remote audio signals and corresponding spatial indicators from remote systems; generate output signals for local speakers based on the remote audio signals and the corresponding spatial indicators; supply a microphone input signal to a first echo canceller in a series of echo cancellers, where each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus connecting the speakers; map each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator; for each position of the set of positions, combine any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller; transmit a resultant signal including at least an output of a last echo canceller of the series to the remote systems.

Abstract: In various embodiments, a management system may query connection devices for their capabilities and store the information in a data structure. In some embodiments, the data structure may be in a form of a Deducible Capability Numbering (DCN) number. In some embodiments, the DCN number may describe the capabilities of a connection device using a series of representative numbers. After connecting the connection devices, the management system may continue monitoring capabilities of the connection devices and line failures. The management system may reconnect connection devices based on their capabilities if a line failure occurs.

Abstract: In some embodiments, images for the video conference may be white balanced. White balancing may include dividing at least a subset of an image's pixels into multiple ranges according to their luminance and chrominance values. For example, at least a portion of the pixels in an image may be sorted into different groups (i.e., by incrementing counters respective to each group) according to the luminance and chrominance values of the pixels. If enough pixels are found to be in a particular group, a portion or all of the image may be adjusted by a ratio corresponding to that particular group. For example, blue and red analog gains (corresponding to the selected pixels) may be modified by a corresponding ratio to bring red and blue accumulations closer to green accumulations.

Abstract: A communication system includes a set of microphones, a speaker, memory and a processor. The processor is configured to operate on input signals from the microphones to obtain a resultant signal representing the output of a virtual microphone which is highly directed in a target direction. The processor also is configured for self calibration. The processor may provide an output signal for transmission from the speaker. The output signal may be a noise signal, or, a portion of a live conversation. The processor captures one or more input signals in response to the output signal transmission uses the output signal and input signals to estimate parameters of the speaker and/or microphone.

Abstract: A system may include a processor and memory. The processor may be configured to perform calibration measurements on the speaker even when the speaker is being used to conduct a live conversation. The processor may be configured to: provide a live output signal for transmission from a speaker; receive an input signal corresponding to the output signal; compute a midrange sensitivity and a lowpass sensitivity for a transfer function derived from a spectrum of the input signal and a spectrum of the output signal; subtract the midrange sensitivity from the lowpass sensitivity to obtain a speaker-related sensitivity; perform an iterative search for current parameters of a speaker model using the input signal spectrum, the output signal spectrum and the speaker-related sensitivity; and update averages of the speaker model parameters using the current parameter values. The parameter averages may be used to perform echo cancellation.

Abstract: A system such as a speakerphone may include a processor, memory, a speaker and a microphone. The processor may be configured (via program instructions stored in the memory) to calibrate the speaker by: outputting a stimulus signal; receiving an input signal corresponding to the stimulus signal; computing a midrange sensitivity and a lowpass sensitivity for a transfer function derived from a spectrum of the input signal and a spectrum of the output signal; subtracting the midrange sensitivity from the lowpass sensitivity to obtain a speaker-related sensitivity; performing an iterative search for current parameters of a speaker model using the input signal spectrum, the stimulus signal spectrum and the speaker-related sensitivity; and updating averages of the speaker model parameters using the current parameter values. The stimulus signal may be transmitted during periods of silence in the external environment. The parameter averages may be used to perform echo cancellation.

Abstract: In various embodiments, a camera may be controlled by one or more motors in a base of the camera. Cables and other components may be used to manipulate the camera lens through the side arms of the camera. Putting the motors in the base may reduce the size of the outer case of the camera and add stability. A pan motor may pan the camera while a tilt motor may move a tilt pulley relative to a lens portion of the camera (which may or may not tilt the camera depending on the panning motion of the camera). In some embodiments, images from the camera may be converted into a serialized stream and transported over a cable from the lens through a center shaft of the camera.

Abstract: A processor operates on samples of a digital output signal to determine samples of a digital correction signal. The output signal samples are directed to an output channel for transmission from a speaker. The digital correction signal samples are supplied to a first digital-to-analog converter for conversion into an analog correction signal. The subtraction circuit generates a difference between a first analog signal provided by a microphone and the analog correction signal. The analog correction signal is an estimate of a contribution to the first analog signal due to a direct path transmission between the speaker and the microphone. The processor also receives a digital input signal derived from the difference signal, and, performs acoustic echo cancellation on the digital input signal to obtain a resultant signal. The acoustic echo cancellation is configured to remove contributions to the digital input signal due to reflected path transmissions.

Abstract: In various embodiments, multiple participants (at endpoints) may connect through a video conferencing system. A screen may display other participants in the conference call. For example, multiple participants may be displayed in respective portions of the screen. In some embodiments, each of the participants may use video conferencing systems that support different resolutions. In some embodiments, a transcoder may resolution transcode signals to allow the conference call participants to be displayed on each participant's respective screen at up to the highest possible resolution supported by the respective screen. For example, low resolution video conferencing systems may be displayed on a high definition screen of a high resolution system at the low resolution of the low resolution video conferencing system while another image on the same high definition screen from a different, higher resolution video conferencing system, may be displayed at the higher resolution.

Abstract: A conference call may involve participants with video conferencing systems and participants with speakerphone systems. In some embodiments, sound from speakerphone participants may be sent through a speakerphone sound system while sound from video participants may be sent through the video sound system (e.g., near a video monitor). Sound may be localized through a combination of both the video sound system and the speakerphone sound system to produce a spatially correct sound field for in room participants.

Abstract: In some embodiments, spatially realistic audio may be provided for a conference call. Voices from participants on the left side of a display, in a conference call, may be directed through audio on the left side of the display at the other conferencing system in the conference call (similarly for voices from the center and right side of the display). In some embodiments, two speakers may be used in the system to create synthesized stereo sound at a location specified by directional information received as side information along with the existing audio channel. The location may be determined by using beamforming with integrated microphones on a camera or speakerphone. In some embodiments, the audio signal and directional information may be sent in the form of a left audio channel and a right audio channel.

Abstract: Various embodiments of a dual-sensor video camera are disclosed. The dual-sensor video camera includes a color filter array (CFA) sensor, which has a low-pass filter. The dual-sensor video camera also includes a panchromatic sensor. A beam splitter directs an incoming light beam to both sensors. An output image is produced based on image information from the two sensors. The output image includes luminance information based on the image information from the panchromatic sensor and chrominance information based on the image information from the CFA sensor.

Abstract: In various embodiments, to avoid having to plug in the speakerphone, the speakerphone may be powered with a battery. In some embodiments, the speakerphone may exchange a discharged battery with a charged battery on a charging stand. In some embodiments, a charging stand, with a battery releasably coupled to the charging stand, may be configured to receive a second battery from a speakerphone. In some embodiments, the speakerphone with the first battery may be placed onto the charging stand to engage the charging stand. The charging stand may determine if the first battery on the speakerphone needs to be exchanged (e.g., if it is charged below a predetermined limit). If the battery needs to be exchanged, the charging stand may exchange the first battery with the second battery by disengaging the first battery and engaging the second battery with the speakerphone.

Abstract: In various embodiments, a speakerphone may comprise multiple (e.g., 16) microphones placed in a circular array around a central speaker. Each microphone may be mounted to the speakerphone through a microphone support. The microphone support may be made of a flexible material and have various features designed to minimize interference to the microphone (e.g., from the speaker and/or vibrations external to the speakerphone). The centrally mounted speaker may be coupled to a stiff internal speaker enclosure. The speaker enclosure may be made of a stiff, heavy material (e.g., a dense plastic) to prevent the speaker vibrations from excessively vibrating the speakerphone enclosure (which may affect the microphones).