Abstract: The various implementations described herein include methods, devices, and systems for automatic audio equalization. In one aspect, a method is performed at an audio device having one or more processors, memory, and a plurality of device interface elements, including one or more speakers and a plurality of microphones. The method includes: (1) detecting a change in orientation of the audio device from a first orientation to a second orientation; and (2) in response to detecting the change in orientation, configuring operation of two or more of the plurality of device interface elements.

Abstract: The various implementations described herein include methods, devices, and systems for automatic audio equalization. In one aspect, a method is performed at a computing system that includes speaker(s), microphones, processors and memory. The computing system outputs audio user content and automatically equalizes the audio output of the computing system. The equalizing includes: (1) receiving the outputted audio content at each microphone of the plurality of microphones; (2) based on the received audio content, determining an acoustic transfer function for the room; (3) based on the determined acoustic transfer function, obtaining a frequency response for the room; and (4) adjusting one or more properties of the speakers based on the determined frequency response.

Abstract: In a general aspect, a system for media playback can include a first media playback device configured to receive a media stream from a media casting device over a data network, the first media playback device being a member of the media playback group and a second media playback device configured to receive the media stream, the second media playback device being a member of the media playback group. The first media playback device and the second media playback device can be collectively configured to designate one of the first media playback device and the second media playback device as a leader playback device of the media playback group. The playback device not designated as the leader playback device can be designated as a follower playback device of the media playback group. The first media playback device and the second media playback device can be further collectively configured to determine a clock offset between the leader playback device and the follower playback device.

Abstract: A system, method, and computer readable storage medium generates an audio fingerprint for an input audio clip that is robust to differences in key, instrumentation, and other performance variations. The audio fingerprint comprises a sequence of intervalgrams that represent a melody in an audio clip according pitch intervals between different time points in the audio clip. The fingerprint for an input audio clip can be compared to a set of reference fingerprints in a reference database to determine a matching reference audio clip.

Abstract: The present invention relates to the field of panoramic still and motion photography. In a first embodiment, a camera apparatus for panoramic photography includes a first image sensor positioned to capture a first image. The first image sensor has a rolling-shutter readout arranged in portrait orientation. The camera apparatus also includes second image sensor positioned to capture a second image. The second image sensor has a rolling-shutter readout arranged in portrait orientation. Finally, the camera apparatus includes a controller configured to signal the second image sensor to start capturing the second image before the first image sensor finishes capturing the first image. At least a portion of the first image is in front of the second image relative to a forward direction of the camera apparatus.

Abstract: The present invention relates to the field of panoramic still and motion photography. In a first embodiment, a camera apparatus for panoramic photography includes a first image sensor positioned to capture a first image. The first image sensor has a rolling-shutter readout arranged in portrait orientation. The camera apparatus also includes second image sensor positioned to capture a second image. The second image sensor has a rolling-shutter readout arranged in portrait orientation. Finally, the camera apparatus includes a controller configured to signal the second image sensor to start capturing the second image before the first image sensor finishes capturing the first image. At least a portion of the first image is in front of the second image relative to a forward direction of the camera apparatus.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, are provided for using audio features to classify audio for information retrieval. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of generating a collection of auditory images, each auditory image being generated from respective audio files according to an auditory model; extracting sparse features from each auditory image in the collection to generate a sparse feature vector representing the corresponding audio file; and ranking the audio files in response to a query including one or more words using the sparse feature vectors and a matching function relating sparse feature vectors to words in the query.

Abstract: A system, method, and computer readable storage medium generates an audio fingerprint for an input audio clip that is robust to differences in key, instrumentation, and other performance variations. The audio fingerprint includes a sequence of intervalgrams that represent a melody in an audio clip according pitch intervals between different time points in the audio clip. The fingerprint for an input audio clip can be compared to a set of reference fingerprints in a reference database to determine a matching reference audio clip.

Abstract: A system, method, and computer readable storage medium generates an audio fingerprint for an input audio clip that is robust to differences in key, instrumentation, and other performance variations. The audio fingerprint comprises a sequence of intervalgrams that represent a melody in an audio clip according pitch intervals between different time points in the audio clip. The fingerprint for an input audio clip can be compared to a set of reference fingerprints in a reference database to determine a matching reference audio clip.

Abstract: A system, method, and computer readable storage medium generates an audio fingerprint for an input audio clip that is robust to differences in key, instrumentation, and other performance variations. The audio fingerprint comprises a sequence of intervalgrams that represent a melody in an audio clip according pitch intervals between different time points in the audio clip. The fingerprint for an input audio clip can be compared to a set of reference fingerprints in a reference database to determine a matching reference audio clip.

Abstract: A system, method, and computer readable storage medium generates an audio fingerprint for an input audio clip that is robust to differences in key, instrumentation, and other performance variations. The audio fingerprint includes a sequence of intervalgrams that represent a melody in an audio clip according pitch intervals between different time points in the audio clip. The fingerprint for an input audio clip can be compared to a set of reference fingerprints in a reference database to determine a matching reference audio clip.

Abstract: A system, method, and computer readable storage medium generates an audio fingerprint for an input audio clip that is robust to differences in key, instrumentation, and other performance variations. The audio fingerprint comprises a sequence of intervalgrams that represent a melody in an audio clip according pitch intervals between different time points in the audio clip. The fingerprint for an input audio clip can be compared to a set of reference fingerprints in a reference database to determine a matching reference audio clip.

Abstract: Systems and methods of providing spatially dependent image exposure information to a user of a digital camera. The described approach is applicable to determination of image exposure quality in a digital camera system. In these applications an image is displayed in a first display mode wherein the exposure information is overlaid on the image or in a second display mode wherein the exposure information is eliminated or reduced and thus is less obstructive of the image. In the second display mode, a separate exposure warning optionally conveys a subset of the information displayed in the first display mode. The invention includes a user input operable to temporarily specify a change in the display of the image between the first mode and the second mode while an image is displayed, thus providing the user with direct control of the presence and duration of spatially dependent image exposure information.

Abstract: The present invention relates to the field of panoramic still and motion photography. In a first embodiment, a camera apparatus for panoramic photography includes a first image sensor positioned to capture a first image. The first image sensor has a rolling-shutter readout arranged in portrait orientation. The camera apparatus also includes second image sensor positioned to capture a second image. The second image sensor has a rolling-shutter readout arranged in portrait orientation. Finally, the camera apparatus includes a controller configured to signal the second image sensor to start capturing the second image before the first image sensor finishes capturing the first image. At least a portion of the first image is in front of the second image relative to a forward direction of the camera apparatus.

Abstract: A flexible, user-friendly computer-implemented image processing system is provided. The system includes a process to receive an image rendering request. The image rendering request includes an indication of raw image data and an indication of desired rendering output characteristics. A rendering process is configured to process the raw image data to generate at least one rendered image, based on an indication of a particular image acquisition device employed to generate the raw image data. In accordance with some embodiments, the rendering process includes a plurality of rendering sub-processes. Each sub-process corresponds to a separate image acquisition device, and the rendering process is configured to process the raw image data based on the sub-process corresponding to the indication of the particular image acquisition device employed to generate the raw image data.

Abstract: An array of vertical color filter (VCF) sensor groups, optionally including or coupled to circuitry for converting photogenerated carriers produced in the sensors to electrical signals, and methods for reading out any embodiment of the array. The array has a top layer (including the top sensors of the sensor group) and at least one low layer including other ones of the sensors. Only the top layer can be read out with full resolution. Each low layer can only be read out with less than full resolution to generate fewer sensor output values than the total number of pixel sensor locations. Typically, the sensor groups are arranged in cells, each cell including a S sensor groups (e.g., S=4), with S sensors in the top layer and fewer than S sensors in each low layer of the cell. Typically, each cell includes at least one shared sensor (a sensor shared by two or more VCF sensor groups) in each low layer, and each cell includes sensor selection switches (e.g., transistors) between the cell's sensors and a sense node.

Abstract: A vertical color filter sensor group formed on a substrate (preferably a semiconductor substrate) and including at least two vertically stacked, photosensitive sensors, and an array of such sensor groups. In some embodiments, a carrier-collection element of at least one sensor of the group has substantially larger area, projected in a plane perpendicular to a normal axis defined by a top surface of a top sensor of the group, than does each minimum-sized carrier-collection element of the group. In some embodiments, the array includes at least two sensor groups that share at least one carrier-collection element. Optionally, the sensor group includes at least one filter positioned relative to the sensors such that radiation that has propagated through or reflected from the filter will propagate into at least one sensor of the group.

Abstract: An array of vertical color filter (VCF) sensor groups, each VCF sensor group including at least two vertically stacked, photosensitive sensors. Preferably, the array is fabricated, or the readout circuitry is configured (or has a state in which it is configured), to combine the outputs of sensors of multiple sensor groups such that the array emulates a conventional array of single-layer sensors arranged in a Bayer pattern or other single-layer sensor pattern, and such that the outputs of at least substantially all of the sensors of each of the VCF sensor groups are utilized to emulate the array of single-layer sensors.

Abstract: A method for storing a full Red, Green, Blue (RGB) data set. A full RGB data set is three-color image data captured with an imager array formed on a semiconductor substrate and comprising a plurality of vertical-color-filter detector groups. Each of the vertical color detector groups comprises three detector layers each configured to collect photo-generated carriers of a first polarity, separated by intervening reference layers configured to collect and conduct away photo-generated carriers of opposite polarity, the three detector layers being disposed substantially in vertical alignment with respect to one another and having different spectral sensitivities. The three-color image data is then stored as digital data in a digital storage device without performing interpolation on the three-color image data.

Abstract: A storage pixel sensor disposed on a semiconductor substrate comprises a photodiode having a first terminal coupled to a first potential and a second terminal. A barrier transistor has a first terminal coupled to the second terminal of the photodiode, a second terminal and a control gate coupled to a barrier set voltage. A reset transistor has a first terminal coupled to the second terminal of the barrier transistor, a second terminal coupled to a reset reference potential that reverse biases the photodiode, and a control gate coupled to a source of a RESET signal. A photocharge integration node is coupled to said second terminal of said barrier transistor. The photocharge integration node comprises the control gate of a first source-follower transistor. The first source-follower transistor is coupled to a source of bias current and has an output.