Abstract: A method for identifying a set of key frames from a video sequence including a time sequence of video frames, comprising: extracting a feature vector for each video frame in a set of video frames selected from the video sequence; defining a set of basis functions that can be used to represent the extracted feature vectors, wherein each basis function is associated with a different video frame in the set of video frames; representing the feature vectors for each video frame in the set of video frames as a sparse combination of the basis functions associated with the other video frames; and analyzing the sparse combinations of the basis functions for the set of video frames to select the set of key frames.

Abstract: A method for identifying a set of key frames from a video sequence including a time sequence of video frames, the method executed at least in part by a data processor, comprising: selecting a set of video frames from the video sequence; identifying a plurality of visually homogeneous regions from each of the selected video frames; defining a set of basis functions, wherein each basis function is associated with a different visually homogeneous region; determining a feature vector for each of the selected video frames; representing each of the determined feature vectors as a sparse combination of the basis functions; for each of the determined feature vectors, determining a sparse set of video frames that contain the visually homogeneous regions corresponding to the basis functions included in the corresponding sparse combination of the basis functions; and analyzing the sparse sets of video frames to identify the set of key frames.

Abstract: Disclosed herein are methods and devices for generating electricity from an effluent source. In the presence of a biological catalyst, a high strength effluent allows for efficient production of electricity. Further, disclosed herein are methods for the treatment of wastewater while generating electricity.

Abstract: A method for determining a video summary from a video sequence including a time sequence of video frames, comprising: defining a global feature vector representing the entire video sequence; selecting a plurality of subsets of the video frames; extracting a frame feature vector for each video frame in the selected subsets of video frames; defining a set of basis functions, wherein each basis function is associated with the frame feature vectors for the video frames in a particular subset of video frames; using a data processor to automatically determine a sparse combination of the basis functions representing the global feature vector; determining a summary set of video frames responsive to the sparse combination of the basis functions; and forming the video summary responsive to the summary set of video frames.

Abstract: An image sensor for capturing a color image comprising a two dimensional array of light-sensitive pixels including panchromatic pixels and color pixels having at least three different color responses, the pixels being arranged in a rectangular minimal repeating unit having at least eight pixels and having at least two rows and two columns, wherein for a first color response, the color pixels having the first color response alternate with panchromatic pixels in at least two directions, and for each of the other color responses there is at least one row, column or diagonal of the repeating pattern that only has color pixels of the given color response and panchromatic pixels.

Abstract: A method of forming a full-color output image using a color filter array image having a plurality of color channels and a panchromatic channel, comprising capturing a color filter array image having a plurality of color channels and a panchromatic channel, wherein the panchromatic channel is captured using a different exposure time than at least one of the color channels; computing an interpolated color image and an interpolated panchromatic image from the color filter array image; computing a chrominance image from the interpolated color image; and forming the full color output image using the interpolated panchromatic image and the chrominance image.

Abstract: A method of forming a full-color output image using a color filter array image having a plurality of color channels and a panchromatic channel, comprising capturing a color filter array image having a plurality of color channels and a panchromatic channel, wherein the panchromatic channel is captured using a different exposure time than at least one of the color channels; computing an interpolated color image and an interpolated panchromatic image from the color filter array image; computing a transform relationship from the interpolated color image; and forming the full color output image using the interpolated panchromatic image and the functional relationship.

Abstract: A method for sharpening an input digital image captured using a digital camera having a zoom lens, determining a parameterized representation of lens acuity of the zoom lens as a function of at least the lens focal length and lens F# by fitting a parameterized function to lens acuity data for the zoom lens at a plurality of lens focal length and lens F/#; using a processor to sharpen the input digital image responsive to the particular lens focal length and lens F/# corresponding to the input digital image using the parameterized representation of the lens acuity.

Abstract: A method for reducing noise in a color image captured using a digital image sensor having pixels being arranged in a rectangular minimal repeating unit. The method comprises, for a first color channel, determining noise reduced-pixel values using a first noise reducing process that includes computing weighted pixel differences by combining the pixel differences with corresponding local edge-responsive weighting values. The method further comprises a second noise reducing process that includes computing weighted chroma differences by combining chroma differences with corresponding local edge-responsive weighting values.

Abstract: A method for reducing noise in an image captured using a digital image sensor having pixels being arranged in a rectangular minimal repeating unit, comprising: computing first weighted pixel differences by combining first pixel differences between the pixel value of a central pixel and pixel values for nearby pixels of the first channel in a plurality of directions with corresponding local edge-responsive weighting values; computing second weighted pixel differences by combining second pixel differences between pixel values for pixels of at least one different channel in the plurality of directions with corresponding local edge-responsive weighting values; and computing a noise-reduced pixel value for the central pixel by combining the first and second weighted pixel differences with the pixel value for the central pixel.

Abstract: A method for producing a noise-reduced digital image captured using a digital imaging system having signal-dependent noise characteristics, comprising: capturing one or more noisy digital images of a scene, wherein said at least one noisy digital image has signal-dependent noise characteristics; defining a functional relationship to relate the noisy digital images to a noise-reduced digital image, wherein the functional relationship includes at least two sets of unknown parameters, and wherein at least one of the sets of unknown parameters relates to the signal-dependent noise characteristics; defining an energy function responsive to the functional relationship which includes at least a data fidelity term to enforce similarities between the noisy digital images and the noise-reduced digital image, and a spatial fidelity term to encourage sharp edges in the noise-reduced digital image; and using an optimization process to determine a noise-reduced image responsive to the energy function.

Abstract: A method for resizing an input digital image to form an output digital image with an output aspect ratio, comprising: determining a number of rows or columns that need to be reduced from the input digital image; determining an image energy map for the input digital image; repeatedly determining a seam path responsive to the image energy map and removing pixels along the determined seam path to determine the output digital image, wherein the determined seam path satisfies a constraint that a directional image gradient is less than a gradient threshold for each pixel in the seam path, until either the determined number of rows or columns has been reduced or no valid seam path can be found; and cropping or scaling the output digital image to the output aspect ratio if the determined number of rows or columns was not reduced.

Abstract: A method for modifying an input digital image having input dimensions defined by a number of input rows and input columns to form an output digital image where the number of rows or columns is reduced by one, comprising an image energy map determined from the input image; determining a seam path responsive to the image energy map; imposing constraints on the seam path; and removing pixels along the seam path to modify the input digital image.

Abstract: An image sensor for capturing a color image comprising a two dimensional array of light-sensitive pixels including panchromatic pixels and color pixels having at least three different color responses, the pixels being arranged in a rectangular minimal repeating unit having at least eight pixels and having at least two rows and two columns, wherein for a first color response, the color pixels having the first color response alternate with panchromatic pixels in at least two directions, and for each of the other color responses there is at least one row, column or diagonal of the repeating pattern that only has color pixels of the given color response and panchromatic pixels.

Abstract: A method is described for forming a full-color output image from a color filter array image comprising capturing an image using an image sensor including panchromatic pixels and color pixels having at least two different color responses, the pixels being arranged in a rectangular minimal repeating unit wherein for a first color response, the color pixels having the first color response alternate with panchromatic pixels in at least two directions, and for each of the other color responses there is at least one row, column or diagonal of the repeating pattern that only has color pixels of the given color response and panchromatic pixels. The method further comprising, computing an interpolated panchromatic image from the color filter array image; computing an interpolated color image from the color filter array image; and forming the full color output image from the interpolated panchromatic image and the interpolated color image.

Abstract: A method of forming a full-color output image from a color filter array image having a plurality of color pixels having at least two different color responses and panchromatic pixels, comprising capturing a color filter array image using an image sensor including panchromatic pixels and color pixels having at least two different color responses, the pixels being arranged in a repeating pattern having a square minimal repeating unit having at least three rows and three columns, the color pixels being arranged along one of the diagonals of the minimal repeating unit, and all other pixels being panchromatic pixels; computing an interpolated panchromatic image from the color filter array image; computing an interpolated color image from the color filter array image; and forming the full color output image from the interpolated panchromatic image and the interpolated color image.

Abstract: An image sensor for capturing a color image comprising a two dimensional array of light-sensitive pixels including panchromatic pixels and color pixels having at least two different color responses, the pixels being arranged in a repeating pattern having a square minimal repeating unit having at least three rows and three columns, the color pixels being arranged along one of the diagonals of the minimal repeating unit, and all other pixels being panchromatic pixels.

Abstract: A method of forming a full-color output image using a color filter array image having a plurality of color channels and a panchromatic channel, comprising capturing a color filter array image having a plurality of color channels and a panchromatic channel, wherein the panchromatic channel is captured using a different exposure time than at least one of the color channels; computing an interpolated color image and an interpolated panchromatic image from the color filter array image; computing a transform relationship from the interpolated color image; and forming the full color output image using the interpolated panchromatic image and the functional relationship.

Abstract: A method of forming a full-color output image using a color filter array image having a plurality of color channels and a panchromatic channel, comprising capturing a color filter array image having a plurality of color channels and a panchromatic channel, wherein the panchromatic channel is captured using a different exposure time than at least one of the color channels; computing an interpolated color image and an interpolated panchromatic image from the color filter array image; computing a chrominance image from the interpolated color image; and forming the full color output image using the interpolated panchromatic image and the chrominance image.

Abstract: A method for forming a final digital color image with reduced motion blur including of a processor for providing images having panchromatic pixels and color pixels corresponding to at least two color photo responses, interpolating between the panchromatic pixels and color pixels to produce a panchromatic image and a full-resolution color image to produce a fall-resolution synthetic panchromatic image from the fill-resolution color image; and developing color correction weights in response to the synthetic panchromatic image and the panchromatic image; and using the color correction weights to modify the fill-resolution color image to provide a final color digital image.