Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as “zones”) that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.

Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.

Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.

Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as “zones”) that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.

Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract: A camera mounting assembly is disclosed for a plurality of cameras. In an example embodiment, the camera mounting assembly has a substantially cubic configuration. The camera mounting assembly includes a cubic configuration that includes one or more detachable frames. Each frame is attached to one or more other detachable frames via a securing mechanism to form the cube structure. Each frame includes one or more arms connected to a lens opening, the lens opening configured to allow a lens of the camera to have an unobstructed view for capturing images. A camera is secured to each frame by a standoff. A first end of the standoff attaches to a corner of the frame and the second end is attached to the camera. A box structure that houses electronics is located at the center of the cubic configuration and the box structure is secured to one or more frames via standoffs.

Abstract: A camera mounting assembly is disclosed for a plurality of cameras. The camera mounting structure may have a substantially circular configuration. The camera mounting structure may include a unibody base cage. One or more lens openings may be configured along the circumference of the unibody base cage. The lens openings may allow a camera lens to have an unobstructed view outside of the unibody base cage to capture an image or a video. The assembly further may include one or more sub-cages that are releasably attached to the unibody base cage. Each sub-cage may be configured to securely hold a camera via a securing mechanism such as a clamp or interlocking pin. Each sub-cage further may include an aligning pin that is configured to align the center of the camera with the center of the lens opening.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.