Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load.

Abstract: Systems and methods are disclosed for image signal processing. For example, systems may include an image sensor and a processing apparatus. The image sensor captures image data using a plurality of selectable exposure times. The processing apparatus receives a first image from the image sensor captured with a first exposure time and receives a second image from the image sensor captured with a second exposure time that is less than the first exposure time. A high dynamic range image is determined based on the first image and the second image, wherein an image portion of the high dynamic range image is based on a corresponding image portion of the second image when a pixel of a corresponding image portion of the first image is saturated. An output image that is based on the high dynamic range image is stored, displayed, or transmitted.

Abstract: An image capture device with dynamic wind noise compression tuning techniques is described. A technique includes detecting of the presence of wind noise by measuring coherence between at least two microphones. For a compressor, adjusting a default compression threshold and default compression parameters based on the coherence measurements. For each microphone, applying by the compressor the adjusted compression parameters when an audio signal is above the adjusted compression threshold and applying the default compression parameters when the audio signal is below the adjusted compression threshold.

Abstract: A remapping space may define correspondence between times within a video and times within a time-remapped video. Responsive to user selection of a moment within the video for initiation of time remapping using a selected playback speed, a start point and an end point may be inserted at the selected moment within the remapping space. Responsive to user selection of a segment within the video to apply the selected playback speed in the time remapping, the start point and/or the end point may be moved to change the correspondence between times within the video and times within the time-remapped video.

Abstract: A video, such as a spherical video, may include motion due to motion of one or more image capture devices during capture of the video. Motion of the image capture devices during the capture of the video may cause the playback of the video to appear jerky/shaky. The video may be stabilized by using both a horizontal feature and a fixed feature captured within the video.

Abstract: A highlight moment within a video, music to accompany a looping presentation of the video, and a looping effect for the video may be determined. A segment of the video to be used for the looping presentation of the video may be selected based on highlight moment, the music, and the looping effect. The looping presentation of the video may be generated to have the segment edited based on a style of the looping effect and to include accompaniment of the music.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. Context of the video may be assessed and used to suggest framing of the video.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include determining a sequence of orientation estimates based on sensor data from one or more motion sensors; based on the sequence of orientation estimates, invoking a mechanical stabilization system to reject motions of an image sensor occurring within a first operating bandwidth with an upper cutoff frequency; receiving an image from the image sensor; based on the sequence of orientation estimates, invoking an electronic image stabilization module to correct the image for rotations of the image sensor occurring within a second operating bandwidth with a lower cutoff frequency to obtain a stabilized image, wherein the lower cutoff frequency is greater than the upper cutoff frequency; and storing, displaying, or transmitting an output image based on the stabilized image.

Abstract: A camera housing includes four walls configured to enclose and secure a camera: a top wall, a bottom wall, a right wall, and a left wall. The bottom wall includes a first segment and a segment coupled by a latching mechanism. The latching mechanism comprises a tongue component coupled to the second segment and a groove component coupled to the first segment. The tongue and groove components are configured such that the tongue component securely couples the second segment to the first segment when the camera frame is in the closed configuration. In the open configuration, the first and second segment can decouple and the left wall and second segment rotates upwards relative to the top wall such that a camera can be inserted or removed from the camera system. The camera housing also includes a button interface, an input/output interface, and a mounting mechanism.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

Abstract: An aerial vehicle comprises one or more sensors to environmental data, a communication system to receive control inputs from a user, two or more actuators, with each actuator coupled to a rotary wing. The aerial vehicle also comprises a controller to determine a mode of the aerial vehicle based on the environmental data and the control inputs, each mode indicating a set of flight characteristics for the aerial vehicle, generate a gain value based on the mode, the gain value, when used to modify power signals transmitted to actuators of the aerial vehicle, causing the aerial vehicle to conform within the indicated flight characteristics of the determined mode, generate an output signal modified by the gain value based on the input signal, and transmit a power signal based on the output signal to each actuator of the aerial vehicle.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences change in position during the capture duration. The trajectory of the image capture device is smoothed based on a look ahead of the trajectory. A punchout of the visual content is determined based on the smoothed trajectory. The punchout of the visual content is used to generate stabilized visual content.

Abstract: Auto exposure metering is adapted for spherical panoramic content. Using input image data, a first metering map is generated for a selected image sensor and a second metering map is generated for an unselected image sensor. Auto exposure level values for the selected image sensor and for the unselected image sensor are respectively metered using the first metering map and the second metering map, such as by adjusting luminance weights in certain locations of the respective image sensor panoramic image capture band. Hemispherical images are processed using the auto exposure metered level values and stitched together in a panoramic format to produce a spherical panoramic image. The metering maps are generated to account for areas of greatest image data importance relative to a primary orientation direction of the spherical panoramic image. This allows for effective auto exposure metering of such areas within the resulting spherical panoramic image.

Abstract: This disclosure describes systems and methods for a multipoint cable cam (MPCC) of an aerial vehicle. A method includes operations of receiving user input associated with a predetermined path and correlating the received user input with stored global positioning satellite (GPS) data to generate one or more virtual waypoints along the predetermined path. The method includes processing the one or more virtual waypoints to generate a spline-based flight path. The method may include storing the spline-based flight path and transmitting the spline-based flight path to the aerial vehicle.

Abstract: Implementations of a mobile platform for image capture device control may use voice recognition. A user may use a mobile platform, such as a mobile application, on a mobile device to interpret and relay voice commands to an image capture device. Voice recognition services may be integrated into the mobile application, the mobile device operating system (OS), or both. The voice recognition services may be server-based.

Abstract: A camera is configured with multiple microphones to reduce wind noise in audio data collected by the camera. The camera receives motion data, which may comprise data indicating acceleration of the camera, a plurality of video frames received by the camera, or a background level of noise associated with one or more microphones configured on the camera. The camera determines a motion vector from the motion data. The motion vector is parallel to the direction of motion of the camera. The camera selects a subset of one or more microphones in the direction of the motion vector. By recording audio data using the one or more selected microphones, the camera reduces wind noise in the audio data.

Abstract: Images may be captured by a moving image capture device. A reference image and a background image may be selected from the images. The reference image may include depiction of an object, with the object blocking view of the background. The background image may include depiction of the background blocked by the object in the reference image. An object layer may be generated by segmenting the depiction of the object from the reference image. A background layer may be generated by combining the depiction of the background in the background image with the reference image. The background layer may be blurred and combined with the object layer to generate a panning image.

Abstract: An image capture device may provide framing recommendations for capture of visual content. Framing recommendation may include information on how one or more subjects are to be positioned with respect to the image capture device. Framing recommendation may guide a user in how the image capture device and/or the subject(s) are to be positioned. Framing recommendation may include suggestions on orientation of the image capture device with respect to the subject(s) to improve composition of the subject(s) within the visual content. The image capture device may provide these aforementioned framing recommendations visually, audibly, and/or through other means. For example, the image capture device may provide framing recommendations in form of visual overlays/directional graphs and/or audible instructions (e.g., directions on subject/image capture device positioning provided through a speaker of the image capture device). Framing recommendation may be static (not changing over time) or dynamic (changing over time).

Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.

Abstract: A wearable imaging device is disclosed. The wearable imaging device includes a frame defining openings aligned to a user's field of view when in a wearable position and a pair of temple arms each extending from one end of the frame and moveable between the wearable position and a folded position. The wearable imaging device includes lenses within the openings of the frame, an imaging unit coupled to the frame and comprising an imaging lens that captures light through at least one of the lenses, an electronics unit coupled to the frame and in communication with the imaging unit, a power source coupled to the frame and providing power to the imaging unit and to the electronics unit, and an input/output module coupled to at least one of the imaging unit, the electronics unit, or the power source that includes a communications interface for communicating with external devices.

Abstract: An image capture device may include a touchscreen display, which may be used to receive user input. The image capture device may determine whether it is under water based on analysis of visual content captured by the image capture device. Responsive to determination that it is under water, the image capture device may change operation with respect to the touchscreen display.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.

Abstract: Methods and apparatus for blending unknown pixels in overlapping images. In one embodiment, an action camera captures two hyper-hemispherical fisheye images that are stitched to a 360° panorama. In order to remove exposure differences between the two cameras, the images are pre-processed prior to multiband blending. The pre-processing leverages image information from pixels to make informed guesses about pixels that were not captured. In particular, various pixels with different knowability (e.g., known, unknown, consistent, and conflicting) may be handled differently so as to emphasize/de-emphasize their importance in pre-processing.

Abstract: An image capture device may include a microphone, a vibration sensor, and a processor. The microphone may obtain a microphone signal that includes an acoustic signal portion and a mechanical noise portion. The vibration sensor may obtain a vibration signal. The processor may upsample the vibration signal. The processor may determine a correlation value. The correlation value may be based on the microphone signal, the upsampled vibration signal, or both. The processor may determine filter coefficients. The filter coefficients may be determined on a condition that the correlation value is above a threshold. The filter coefficient may be based on the upsampled vibration signal. The processor may filter the vibration signal based on the filter coefficients to remove the mechanical noise portion and obtain a processed microphone signal. The processor may output the processed microphone signal.

Abstract: A camera housing includes a main body having four sides that form a cavity to receive a camera, a door detachably coupled to the main body, and an exposed area in the main body allowing a user to manipulate a button on the camera or access an I/O or microphone interface of the camera. The camera housing includes an indicator window substantially aligning with a visible indicator on the camera, a latch detachably securing a first side of the door to a first side of the main body; and a hinge coupling a second side of the door to a second side of the main body. The camera housing includes securing protrusions that interlock with corresponding mounting protrusions extending from a camera mount. A front face and a rear face of the camera are exposed when the camera is secured by the door in the camera housing.

Abstract: Automated camera mode selection using local motion vectors is described. An image capture device includes an image metric estimation unit to detect a presence or level of an image metric in a scene of an image to capture based on image metric inputs, a motion estimation unit to determine a level of movement within the scene using ratios of histograms based on local motion vectors, a mode selection unit to select a camera mode for capturing the image based on outputs of the image metric estimation unit and the motion estimation unit, and an image sensor to capture the image according to the selected camera mode. The motion estimation unit computes a norm for each local motion vector, generates a histogram from the computed norms, determines movement metrics based on the ratios of histograms associated with different norm thresholds, and identifies the level of movement based on the movement metrics.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: A method and apparatus for denoising a video are disclosed. The method includes obtaining multiple frames of the video. One or more frames of the video may be temporally precedent or temporally subsequent to a central frame. The method includes performing a first denoising of the multiple frames. The method includes concatenating the denoised frames into a concatenated input. The method includes performing a second denoising of the concatenated input. The method includes outputting a denoised frame based on the denoised concatenated input.

Abstract: Video information defining video content to be encoded may be obtained. Scene composition information for the video content may be obtained. The scene composition information may be determined by a convolutional neural network based on visuals represented within the video content. The video content may be encoded based on the scene composition information. The encoding of the video content may generate encoded video information defining the encoded video content.

Abstract: A camera detects devices, such as other cameras, smart devices, and access points, with which the camera may communicate. The camera may alternate between operating as a wireless station and a wireless access point. The camera may connect to and receive credentials from a device for another device to which it is not connected. In one embodiment, the camera is configured to operate as a wireless access point, and is configured to receive credentials from a smart device operating as a wireless station. The camera may then transfer the credentials to additional cameras, each configured to operate as wireless stations. The camera and additional cameras may connect to a smart device directly or indirectly (for instance, through an access point), and the smart device may change the camera mode of the cameras. The initial modes of the cameras may be preserved and restored by the smart device upon disconnection.

Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.

Abstract: Visual content may be captured by an image capture device during a capture duration. The rotational positions of the image capture device may change during the capture duration. The rotational positions of the image capture device may be smoothed based on a look ahead of a rotation constraint. A punchout of the visual content may be determined based on the smoothed rotational positions. The punchout of the visual content may be used to generate stabilized visual content.

Abstract: Multiple video clips may be selected for use in generating a video edit. A graphical user interface for editing the multiple video clips may include a combined progress length element. The combined progress length element may visually represent combined progress length of the multiple video clips.

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

Abstract: An image capture device includes a first component that is configured to provide thermal energy. A heatsink is spaced a distance apart from the first component, and a second component is positioned between the first component and the heatsink. A conductor contacts the first component and the heatsink, and the conductor extends from the first component along sides of the second component to the heatsink.

Abstract: A media summary is generated to include portions of media items. The portions of media items identified for inclusion in the media summary is determined based on the length of the media summary and classification of content depicted within the media items. Classification of content depicted within the media items includes number of smiles depicted within the media items.

Abstract: Systems and methods are disclosed for non-linear color correction. The method including receiving an input image from an image sensor, converting the input image from a red, green, blue (RGB) color space format to an alternate color space format, determining localized hue correction parameters for a selected color in the alternate color space, determining localized saturation correction parameters for a selected hue in the alternate color space, applying the localized hue correction parameters and the localized saturation correction parameters to the input image to generate an output image and storing, displaying, or transmitting the output image based on at least the localized hue correction parameters and the localized saturation correction parameters.

Abstract: An image capture device continuously generates time-lapse video frames to be included within a time-lapse video using a time-lapse video frame rate, with the value of the time-lapse video frame rate changing based on activation of a trigger to change the time-lapse video frame rate.

Abstract: An image or a video may include a spherical capture of a scene. A punchout of the image or the video may provide a panoramic view of the scene.

Abstract: A user interface of an image capture device may provide options for a user to schedule future capture of visual content by the image capture device. The user may interact with the options to specify the start time and the capture duration for the future capture of visual content.

Abstract: Systems and methods are disclosed for image capture. For example, methods may include accessing a sequence of images from an image sensor; determining a sequence of parameters for respective images in the sequence of images based on the respective images; storing the sequence of images in a buffer; determining a temporally smoothed parameter for a current image in the sequence of images based on the sequence of parameters, wherein the sequence of parameters includes parameters for images in the sequence of images that were captured after the current image; applying image processing to the current image based on the temporally smoothed parameter to obtain a processed image; and storing, displaying, or transmitting an output image based on the processed image.

Abstract: This disclosure describes a system including an imaging device. The imaging device includes an imaging unit with a lens that focuses light onto an image sensor that produces image data, wherein the image data is only stored by the imaging device for transfer to and processing by an external device. The imaging device includes a control interface that provides commands to the imaging unit. The system also includes a mount with a wall that releasably secures the imaging device and provides access to the control interface and a securing structure that secures the mount to a variety of locations.

Abstract: This disclosure relates to providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap. The UAV may include a housing, a motor, a first image sensor, a second image sensor, a first optical element having a first field of view greater than 180 degrees, a second optical element having a second field of view greater than 180 degrees, and one or more processors. The first optical element and the second optical element may be carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view, and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap. Flight control for the UAV may be provided based on parallax disparity of an object within the overlapping fields of view.

Abstract: An image capture device may obtain first frames at a first frame rate from a first image sensor and obtain second frames at a second frame rate from a second image sensor. The image capture device may process the first frames from the first image sensor and store the processed first frames in a memory. The image capture device may partially process the second frames from the second image sensor to obtain first camera control statistics. The image capture device may switch a capture mode to obtain third frames at the second frame rate from the first image sensor obtain fourth frames at the first frame rate from the second image sensor.

Abstract: A button is disclosed for use with an image capture device in an underwater environment. The button includes a movable plunger configured to cause actuation of the image capture device, and upper and lower components collectively defining an internal cavity that is configured to receive the plunger. The upper and lower components are configured and connected such that actuation of the image capture device is prevented until a threshold pressure is applied to the upper component that is greater than external water pressure applied in the underwater environment. The upper component includes at least one opening that is configured to allow water to enter the internal cavity to modify an internal pressure within the internal cavity so as to reduce the threshold pressure required to actuate the image capture device in the underwater environment.

Abstract: This disclosure relates to systems and methods for determining predicted risk for a flight path of an unmanned aerial vehicle. A previously stored three-dimensional representation of a user-selected location may be obtained. The three-dimensional representation may be derived from depth maps of the user-selected location generated during previous unmanned aerial vehicle flights. The three-dimensional representation may reflect a presence of objects and object existence accuracies for the individual objects. The object existence accuracies for the individual objects may provide information about accuracy of existence of the individual objects within the user-selected location. A user-created flight path may be obtained for a future unmanned aerial flight within the three-dimensional representation of the user-selected location. Predicted risk may be determined for individual portions of the user-created flight path based upon the three-dimensional representation of the user-selected location.

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.