Abstract: Systems and methods are disclosed for image capture. For example, systems may include an image capture module including an image sensor configured to capture images, a connector, and an integrated mechanical stabilization system configured to control an orientation of the image sensor relative to the connector; an aerial vehicle configured to be removably attached to the image capture module by the connector and to fly while carrying the image capture module; and a handheld module configured to be removably attached to the image capture module by the connector, wherein the handheld module includes a battery and an integrated display configured to display images received from the image sensor.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Methods and apparatus for just-in-time streaming media. Existing content delivery networks are optimized for providing mass media to many consumers. This delivery model is poorly suited to user-specific content. Exemplary embodiments of the present disclosure create a program instance that can service a client's media requests from their archival data. In one specific implementation, the archival data is stored segments that are ready for streaming; a content server may provide either a consolidated file or a media “quasi-stream” from the same storage object(s). The quasi-stream supports progressive playback (media playback as it is being downloaded.) The program instance provides the client device the illusion of a static file system, however client requested access to HTTP file downloads are provided in packets that are transmuxed/transcoded from archival data.

Abstract: A method for encoding images includes decoding a first encoded image to obtain a first decoded image, where the first decoded image includes a first decoded portion corresponding to a first encoded portion of the first encoded image and a second decoded portion corresponding to a second encoded portion of the first encoded image; decoding a second encoded image to obtain a second decoded image; combining the first decoded image and the second decoded image to obtain a single decoded image; and encoding the single decoded image to obtain a single encoded image that includes a third and a fourth encoded portions. Encoding the single decoded image includes obtaining the third encoded portion of the single encoded image by copying the first encoded portion of the first encoded image; and obtaining the fourth encoded portion of the single encoded image by encoding the second decoded portion using an encoder.

Abstract: The present teachings provide an image capture device including an optical system having a bayonet. The bayonet is connected to a body of the image capture device. The bayonet includes a forward surface, a rearward surface opposing the forward surface, and a bayonet axial surface; and. The optical system includes an integrated sensor and lens assembly (ISLA) extending away from the rearward surface of the bayonet; and a lens module extending away from the forward surface of the bayonet and comprising a lens module axial surface, wherein the lens module axial surface contacts the bayonet axial surface so that the lens module is axially aligned with the bayonet.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Abstract: An image capture device may detect presence of drop of liquid on its optical element during capture of visual content. The image capture device may effectuate removal of the drop of liquid from the optical element.

Abstract: An image capture device may include an image sensor, a processor, and memory. The image sensor may be configured to obtain an image. The processor may be configured to: generate a grid on the image forming tiles; determine a fringing level of each vertex of the vertices; sort all of the tiles based on the fringing level of each tile so that the tiles are sorted in a descending order from the tile with a highest of the fringing levels to the tile with a lowest of the fringing levels; and apply a fringing compensation to a subset of the sorted tiles to obtain a processed image. The memory may be configured to store the processed image.

Abstract: A motor controller of an unmanned aerial vehicle (UAV) is optimized to improve operation of the UAV. The motor control optimizations include controlling a motor of a UAV to reduce an operating temperature of the UAV, reducing an amount of latency or jitter resulting from motor operation, and applying a smoothing filter for motor operation. For example, controlling a motor of a UAV to reduce an operating temperature of the UAV can include using a temperature model for the unmanned aerial vehicle or an operating temperature measurement to determine a current operating temperature and comparing that current operating temperature to a threshold. If the threshold is exceeded, settings of the motor are adjusted to cause the motor to operate in a manner that reduces the current operating temperature.

Abstract: Consumption information associated with a user consuming video segments may be obtained. The consumption information may define user engagement during a video segment and/or user response to the video segment. Sets of flight control settings associated with capture of the video segments may be obtained. The flight control settings may define aspects of a flight control subsystem for the unmanned aerial vehicle and/or a sensor control subsystem for the unmanned aerial vehicle. The preferences for the flight control settings of the unmanned aerial vehicle may be determined based upon the first set and the second set of flight control settings. Instructions may be transmitted to the unmanned aerial vehicle. The instructions may include the determined preferences for the flight control settings and being configured to cause the unmanned aerial vehicle to adjust the flight control settings to the determined preferences.

Abstract: An image capture device includes a heatsink that absorbs thermal energy and a first component that generates thermal energy. The image capture device includes a second component that generates thermal energy and a first conductor that extends between the first component and the heatsink, and the first conductor moves thermal energy from the first component to the heatsink by conduction. The image capture device includes a second conductor that extends between the second component and the heatsink, and the second conductor has a portion perpendicularly extended relative to the first conductor. The second conductor moves thermal energy from the second component to the heatsink by conduction.

Abstract: A face located along a stitch line in a spherical image is detected by rendering views of regions of the spherical image along the stitch line. The spherical image may be produced by combining first and second images. A first view of a projection of the spherical image is rendered. A scaling factor for rendering a second view of the projection is determined based characteristics of the first portion of the face. The second view is then rendered according to the scaling factor. The use of the scaling factor to render the second view causes a change in the depiction of the second portion of the face. For example, the scaling factor can indicate to change the resolution or expected size of the second portion of the face when rendering the second view. A face is then detected within the spherical image based on the rendered first and second views.

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

Abstract: An image capture device is described that includes a body; a mounting structure that is connected to the body; an integrated sensor-lens assembly (ISLA) that defines an optical axis and extends through the body and the mounting structure; and an accessory that is releasably connectable to the mounting structure via rotation through a range of motion less than approximately 90 degrees. The mounting structure and the accessory include corresponding angled bearing surfaces that are configured for engagement such that rotation of the accessory relative to the mounting structure creates a bearing effect that displaces the accessory along the optical axis to thereby reduce any axial force required during connection and disconnection of the accessory.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: Media items captured by a media capture device may include and/or be associated with values of a clock-change identifier. The values of the clock-change identifier may be set based on when and how many times the time of the media capture device was changed. Based on a capture-time of a media item being incorrect, other media items with the same value of the clock-change identifier may be determined to be incorrect. Capture-times of the other media items may be corrected based on capture-time correction of the media item.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.