Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Systems and methods are disclosed for boot sequences in cold temperatures. For example, methods may include accessing a temperature measurement from a temperature sensor; responsive to the temperature measurement being below a threshold, setting a clock frequency for a clock signal used by an integrated circuit to a first frequency; and executing boot code in the integrated circuit using the clock signal at the first frequency, wherein the first frequency is lower than a second frequency that the integrated circuit is configured to use when executing the boot code at higher temperatures. In some implementations, an idle mode is used to heat up a device to achieve a temperature needed to support a use case for the device.

Abstract: An accessory for an image capture device is disclosed that includes: a body; a rotatable first support that is configured for connection to the image capture device; a second support that is pivotably reconfigurable between stowed and deployed configurations; and a third support including first and second legs that are pivotably connected to the body such that the third support is reconfigurable between collapsed and expanded configurations. In the stowed configuration, the second support is concealed within the body, and in the deployed configuration, the second support extends outwardly from the body to facilitate connection of the accessory to an ancillary product. In the collapsed configuration, the third support defines a grip for the image capture device, and in the expanded configuration, the body defines a third leg that cooperates with the first and second legs to provide a freestanding base for the image capture device.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: An image capture device includes electronic components and a body. The electronic components include an image sensor and a processing apparatus. The body defines an internal compartment containing the electronic components. The body includes a rear housing and a chassis. The rear housing extends around a top side, a right side, a bottom side, and a left side of the body. The chassis includes an upright portion and a lateral portion extending rearward from the upright portion. The rear housing and the chassis are coupled to each other to cooperatively form the internal compartment with the upright portion of the chassis being coupled to a front end of the rear housing and the lateral portion being positioned outside of and below the internal compartment.

Abstract: An underwater system is disclosed for use with a digital image capturing device (DICD) in underwater environments. The underwater system includes a center band having first and second support bands; a first housing fixedly connected to the first support band and including an optically clear material; a second housing fixedly connected to the second support band and including an optically clear material; a cradle connected to the first support band and configured to receive the DICD; and a latching mechanism positioned between the cradle and the first support band. The second support band is pivotally connected to the first support band such that the underwater system is repositionable between an open position and a closed position, and the latching mechanism is repositionable between a locked position, in which the latching mechanism securely engages the DICD, and an unlocked position, in which the latching mechanism is disengaged from the DICD.

Abstract: Methods and apparatus for stabilizing image data based on a lens polynomial. Non-rectilinear footage can be captured and rectified in-camera; the rectified images may be stabilized to provide rectified stable video. In one exemplary embodiment, the footage is rectified and stabilized based on a lens polynomial and the camera's own movement. In some variants, the rectified stable video may be stored along with its margin track. In-camera rectified stable video provides several benefits over traditional techniques (e.g., the ability to share rectilinear content from the camera without additional post-processing, as well as reduced file sizes of the shared videos). Lens-aware post-processing can reuse portions of the in-camera rectified stable videos while providing additional benefits (e.g., the ability to re-frame the video in post-production).

Abstract: Features to be enabled for an image capture device may be determined based on user subscription to a feature plan and/or user usage of the image capture device. The features for the image capture device may be enabled through firmware update or code unlock.

Abstract: Locations in which a person is depicted within video frames may be determined to identify portions of the video frames to be included in a composite video. A background image not including any depiction of the person may be generated, and the identified portions of the video frames may be inserted into the background image to generate the composite video.

Abstract: An image capture device is disclosed that includes a body and a door assembly that is configured for removable connection to the body. The door assembly includes a door body; a locking mechanism that is slidable in relation to the door body between a locked position and an unlocked position; and at least one biasing member that is configured for engagement (contact) with the door body and the locking mechanism to automatically move the locking mechanism into the locked position upon closure of the door assembly.

Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.

Abstract: A camera case that includes a buoyant material. The buoyant material forms a cavity defined by a top side, a right side, a bottom side, and a left side, and the cavity is configured to removably receive a camera. A front opening extends into the cavity. A rear opening is located opposite the front opening, and the rear opening is larger than the front opening so that the camera is extendable into the cavity through the rear opening. A button recess in the top side is aligned with a physical input interface of the camera. A mount opening extends through the bottom side of the camera case to receives a portion of a support member so that the support member and the camera are connectable through the mount opening. The camera case includes a sufficient amount of the buoyant material to float the camera in water when the camera is inserted into the cavity.

Abstract: Salient regions within video frames of a video may be identified. Sizes of salient regions within video frames may be determined and used to identify saliency frames in the video. Salient segments of the video may be identified using the saliency fames in the video. The salient segments of the video may be used to generate a video edit.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

Abstract: An image capture device may capture multiple audio content during capture of visual content. A viewing window for the visual content and rotational position of the image capture device during capture of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of a punchout of the visual content using the viewing window.

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.

Abstract: A non-transitory computer-readable storage medium stores executable instructions that, when executed by a processor, cause performance of operations comprising operations to access an image captured by an image sensor, obtain a transfer function for mapping pixel values, determine a faces indication that reflects a proportion of a scene depicted in the image that includes one or more human faces, and modify the transfer function based on the faces indication. Modifying the transfer function based on the faces indication comprises adjusting a gain of the transfer function to move the gain closer to unity. The operations include to apply the transfer function to pixel values of the image to produce a tone mapped image and output the tone mapped image.

Abstract: Systems, apparatus, and methods for augmenting dense depth maps using sparse data. Various embodiments combine single-image depth estimation (SIDE) techniques with structure-from-motion techniques for improved depth accuracy. In some examples, a machine learning (ML) model is used to generate a dense depth map based on one or more frames/images of a video. Structure-from-motion (SfM) analysis is performed on the video to determine depth information from camera movement in the video. The structure-from-motion techniques may generate more accurate data than the ML model, however, the data from the ML model may be denser compared with the SFM depth data. The dense ML model depth map may be augmented by the SFM depth data. Augmentation may include fitting the relative depths determined by the ML model depth map to the absolute depth in the SFM data resulting in more accurate dense depth information.

Abstract: An unmanned aerial vehicle including a housing, a first front arm, a first back arm, a second front arm, and a second back arm. The first front arm has an end at a first elevational plane when in a closed position. The first back arm has an end at a second elevational plane when in the closed position, the second elevational plane higher than the first elevational plane to provide an offset. The second front arm has an end at the first elevational plane when in the closed position. The second back arm has an end at the second elevational plane when in the closed position, the second elevational plane higher than the first elevational plane to provide the offset.

Abstract: A first device includes a processor and instructions. The instructions, when executed by the processor, cause the processor to configure the first device to receive network credentials; accept a connection request from a second device to connect to the first device; obtain the network credentials from the second device; configure the first device to connect to a third device subsequent to obtaining the network credentials; and transmit a request to connect to the third device, where request includes the network credentials.

Abstract: The present teachings provide a camera housing that includes a first housing portion, a second housing portion, a hinge, a latch mechanism, and protrusions. The first housing portion forms a first portion of a cavity. The second housing portion forms a second portion of the cavity The hinge is located within the first housing portion so that the first housing portion is divided into a first piece and a second piece. The hinge movably connects the first housing portion to the second housing portion so that the second housing portion is movable relative to the first housing. The latch mechanism is movable between an open position and a closed position. The protrusion extend from a third housing portion, and the third housing portion is located opposite the first housing portion with respect to the cavity.

Abstract: An image capture device may process first frames from a first image sensor obtained at a first frame rate and store the processed first frames in a memory. The image capture device may obtain first camera control statistics based at least on partially processed second frames from a second image sensor obtained at a second frame rate. The image capture device may switch a capture mode to obtain third frames at the second frame rate from the first image sensor and to obtain fourth frames at the first frame rate from the second image sensor.

Abstract: A video edit may include one or more segment of a video. A graphical user interface may convey information that indicates video editing decisions made to generate the video edit. The graphical user interface may include a timeline element to represent the length of the video and one or more inclusion elements to visually indicate the segment(s) of the video included in the video edit. The graphical user interface may convey information on the segment(s) of the video that have been automatically included in the video edit and the segment(s) of the video that have been manually included in the video edit.

Abstract: In one aspect of the present disclosure, a digital image capturing device (DICD) is disclosed that includes a device body with a printed circuit board (PCB), and an integrated sensor-lens assembly (ISLA) that is configured for releasable connection to the device body. The PCB defines a plurality of openings that extend therethrough and includes a plurality of connector pins that are fixedly positioned within the openings. The ISLA includes at least one connective surface that is configured for contact with the connector pins to establish electrical communication between the device body and the ISLA.

Abstract: Auto exposure processing for spherical images improves image quality by reducing visible exposure level variation along a stitch line within a spherical image. An average global luminance value is determined based on luminance values determined for first and second images, which are based on auto exposure configurations of first and second image sensors used to obtain those first and second images. Delta luminance values are determined for the first and second images using the average global luminance value. The first and second images are then updated using the delta luminance values, and the updated first and second images are used to produce a spherical image.

Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.

Abstract: An image capture device is disclosed that includes: a body; first and second image capture devices supported within the body so as to define respective, overlapping first and second fields-of-view; and a thermal spreader. The first image capture device includes a first integrated sensor-lens assembly (ISLA) with a first image sensor and a first lens, and the second image capture device includes a second ISLA with a second image sensor and a second lens. The first lens faces in a first direction, and is positioned to receive and direct light onto the first image sensor, and the second lens faces in a second direction, and is positioned to receive and direct light onto the second image sensor, wherein the second direction is generally opposite to the first direction. The thermal spreader extends between, and is connected to, the first and second ISLAs, and is configured to transfer heat therebetween.

Abstract: Video frames of a video may be marked with visual patterns to identify individual video frames. The video may be changed by applying one or more effects to the video. The accuracy with which the changes were made to the video by the effect(s) may be determined using the visual patterns marked on the video frames.

Abstract: A device includes a mechanical stabilization system is used in image signal processing. The mechanical image stabilization system has an operating bandwidth and includes a motor to control an orientation of an image sensor. A processing apparatus of the device determines a temperature of the motor and adjusts a cutoff frequency of the operating bandwidth based on the temperature of the motor.

Abstract: A handheld module including a battery, an electro-mechanical interface, and a display. The electro-mechanical interface is configured to attach the handheld module to an image capture module, wherein when attached to the image capture module, the handheld module forms a communication link to the image capture module via the electro-mechanical interface and supplies power from the battery to the image capture module via conductors of the electro-mechanical interface. The display is configured to present images captured by the image capture module and received from the image capture module via the communication link.

Abstract: An image capture device may capture two hemispherical views of a scene. The two hemispherical view of the scene may be stitched along a stitch line. The image capture device may be rotated to align the stitch line with a mid-line of a panoramic field of view of the scene. Separate exposure settings may be used to capture the two hemispherical views of the scene, with the exposure settings increasing the dynamic range of the scene depicted within the panoramic field of view of the scene. The panoramic field of view of the scene may be punched out as panoramic visual content.

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.

Abstract: Tone mapping for image capture may include accessing a first image detected using an image sensor; accessing an exposure parameter (exposure duration, or time, multiplied by ISO or gain) used to detect the first image; scaling pixel values of the first image by a scale factor inversely proportional to the exposure parameter to obtain a scaled image; determining a scene luminance based on an average of pixel values of the scaled image; determining a target luminance based on the scene luminance; determining a target histogram based on the target luminance; determining a first histogram of luminance values of the first image; determining a transfer function based on the first histogram and the target histogram; applying the transfer function to pixel values of the first image to produce a tone mapped image; and storing or transmitting an output image based on the tone mapped image.

Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.

Abstract: Field variable tone mapping is performed for 360 content. An image capture device includes an image sensor and a processor. The image sensor obtains a hyper-hemispherical image and the processor performs local tone mapping (LTM) on a first area of the hyper-hemispherical image and performs global tone mapping (GTM) on a second area of the hyper-hemispherical image to obtain a processed image. The processor may be configured to display, store, output, or transmit the processed image.

Abstract: Described is an image capture device which provides substantially immediate indications to a user that an image capture device is on after the user has turned on the image capture device. The image capture device can include a processor and a low power processor. The low power processor can perform or initiate multiple substantially parallel processes upon detection of an image capture device power on event. In some implementations, the low power processor can initiate a boot-up process for the processor and a light emitting device (LED) power on process for a LED indicator. In some implementations, the low power processor can initiate a boot-up process for the processor, a LED power on process for a LED indicator, and a battery authentication process for a battery inserted in the image capture device.

Abstract: Systems and methods are disclosed for high dynamic range processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.

Abstract: An image capture device with a housing, a drainage microphone, processor, and drainage channel. The housing defining an audio depression. The drainage microphone coupled to the housing at a location of the audio depression and configured to capture audio. The processor coupled with a memory storing instructions that when executed cause the processor to apply a set of tuned beamforming parameters to the captured audio. The drainage channel within the housing to drain moisture from the drainage microphone. The drainage channel defining a channel entrance having a channel entrance width and a channel entrance height.

Abstract: Disclosed is an electronic gimbal with camera and mounting configuration. The gimbal can include an inertial measurement unit which can sense the orientation of the camera and three electronic motors which can manipulate the orientation of the camera. The gimbal can be removably coupled to a variety of mount platforms, such as an aerial vehicle, a handheld grip, or a rotating platform. Moreover, a camera can be removably coupled to the gimbal and can be held in a removable camera frame. Also disclosed is a system for allowing the platform, to which the gimbal is mounted, to control settings of the camera or to trigger actions on the camera, such as taking a picture, or initiating the recording of a video. The gimbal can also provide a connection between the camera and the mount platform, such that the mount platform receives images and video content from the camera.

Abstract: A graphical user interface may provide presentation of a video edit during video edit playback. The video edit may include a segment of a video. When a user modifies the segment of the video included in the video edit, the graphical user interface may automatically switch the presentation of the video edit into presentation of the original video.