Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: A video may be presented with a timeline representation of the video. The timeline representation may enable a user to jump to different parts of the video. An action curve for the video may be presented along the timeline representation. The action curve may include values that represent different actions taken/experienced by an image capture device while capturing the video. The action curve may help the user identify/locate different parts of the video.

Abstract: Systems, apparatus, and methods for piggyback camera calibration. Existing piggybacked capture techniques use a “beauty camera” and an “action camera” to capture raw footage. The user directly applies the EIS stabilization track of a piggybacked action camera to the cinematic footage to create desired stable footage. Unfortunately, since the action camera may have been slightly offset from the cinematic video camera, the EIS stabilization data will only roughly approximate the necessary corrections. In other words, the user must manually fine tune the corrections. The disclosed embodiments use a calibration sequence to estimate a physical offset between the beauty camera and the action camera. Then, the estimated physical offset can be used to calculate an offset camera orientation for stabilizing the beauty camera. The foregoing process can be performed in-the-field before actual capture. This allows the user to check their set-up and fix any issues before capturing the desired footage.

Abstract: Systems, apparatus, and methods for stabilization and blending of exposures. So-called Electronic Image Stabilization (EIS) techniques use image manipulation software to compensate for camera motion. Unfortunately, existing EIS techniques cannot compensate for artifacts introduced by low shutter speed (e.g., blurs). Various embodiments of the present disclosure generate stabilized images from multiple exposures. In one exemplary embodiment, the stabilized exposures are blended using a linear sum of the color data for each pixel of the image. By stabilizing each exposure and linearly summing the light information, the camera shake can be removed, and the scene motion blur can be controlled. The stabilization and blending techniques enable a mathematical emulation of a selected shutter angle from many high-speed exposures.

Abstract: An integrated image sensor and lens assembly is disclosed that includes: an image sensor assembly defining an optical axis; a lens holder; and a lens barrel. The lens holder is coupled to the image sensor assembly and includes a tubular body portion terminating in a tapered surface that extends at an angle to the optical axis. The lens barrel is coupled to the lens holder by an adhesive that is applied between the lens holder and the lens barrel such that the adhesive extends in non-perpendicular relation to the optical axis.

Abstract: Video frames of a video may be marked with visual patterns to identify individual video frames. The video may be changed by applying one or more effects to the video. The accuracy with which the changes were made to the video by the effect(s) may be determined using the visual patterns marked on the video frames.

Abstract: An image capture device may capture a video. A part of the video may include depiction of an object of interest, and another part of the video may not include depiction of the object of interest. Stabilization of the video may switch between object stabilization and movement stabilization based on whether or not the video depicts the object of interest. The part of the video depicting the object of interest may be stabilized using object stabilization. The part of the video not depicting the object of interest may be stabilized using movement stabilization.

Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.

Abstract: Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

Abstract: An image head with a housing, an integrated sensor and lens assembly (ISLA), a port, and internal componentry. The housing has a front side; a rear side; a top side; and a bottom side. The ISLA extends from the front side and is configured to detect images. The port is located on the rear side that is configured to electrically connect the image head to a base when the image head is inserted into the base. The internal componentry includes: a first microphone located within the front side below the ISLA; a second microphone located within the top side of the housing; a speaker located at the bottom side of the housing; a printed circuit board in communication with the integrated sensor of the ISLA; and a memory located on the printed circuit board and configured to store the images.

Abstract: An apparatus including a body and a wireless communication system. The body partially encloses a camera. The wireless communication system is integrated within or coupled to the body of the apparatus. The wireless communication system includes: a sensor, an antenna, a switching unit, a wireless communication circuit, and a controller. The sensor is configured to determine an orientation of the wireless communication system. The antenna is configured to transmit or receive wireless signals and configured to have an antenna gain and polarization. The switching unit is configured to change a configuration of the antenna gain and polarization. The wireless communication circuit is electrically coupled to the antenna to transmit or receive the wireless signals. The sensor determines the orientation of the wireless communication system related to an external wireless communication system and the switching unit changes the configuration of the antenna gain and polarization.

Abstract: Methods and apparatus for shared image processing among multiple devices. In one embodiment, an exemplary action camera performs a partial multiband blend. Even though the action camera may not have resources to handle the multiband blend of the entire action camera's footage, it can do a significant portion. The partially blended content can be used in ready-to-share applications, or completely blended by another device.

Abstract: A method and system for continuously supplying power to an image capture device during an image capture session are disclosed. The image capture device includes an integrated internal battery located internal to the image capture device and a removable battery connected to the image capture device. Power is provided to the image capture device from the removable battery. When the removable battery is disconnected from the image capture device, power is provided to the image capture device from the integrated internal battery. When a new removable battery is connected to the image capture device, power is provided to the image capture device from the new removable battery. Power is continuously supplied to the image capture device from the integrated internal battery while the removable battery is disconnected and replaced with the new removable battery.

Abstract: Systems and methods are disclosed for field of view adjustment for image capture devices. For example, methods may include receiving a field of view selection; oversampling, using an image sensor, to obtain an image at a capture resolution that is greater than an encode resolution; determining a crop setting based on the field of view selection; cropping the image using the crop setting to obtain a cropped image; down-scaling the cropped image to obtain a scaled image at the encode resolution; encoding the scaled image at the encode resolution; and storing, displaying, or transmitting an output image based on the scaled image.

Abstract: An automated control system including an unmanned aerial vehicle (UAV) and an input device. The UAV includes: a sensor, a receiver; and memory. The memory includes a task association data including one or more tasks for execution by the UAV. The input device includes a tagging block. The tagging block allows an operator to tag an object of interest and send a tag regarding the object of interest to the UAV, via the receiver, wherein the object of interest is located within a visual field of the UAV. The sensor processes data within the visual field and the input device is configured to communicate the object of interest from the visual field tagged by the operator. The task is selected from the task association data and the UAV executes the task with respect to the object of interest from the visual field.

Abstract: An integrated circuit includes a processor that upsamples a vibration signal. The processor determines a correlation value. The correlation value may be based on a microphone signal, the upsampled vibration signal, or both. The processor filters the vibration signal to remove a noise portion and obtain a processed microphone signal. The processor outputs the processed microphone signal.

Abstract: A method is provided for controlling a movable imaging assembly having a movable platform and an imaging device coupled to and movable relative to the movable platform. The method includes receiving user inputs that define an MIA position relative to a target and a frame position of the target within image frames captured by the imaging device. The user inputs include a horizontal distance, a circumferential position, and a horizontal distance that define the MIA position, and include a horizontal frame position and a vertical frame position that define the frame position. The method further includes predicting a future position of the target for a future time, and moving the MIA to be in the MIA position at the future time and moving the imaging device for the target to be in the frame position for an image frame captured at the future time.

Abstract: Flare compensation includes obtaining a dark corner intensity differences profile between a first and a second image based on a relative illumination of an area outside a first image circle of the first image and a second image circle of the second image. The dark corner intensity differences profile is obtained for a luminance (Y) component. A flare profile is obtained using an intensity differences profile and the dark corner intensity differences profile. The intensity differences profile is obtained for the Y component along a stitch line between the first image and the second image. The flare profile of the Y component is converted to an RGB flare profile. The first image is modified based on the RGB flare profile to obtain a processed first image.

Abstract: An image capture device continuously generates time-lapse video frames to be included within a time-lapse video using a dynamic time-lapse video frame rate, with the value of the dynamic time-lapse video frame rate changing based on activation of a trigger to change the dynamic time-lapse video frame rate. The dynamic time-lapse video frame rate alternates between different values.

Abstract: A handheld image stabilization device or an image capture device includes a housing, a motor, a microphone, and a dampener. The housing includes a first port. The motor is attached to the housing. The microphone detects audio waves via the first port and vibration noise of the motor via the housing. The audio waves may include acoustic noise from the motor. The dampener is coupled to the housing. The dampener reduces the acoustic noise from the motor and the vibration noise from the motor.

Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.

Abstract: In one aspect of the present disclosure, a gimbal assembly is described for use with an image capturing device. The gimbal assembly includes a motor assembly, a first housing defining an internal compartment that is configured and dimensioned to receive the motor assembly, and a second housing that is mechanically connected to the motor assembly such that actuation of the motor assembly causes relative rotation between the first and second housings. The first housing includes a first guide that is configured and dimensioned to support transmission media adapted to communicate electrical and/or digital signals. The second housing defines a channel that is configured and dimensioned to receive the first guide such that the first guide extends into the second housing through the channel. The transmission media is supported on the first guide such that the first guide routes the transmission media from the first housing into the second housing.

Abstract: A camera is configured for use with a removable camera lens cover, which can be secured to or removed from the camera by a user without the use of a tool set. The mechanism which allows the lens cover to be secured to and removed from the camera includes a set of wires embedded into the lens cover and a set of wedges protruding from the lens wall of the camera. To secure the lens cover to the camera, the lens cover is placed onto the front of the camera and rotated until the wires align with corresponding wedges, securing the wires underneath the tapered surface of the wedges. To remove the lens cover from the camera, a force is applied outward and normal to the lens cover, causing the wires to flex outward and enabling the rotation and removal of the lens cover from the camera.

Abstract: Image capture devices and methods may be used to pre-buffer media storage. The pre-buffering method includes recording an image capture segment in a circular buffer. The circular buffer includes a number of recordable segments. The pre-buffering method includes determining whether a key moment command is received. If a key moment command is not received, the method includes recording a next image capture segment in a next adjacent recordable segment of the circular buffer if the next adjacent recordable segment of the predetermined number of recordable segments is available. If a key moment command is not received, the method includes overwriting an oldest recordable segment if the next adjacent recordable segment of the predetermined number of recordable segments is not available. If a key moment command is received, the pre-buffering method includes marking a wrap point in the circular buffer and switching from recording in the circular buffer to linear recording.

Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.

Abstract: A camera housing includes a first and second housing portion and a draw latch. The first housing portion includes a monolithic panel base hinge. The second housing portion is pivotally coupled to the first housing portion. The draw latch secures the first and second housing portions to enclose a camera. The draw latch is coupled to the first housing portion and coupleable to the second housing portion. The draw latch includes a draw hook and a mid-linkage. The mid-linkage includes a draw hook hinge end, a draw hook lip end, and first and second segments. The draw hook hinge end rotatably connects to the draw latch. The first segment couples first sides of the draw hook hinge end and the draw hook lip end to one another. The second segment couples the draw hook hinge end and the draw hook lip end together. The mid-linkage is plastic and substantially rigid.

Abstract: An image capture device may capture multiple audio content during capture of visual content. A viewing window for the visual content and rotational position of the image capture device during capture of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of a punchout of the visual content using the viewing window.

Abstract: An image capture device, including: a heatsink, an integrated sensor and lens assembly (ISLA), and a battery cage. The heatsink includes a mounting flange. The ISLA extends through the heatsink. The battery cage being in communication with a finger mounting flange of the mounting flange to support the battery cage within the image capture device.

Abstract: A video edit may include one or more segment of a video. A graphical user interface may convey information that indicates video editing decisions made to generate the video edit. The graphical user interface may include a timeline element to represent the length of the video and one or more inclusion elements to visually indicate the segment(s) of the video included in the video edit. The graphical user interface may convey information on the segment(s) of the video that have been automatically included in the video edit and the segment(s) of the video that have been manually included in the video edit.

Abstract: A camera and a smart device are connected when the camera is in a first communication mode. Network credentials that enable connections to the camera in a second communication mode are transmitted from the camera to the smart device. Subsequent to transmitting the network credentials from the camera to the smart device, the camera is configured to operate in the second communication mode. A request to connect the smart device to the camera in the second communication mode is received at the camera and from the smart device. Media captured by the camera are transmitted from the camera to the smart device and using the second communication mode.

Abstract: Auto exposure processing for spherical images improves image quality by reducing visible exposure level variation along a stitch line within a spherical image. An average global luminance value is determined based on auto exposure configurations of first and second image sensors. Delta luminance values are determined for each of the image sensors based on the average global luminance value and a luminance variance between the image sensors. The auto exposure configurations of the image sensors are then updated using the delta luminance values, and the updated auto exposure configurations are used to capture images which are then combined to produce the spherical image. In some cases wherein updating the auto exposure configurations using the delta luminance values would breach a threshold representing a target luminosity for the scene, the use of the delta luminance values may be limited or those values may instead be discarded.

Abstract: Systems, apparatus, and methods for motion transfer between different media. Two videos shot simultaneously are combined with aspects of each used to produce a higher-resolution frame interpolated video than would otherwise be possible by the devices alone. The interpolated video may be used in slow motion footage, a higher frame rate (e.g., virtual reality) application, or to add a realistic motion blur effect in post-processing (rather than in capture). A post-processing device may receive high-speed video from a high-speed camera and a low-speed video from a low-speed camera. The post-processing device may use motion data from the high-speed video to interpolate frames of (high-resolution) low-speed video producing low-speed interpolated video.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. A punchout of the video may provide a framing of the captured scene. The punchout may be determined based on the context of the video, such as the type of captured scene within the video, the motion of the image capture device that captured the video, and/or the motion of one or more things within the captured scene.

Abstract: An image capture device includes a housing and a lens cavity comprising an external lens that separates the lens cavity from an exterior environment. The lens cavity is connected with an inside of the housing. The image capture device includes a door positioned on the housing that opens the inside of the housing to the exterior environment. The image capture device includes a vent positioned on housing so that moisture can be vented from housing and the lens cavity to the exterior environment.

Abstract: A graphical user interface for indicating video editing decisions may include an inclusion marker element, an exclusion marker element, and a selection marker element. The inclusion marker element may indicate a segment of a video that has been marked for inclusion in a video edit. The exclusion marker element may indicate a segment of the video has been marked for exclusion from the video edit. The selection marker element may indicate a segment of the video has been selected for inclusion in the video edit.

Abstract: A media summary is generated to include portions of media items. The portions of media items identified for inclusion in the media summary is determined based on the length of the media summary and classification of content depicted within the media items. Classification of content depicted within the media items includes number of smiles depicted within the media items.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: Systems, apparatus, and methods for stabilization and blending of exposures. So-called Electronic Image Stabilization (EIS) techniques use image manipulation software to compensate for camera motion. Unfortunately, existing EIS techniques cannot compensate for artifacts introduced by low shutter speed (e.g., blurs). Various embodiments of the present disclosure generate stabilized images from multiple exposures. In one exemplary embodiment, the stabilized exposures are blended using a linear sum of the color data for each pixel of the image. By stabilizing each exposure and linearly summing the light information, the camera shake can be removed, and the subject motion blur can be controlled. The stabilization and blending techniques enable a mathematical emulation of a selected shutter angle from many high-speed exposures.

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

Abstract: An image capture device includes an image sensor and a heat controller. The image capture device includes a heat spreader that extends between the image sensor and the heat controller. The heat spreader dissipates heat from the image sensor to the heat controller. The image capture device includes an electronics unit spaced from the image sensor. The image capture device includes a compressive insulator that contacts the heat spreader and the electronics unit, and the compressible insulator thermally separates the electronics unit and the heat spreader.

Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.

Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.

Abstract: A method includes determining an altitude of a camera of an aerial vehicle, determining a field of view (FOV) of a camera, generating a localized map, determining a relative position of the aerial vehicle on the localized map, and determining a relative heading of the aerial vehicle.

Abstract: A gimbal mount system is configured to a couple to a gimbal coupled to and securing a camera. The gimbal mount system includes a handle, a power source, a user interface, a mounting interface, a communication interface, and a communication bus. The mounting interface is located within an end of the gimbal mount system and includes an opening configured to receive a reciprocal mounting protrusion of the gimbal. A locking mechanism removably couples the gimbal to the gimbal mount system. The communication interface is located within the mounting interface and is configured to couple to a reciprocal communication interface of the gimbal. The communication bus is coupled to the power source, user interface, and communication interface and is configured to provide power from the power source to the gimbal. The communication bus may provide instructions to the gimbal based on user input received via the user interface.