Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Placement of a face depicted within a video may be determined. One or more stabilization options for the video may be obtained. Stabilization option(s) may include angle stabilization option, a position stabilization option, and/or a size stabilization option. The video may be stabilized based on the placement of the face and the stabilization option(s).

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: A video may be presented with a timeline representation of the video. The timeline representation may enable a user to jump to different parts of the video. An action curve for the video may be presented along the timeline representation. The action curve may include values that represent different actions taken/experienced by an image capture device while capturing the video. The action curve may help the user identify/locate different parts of the video.

Abstract: An integrated image sensor and lens assembly is disclosed that includes: an image sensor assembly defining an optical axis; a lens holder; and a lens barrel. The lens holder is coupled to the image sensor assembly and includes a tubular body portion terminating in a tapered surface that extends at an angle to the optical axis. The lens barrel is coupled to the lens holder by an adhesive that is applied between the lens holder and the lens barrel such that the adhesive extends in non-perpendicular relation to the optical axis.

Abstract: An image capture device may capture a video. A part of the video may include depiction of an object of interest, and another part of the video may not include depiction of the object of interest. Stabilization of the video may switch between object stabilization and movement stabilization based on whether or not the video depicts the object of interest. The part of the video depicting the object of interest may be stabilized using object stabilization. The part of the video not depicting the object of interest may be stabilized using movement stabilization.

Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.

Abstract: Video frames of a video may be marked with visual patterns to identify individual video frames. The video may be changed by applying one or more effects to the video. The accuracy with which the changes were made to the video by the effect(s) may be determined using the visual patterns marked on the video frames.

Abstract: An image head with a housing, an integrated sensor and lens assembly (ISLA), a port, and internal componentry. The housing has a front side; a rear side; a top side; and a bottom side. The ISLA extends from the front side and is configured to detect images. The port is located on the rear side that is configured to electrically connect the image head to a base when the image head is inserted into the base. The internal componentry includes: a first microphone located within the front side below the ISLA; a second microphone located within the top side of the housing; a speaker located at the bottom side of the housing; a printed circuit board in communication with the integrated sensor of the ISLA; and a memory located on the printed circuit board and configured to store the images.

Abstract: An apparatus including a body and a wireless communication system. The body partially encloses a camera. The wireless communication system is integrated within or coupled to the body of the apparatus. The wireless communication system includes: a sensor, an antenna, a switching unit, a wireless communication circuit, and a controller. The sensor is configured to determine an orientation of the wireless communication system. The antenna is configured to transmit or receive wireless signals and configured to have an antenna gain and polarization. The switching unit is configured to change a configuration of the antenna gain and polarization. The wireless communication circuit is electrically coupled to the antenna to transmit or receive the wireless signals. The sensor determines the orientation of the wireless communication system related to an external wireless communication system and the switching unit changes the configuration of the antenna gain and polarization.

Abstract: Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

Abstract: A method is provided for controlling a movable imaging assembly having a movable platform and an imaging device coupled to and movable relative to the movable platform. The method includes receiving user inputs that define an MIA position relative to a target and a frame position of the target within image frames captured by the imaging device. The user inputs include a horizontal distance, a circumferential position, and a horizontal distance that define the MIA position, and include a horizontal frame position and a vertical frame position that define the frame position. The method further includes predicting a future position of the target for a future time, and moving the MIA to be in the MIA position at the future time and moving the imaging device for the target to be in the frame position for an image frame captured at the future time.

Abstract: Systems and methods are disclosed for field of view adjustment for image capture devices. For example, methods may include receiving a field of view selection; oversampling, using an image sensor, to obtain an image at a capture resolution that is greater than an encode resolution; determining a crop setting based on the field of view selection; cropping the image using the crop setting to obtain a cropped image; down-scaling the cropped image to obtain a scaled image at the encode resolution; encoding the scaled image at the encode resolution; and storing, displaying, or transmitting an output image based on the scaled image.

Abstract: An automated control system including an unmanned aerial vehicle (UAV) and an input device. The UAV includes: a sensor, a receiver; and memory. The memory includes a task association data including one or more tasks for execution by the UAV. The input device includes a tagging block. The tagging block allows an operator to tag an object of interest and send a tag regarding the object of interest to the UAV, via the receiver, wherein the object of interest is located within a visual field of the UAV. The sensor processes data within the visual field and the input device is configured to communicate the object of interest from the visual field tagged by the operator. The task is selected from the task association data and the UAV executes the task with respect to the object of interest from the visual field.

Abstract: An integrated circuit includes a processor that upsamples a vibration signal. The processor determines a correlation value. The correlation value may be based on a microphone signal, the upsampled vibration signal, or both. The processor filters the vibration signal to remove a noise portion and obtain a processed microphone signal. The processor outputs the processed microphone signal.

Abstract: A method and system for continuously supplying power to an image capture device during an image capture session are disclosed. The image capture device includes an integrated internal battery located internal to the image capture device and a removable battery connected to the image capture device. Power is provided to the image capture device from the removable battery. When the removable battery is disconnected from the image capture device, power is provided to the image capture device from the integrated internal battery. When a new removable battery is connected to the image capture device, power is provided to the image capture device from the new removable battery. Power is continuously supplied to the image capture device from the integrated internal battery while the removable battery is disconnected and replaced with the new removable battery.

Abstract: Flare compensation includes obtaining a dark corner intensity differences profile between a first and a second image based on a relative illumination of an area outside a first image circle of the first image and a second image circle of the second image. The dark corner intensity differences profile is obtained for a luminance (Y) component. A flare profile is obtained using an intensity differences profile and the dark corner intensity differences profile. The intensity differences profile is obtained for the Y component along a stitch line between the first image and the second image. The flare profile of the Y component is converted to an RGB flare profile. The first image is modified based on the RGB flare profile to obtain a processed first image.

Abstract: An image capture device continuously generates time-lapse video frames to be included within a time-lapse video using a dynamic time-lapse video frame rate, with the value of the dynamic time-lapse video frame rate changing based on activation of a trigger to change the dynamic time-lapse video frame rate. The dynamic time-lapse video frame rate alternates between different values.

Abstract: A handheld image stabilization device or an image capture device includes a housing, a motor, a microphone, and a dampener. The housing includes a first port. The motor is attached to the housing. The microphone detects audio waves via the first port and vibration noise of the motor via the housing. The audio waves may include acoustic noise from the motor. The dampener is coupled to the housing. The dampener reduces the acoustic noise from the motor and the vibration noise from the motor.

Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.

Abstract: A camera housing includes a first and second housing portion and a draw latch. The first housing portion includes a monolithic panel base hinge. The second housing portion is pivotally coupled to the first housing portion. The draw latch secures the first and second housing portions to enclose a camera. The draw latch is coupled to the first housing portion and coupleable to the second housing portion. The draw latch includes a draw hook and a mid-linkage. The mid-linkage includes a draw hook hinge end, a draw hook lip end, and first and second segments. The draw hook hinge end rotatably connects to the draw latch. The first segment couples first sides of the draw hook hinge end and the draw hook lip end to one another. The second segment couples the draw hook hinge end and the draw hook lip end together. The mid-linkage is plastic and substantially rigid.

Abstract: In one aspect of the present disclosure, a gimbal assembly is described for use with an image capturing device. The gimbal assembly includes a motor assembly, a first housing defining an internal compartment that is configured and dimensioned to receive the motor assembly, and a second housing that is mechanically connected to the motor assembly such that actuation of the motor assembly causes relative rotation between the first and second housings. The first housing includes a first guide that is configured and dimensioned to support transmission media adapted to communicate electrical and/or digital signals. The second housing defines a channel that is configured and dimensioned to receive the first guide such that the first guide extends into the second housing through the channel. The transmission media is supported on the first guide such that the first guide routes the transmission media from the first housing into the second housing.

Abstract: Image capture devices and methods may be used to pre-buffer media storage. The pre-buffering method includes recording an image capture segment in a circular buffer. The circular buffer includes a number of recordable segments. The pre-buffering method includes determining whether a key moment command is received. If a key moment command is not received, the method includes recording a next image capture segment in a next adjacent recordable segment of the circular buffer if the next adjacent recordable segment of the predetermined number of recordable segments is available. If a key moment command is not received, the method includes overwriting an oldest recordable segment if the next adjacent recordable segment of the predetermined number of recordable segments is not available. If a key moment command is received, the pre-buffering method includes marking a wrap point in the circular buffer and switching from recording in the circular buffer to linear recording.

Abstract: A camera is configured for use with a removable camera lens cover, which can be secured to or removed from the camera by a user without the use of a tool set. The mechanism which allows the lens cover to be secured to and removed from the camera includes a set of wires embedded into the lens cover and a set of wedges protruding from the lens wall of the camera. To secure the lens cover to the camera, the lens cover is placed onto the front of the camera and rotated until the wires align with corresponding wedges, securing the wires underneath the tapered surface of the wedges. To remove the lens cover from the camera, a force is applied outward and normal to the lens cover, causing the wires to flex outward and enabling the rotation and removal of the lens cover from the camera.

Abstract: An image capture device may capture multiple audio content during capture of visual content. A viewing window for the visual content and rotational position of the image capture device during capture of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of a punchout of the visual content using the viewing window.

Abstract: An image capture device, including: a heatsink, an integrated sensor and lens assembly (ISLA), and a battery cage. The heatsink includes a mounting flange. The ISLA extends through the heatsink. The battery cage being in communication with a finger mounting flange of the mounting flange to support the battery cage within the image capture device.

Abstract: A video edit may include one or more segment of a video. A graphical user interface may convey information that indicates video editing decisions made to generate the video edit. The graphical user interface may include a timeline element to represent the length of the video and one or more inclusion elements to visually indicate the segment(s) of the video included in the video edit. The graphical user interface may convey information on the segment(s) of the video that have been automatically included in the video edit and the segment(s) of the video that have been manually included in the video edit.

Abstract: A camera and a smart device are connected when the camera is in a first communication mode. Network credentials that enable connections to the camera in a second communication mode are transmitted from the camera to the smart device. Subsequent to transmitting the network credentials from the camera to the smart device, the camera is configured to operate in the second communication mode. A request to connect the smart device to the camera in the second communication mode is received at the camera and from the smart device. Media captured by the camera are transmitted from the camera to the smart device and using the second communication mode.

Abstract: Auto exposure processing for spherical images improves image quality by reducing visible exposure level variation along a stitch line within a spherical image. An average global luminance value is determined based on auto exposure configurations of first and second image sensors. Delta luminance values are determined for each of the image sensors based on the average global luminance value and a luminance variance between the image sensors. The auto exposure configurations of the image sensors are then updated using the delta luminance values, and the updated auto exposure configurations are used to capture images which are then combined to produce the spherical image. In some cases wherein updating the auto exposure configurations using the delta luminance values would breach a threshold representing a target luminosity for the scene, the use of the delta luminance values may be limited or those values may instead be discarded.

Abstract: A graphical user interface for indicating video editing decisions may include an inclusion marker element, an exclusion marker element, and a selection marker element. The inclusion marker element may indicate a segment of a video that has been marked for inclusion in a video edit. The exclusion marker element may indicate a segment of the video has been marked for exclusion from the video edit. The selection marker element may indicate a segment of the video has been selected for inclusion in the video edit.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. A punchout of the video may provide a framing of the captured scene. The punchout may be determined based on the context of the video, such as the type of captured scene within the video, the motion of the image capture device that captured the video, and/or the motion of one or more things within the captured scene.

Abstract: A media summary is generated to include portions of media items. The portions of media items identified for inclusion in the media summary is determined based on the length of the media summary and classification of content depicted within the media items. Classification of content depicted within the media items includes number of smiles depicted within the media items.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: An image capture device includes a housing and a lens cavity comprising an external lens that separates the lens cavity from an exterior environment. The lens cavity is connected with an inside of the housing. The image capture device includes a door positioned on the housing that opens the inside of the housing to the exterior environment. The image capture device includes a vent positioned on housing so that moisture can be vented from housing and the lens cavity to the exterior environment.

Abstract: Systems, apparatus, and methods for stabilization and blending of exposures. So-called Electronic Image Stabilization (EIS) techniques use image manipulation software to compensate for camera motion. Unfortunately, existing EIS techniques cannot compensate for artifacts introduced by low shutter speed (e.g., blurs). Various embodiments of the present disclosure generate stabilized images from multiple exposures. In one exemplary embodiment, the stabilized exposures are blended using a linear sum of the color data for each pixel of the image. By stabilizing each exposure and linearly summing the light information, the camera shake can be removed, and the subject motion blur can be controlled. The stabilization and blending techniques enable a mathematical emulation of a selected shutter angle from many high-speed exposures.

Abstract: An image capture device includes an image sensor and a heat controller. The image capture device includes a heat spreader that extends between the image sensor and the heat controller. The heat spreader dissipates heat from the image sensor to the heat controller. The image capture device includes an electronics unit spaced from the image sensor. The image capture device includes a compressive insulator that contacts the heat spreader and the electronics unit, and the compressible insulator thermally separates the electronics unit and the heat spreader.

Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.

Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.

Abstract: Image signal processing includes obtaining two or more image signals from a first image sensor, where each of the two or more image signals has a different exposure and obtaining two or more image signals from a second image sensor, where each of the two or more image signals has a different exposure. Image signal processing includes generating an exposure compensated image based on a gain value applied to an exposure level of a first image and a gain value applied to an exposure level of a second image. Image signal processing further includes processing a transformed base layer of the exposure compensated image to obtain a high dynamic range (HDR) image.

Abstract: Video information may define spherical video content having a duration. Spherical video content may define visual content viewable from a point of view as a function of progress through the spherical video content. Path information may define a path selection for the spherical video content. Path selection may include movement of a viewing window within the spherical video content. The viewing window may define extents of the visual content viewable from the point of view as the function of progress through the spherical video content. Time lapse parameter information may define at least two of a time portion of the duration, an image sampling rate, and a time lapse speed effect. A time lapse video may be generated based on the video information, the path information, and the time lapse parameter information.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

Abstract: An image capture device is described that includes a body; a mounting structure that is connected to the body; an integrated sensor-lens assembly (ISLA) that defines an optical axis and extends through the body and the mounting structure; and an accessory that is releasably connectable to the mounting structure via rotation through a range of motion less than approximately 90 degrees. The mounting structure and the accessory include corresponding angled bearing surfaces that are configured for engagement such that rotation of the accessory relative to the mounting structure creates a bearing effect that displaces the accessory along the optical axis to thereby reduce any axial force required during connection and disconnection of the accessory.

Abstract: A gimbal mount system is configured to a couple to a gimbal coupled to and securing a camera. The gimbal mount system includes a handle, a power source, a user interface, a mounting interface, a communication interface, and a communication bus. The mounting interface is located within an end of the gimbal mount system and includes an opening configured to receive a reciprocal mounting protrusion of the gimbal. A locking mechanism removably couples the gimbal to the gimbal mount system. The communication interface is located within the mounting interface and is configured to couple to a reciprocal communication interface of the gimbal. The communication bus is coupled to the power source, user interface, and communication interface and is configured to provide power from the power source to the gimbal. The communication bus may provide instructions to the gimbal based on user input received via the user interface.