Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

Abstract: Scene-based automatic white balance correction may be performed by obtaining an input image. A histogram may be computed from an image thumbnail. The scene-based automatic white balance correction may include classifying a scene. The scene-based automatic white balance correction may include learning a first filter and a second filter. The first filter and the second filter may be learned from one or several different instances of the raw image thumbnail, the augmented image thumbnail, the scene classification, or any combination thereof. The scene-based automatic white balance correction may include applying the filter to the histogram to determine white balance correction coefficients and obtain a processed image.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.). In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: An image capture device may analyze visual content to determine a smile aggregation value. The smile aggregation value satisfying a smile aggregation criterion may indicate that people depicted in the visual content are smiling. When the smile aggregation value satisfies the smile aggregation criterion, the capture of visual content may be started. When the smile aggregation value fails to satisfy the smile aggregation criterion, the capture of visual content may be stopped.

Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.

Abstract: An image capture device may capture visual content with an optical element having a field of view. The location of the image capture device, the direction of north with respect to the image capture device, and rotation of the image capture device may be used to determine location of celestial pole with respect to the field of view. A graphical user interface may be presented on an electronic display. The graphical user interface may indicate the location of the celestial pole within the field of view.

Abstract: An image capture device includes a first housing, a second housing, a first integrated sensor-lens assembly (ISLA), and a second ISLA. The second housing is coupled to the first housing to form an internal compartment. The first ISLA includes a first image sensor coupled to a first lens in fixed alignment. The second ISLA includes a second image sensor coupled to a second lens in fixed alignment. The first ISLA is positively statically connected to the first housing, and the second ISLA is coupled to the first housing indirectly via the first ISLA.

Abstract: A camera with image and audio capture capabilities is configured to protect the internal audio components from the external environment. The camera includes a housing that allows passage of sound waves via a port from an external area of the camera to an internal area of the camera. The camera includes a circuit board with an opening and a microphone attached to a first surface of the circuit board adjacent to the opening. The camera includes a compressible spacer attached to a second surface of the circuit board. The second surface of the circuit board may be diametrically opposite to the first surface. The camera includes a waterproof membrane between the housing and the compressible spacer.

Abstract: A pipeline in a controller may be configured to interface between sensors and actuators. The pipeline may elements such as drivers, filters, a combine, estimators, controllers, a mixer, and actuator controllers. The drivers may receive sensor data and pre-process the received sensor data. The filters may filter the pre-processed sensor data to generate filtered sensor data. The combine may package the filtered sensor data to generate packaged sensor data. The estimators may determine estimates of a position of a vehicle based on the packaged sensor data. The controllers may generate control signals based on the determined estimates. The mixer may modify the generated control signals based on limitations of the vehicle. The actuator controllers may generate actuator control signals based on the modified control signals to drive the actuators.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor, detecting, in a linear domain, color fringing areas in the image, correcting detected color fringing areas to obtain a corrected image, performing tone mapping to the corrected image to obtain a tone mapped image and storing, displaying, or transmitting an output image based on at least the tone mapped image.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: An image capture device includes a housing and a heatsink that forms an integral portion of the housing and draws heat from a heat generating component of the heatsink. The image capture device includes a circuit board enclosed by the housing and comprising a chip. The image capture device includes a gasket that connects the heatsink and the circuit board. The gasket encloses sides of the chip and the heatsink encloses a top of the chip so that electromagnetic interference does not affect other components of the image capture device.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. Different field of view punchouts, such as wide field of view punchout and linear field of view punchout, may be used to stabilize the video. Different field of view punchouts may provide different stabilization margins to stabilize the video. The video may be stabilized by switching between different field of view punchouts based on the amount of stabilization margin needed to stabilize the video.

Abstract: A image capture device including: heat generating devices, one or more batteries, and a sensor heat spreader. The heat generating devices generate a thermal load. The sensor heat spreader is in thermal communication with one or more of the heat generating devices and extends from the one or more of the heat generating devices to the one or more batteries so that all or a portion of the thermal load is transferred to the one or more batteries.

Abstract: An image capture device includes a housing having a pattern of apertures and a membrane assembly. The membrane assembly includes a support that has internal and external surfaces and a channel that aligns with at least one aperture of the pattern of apertures and extends between the internal and external surfaces. The membrane assembly includes indents that are adjacent to the channel, aligned with the pattern of apertures, and disposed on the external surface. The indents have a depth that is less than a depth of the channel.

Abstract: An image capture device is disclosed that includes a body defining a peripheral cavity and a door assembly that is movable between an open position and a closed position to close and seal the peripheral cavity. The door assembly includes a door body; a slider that is supported by the door body for axial movement between a first position and a second position; a biasing member that is configured for engagement (contact) with the slider; a door lock including a stop that is configured for engagement (contact) with the biasing member; and a sealing member that is fixedly connected to the door lock.

Abstract: Multiple punchouts of a video may be presented based on multiple viewing windows. The video may include visual content having a field of view. Multiple viewing windows may be determined for the video, with individual viewing window defining a set of extents of the visual content. Different punchouts of the visual content may be presented based on the different viewing windows. Individual punchout of the visual content may include the set of extents of the visual content defined by corresponding viewing window.

Abstract: An image capture device is disclosed that includes a body defining a peripheral cavity and a removable door assembly that is configured to close and seal the peripheral cavity. The door assembly includes a door body; a locking mechanism; and a biasing member that is configured for engagement with the locking mechanism to resist unlocking of the locking mechanism until a threshold force is applied, at which time, the biasing member is moved from a normal position, in which the biasing member extends at a first angle in relation to the locking mechanism, to a deflected position, in which the biasing member extends at a second angle in relation to the locking mechanism. When locked, the door assembly is rotationally fixed in relation to the body of the image capture device, and when unlocked, the door assembly is rotatable in relation to the body of the image capture device.

Abstract: In one aspect of the present disclosure, a module is disclosed for use with a digital image capturing device (DICD) including an integrated sensor-lens assembly (ISLA). The module includes a cradle configured for connection to a housing of the DICD, and at least one dampener that is configured for positioning between the module and the housing of the DICD to reduce vibrations transmitted to the ISLA.

Abstract: An image capture device with beamforming for wind noise optimized microphone placements is described. The image capture device includes a front facing microphone configured to capture an audio signal. The front facing microphone co-located with at least one optical component. The image capture device further includes at least one non-front facing microphone configured to capture an audio signal. The image capture device further includes a processor configured to generate a forward facing beam using the audio signal captured by the front facing microphone and the audio signal captured by the at least one non-front facing microphone, generate an omni beam using the audio signal captured by the at least one non-front facing microphone, and output an audio signal based on the forward facing beam and the omni beam.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include, based on a sequence of orientation estimates for an image sensor and an orientation setpoint, invoking a mechanical stabilization system to adjust an orientation of the image sensor toward the orientation setpoint; receiving an image from the image sensor; determining an orientation error between the orientation of the image sensor and the orientation setpoint during capture of the image; and, based on the orientation error, invoking an electronic image stabilization module to correct the image for a rotation corresponding to the orientation error to obtain a stabilized image.

Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.

Abstract: Multiple sets of framing for a video may define different positioning of multiple viewing windows for a video. The multiple viewing windows may be used to provide different punchouts of the video within a graphical user interface. The graphical user interface may enable creation/change in the sets of framing for the video. The graphical user interface for the punchouts may include a single timeline representation for the video. Framing indicators that represent different sets of framing for the video may be presented along the single timeline representation at different times.

Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: Systems, apparatus, and methods for “fast” wake-up using virtualized addresses. Action cameras need to conserve power most of the time, but also be immediately responsive to catch action when it happens. Unfortunately, most general-purpose operating systems (e.g., Linux-based) lock up the processor during boot-up. Empirically, an OS boot process might take between 6-7 seconds from start to finish, even in highly streamlined boot sequences. This is undesirable, especially where one device (e.g., a smart phone) triggers an action camera to capture an image. Various embodiments of the present disclosure create “virtual action addresses” that directly expose interrupts as addressable space (via a Bluetooth Low Energy (BLE) network). In one such example, the interrupts trigger a capture or other action. The action camera can immediately service the interrupts with its real-time operating system (RTOS) while the general-purpose OS is booting up.

Abstract: Methods and apparatus for blending unknown pixels in overlapping images. In one embodiment, an action camera captures two hyper-hemispherical fisheye images that are stitched to a 360° panorama. In order to remove exposure differences between the two cameras, the images are pre-processed prior to multiband blending. The pre-processing leverages image information from pixels to make informed guesses about pixels that were not captured. In particular, various pixels with different knowability (e.g., known, unknown, consistent, and conflicting) may be handled differently so as to emphasize/de-emphasize their importance in pre-processing.

Abstract: An image capture device with dynamic wind noise compression tuning techniques is described. A technique includes detecting of the presence of wind noise by measuring coherence between at least two microphones. For a compressor, adjusting a default compression threshold and default compression parameters based on the coherence measurements. For each microphone, applying by the compressor the adjusted compression parameters when an audio signal is above the adjusted compression threshold and applying the default compression parameters when the audio signal is below the adjusted compression threshold.

Abstract: An image capture device may be physically connected to a computing device using a data cable. The image capture device may masquerade as an ethernet card to the computing device over the physical connection. The image capture device may communicate with the computing device over the physical connection using a wireless communication protocol.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: A system including an image capture module and a handheld module. The image capture module includes a body; an image sensor; and a mechanical stabilization system comprising a first gimbal, a second gimbal, and a third gimbal connected to the body and configured to control an orientation of the image sensor of the image capture module relative to the body. The handheld module defines a slot that is keyed to the body of the image capture module. The image capture module, when located within the handheld module, has a low profile so that the third gimbal is protected from damage by the handheld module.

Abstract: Controlling an unmanned aerial vehicle to traverse a portion of an operational environment of the unmanned aerial vehicle may include obtaining an object detection type, obtaining object detection input data, obtaining relative object orientation data based on the object detection type and the object detection input data, and performing an object avoidance operation based on the relative object orientation data. The object detection type may be monocular object detection, which may include obtaining the relative object orientation data by obtaining motion data indicating a change of spatial location for the unmanned aerial vehicle between obtaining the first image and obtaining the second image based on searching along epipolar lines to obtain optical flow data.

Abstract: A camera expansion device includes a housing and a power supply within the housing. The power supply is configured to power an imaging device. The camera expansion device includes a securing structure extending from the housing for securing the housing to a separate mounting device and an interface configured to facilitate power transfer between the camera expansion device and the imaging device.

Abstract: An image capture system includes an image capture device and an integrated sensor-optical component accessory. The integrated sensor-optical component accessory includes at least one of a microphone, a processor, a motion sensor, or an audio sensor. The image capture device configured to control operation of the integrated sensor-optical component accessory with the image capture device when the integrated sensor-optical component accessory is releasably attached to the image capturing device. The image capture device may include a user interface configurable for operation with the integrated sensor-optical component accessory and the image capture device. The integrated sensor-optical component accessory may draw power from the image capture device. The integrated sensor-optical component accessory may include a power supply.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: An image capture device is disclosed that includes a body defining a peripheral cavity and a removable door assembly that is configured to close and seal the peripheral cavity. The door assembly includes a door body; a locking mechanism; and a biasing member that is configured for engagement with the locking mechanism to resist unlocking of the locking mechanism until a threshold force is applied, at which time, the biasing member is moved from a normal position, in which the biasing member extends at a first angle in relation to the locking mechanism, to a deflected position, in which the biasing member extends at a second angle in relation to the locking mechanism. When locked, the door assembly is rotationally fixed in relation to the body of the image capture device, and when unlocked, the door assembly is rotatable in relation to the body of the image capture device.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: A graphical user interface may switch between presentation of a timeline representation of media items and a tile representation of media items. The timeline representation may include graphical representation of the lengths of the media items. The tile representation may include graphical representation of the content of the media items.

Abstract: An image capture device may capture media items (e.g., images, videos, sound clips). An identifier of a mobile device of a user transmitted to the image capture device when the mobile device is in proximity of the image capture device may be used to identify media items that may include and/or be of interest to the user of the mobile device. An identifier and time of the image capture device transmitted to a mobile device of a user when the image capture device is in proximity of the mobile device may be used to identify media items that may include and/or be of interest to the user of the mobile device.

Abstract: After a command to stop recording a video is received, an image capture device may buffer footage in a buffer memory. The buffer memory may be used as a post-capture cache. The footage buffered in the buffer memory may be appended to the end of previously captured footage, appended to the beginning of subsequently captured footage, and/or used to bridge two separately captured footage.

Abstract: A capture setting for one or more image capture devices may be determined. The capture setting may define one or more aspects of operation for the image capture device(s). The aspect(s) of operation for the image capture device(s) may include one or more aspects of operation for a processor of the image capture device(s), an image sensor of the image capture device(s), and/or an optical element of the image capture device(s). A machine-readable optical code may be generated based on the capture setting and/or other information. The machine-readable optical code may convey the capture setting for the image capture device(s) such that a first image capture device capturing a first image including the machine-readable optical code may: (1) identify the machine-readable optical code within the first image; (2) determine the capture setting conveyed by the machine-readable optical code; and (3) operate in accordance with the capture setting.

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

Abstract: The present disclosure relates to a visual communication system for a helmet comprising: an array of light emitting devices arranged inside the helmet in a manner such that light emitted by the light emitting device is visible by a user of the helmet; a data communication interface arranged to receive situational related data from one or more sources; and a processing module arranged to process the situational related data and generate a light signal providing driving or riding guidance to the user of the helmet.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.