Abstract: Methods and systems for detecting and monitoring memory card performance characteristics. A method for detecting memory card performance characteristics includes obtaining at least one memory card performance characteristic from a memory card when the memory card is inserted in an image capture device, determining whether the at least one memory card performance characteristic meets a defined image capture device requirement, and providing an alert when the at least one memory card performance characteristic fails to match the defined image capture device requirement.

Abstract: An image capture device detects a wind whistle using two or more microphones. The image capture device includes a processor that obtains microphone signals from the two or more microphones and measures coherence values between the microphone signals across a frequency band. The frequency band includes frequency bins, and the processor measures a coherence value for each frequency bin. Based on a detection of an elevated coherence value in a frequency bin, the processor determines the presence of a whistle. The processor attenuates the frequency bin based on a determination that the elevated coherence value is above a threshold.

Abstract: An image capture device including a bayonet, an integrated sensor and lens assembly (ISLA), and fasteners. The bayonet includes a mounting flange that connects the bayonet to a first surface the image capture device, a central portion, and connection recesses located within the central portion. The ISLA includes: a forward end that aligns with the connection recesses; a rearward end; internal lenses located within the ISLA and being aligned along an optical axis; and an integrated sensor connected to the rearward end and located along the optical axis. The fasteners extending through the central portion into the forward end of the lens assembly to connect the ISLA to the bayonet.

Abstract: Ultrasonic ranging state management for a UAV is described. A transducer transmits an ultrasonic signal and receives an ultrasonic response thereto using a gain value. A noise floor estimation mechanism determines a noise floor estimate. A state mechanism sets an ultrasonic ranging state used by the transducer to a first ultrasonic ranging state. The transducer transmits an ultrasonic signal and responsively receive an ultrasonic response to the ultrasonic signal using a gain value according to the noise floor estimate. The state mechanism processes the ultrasonic response to determine whether to determine a new noise floor estimate, adjust the gain value used by the transducer, or change the ultrasonic ranging state of the UAV to a second ultrasonic ranging state. The configurations of the first and second ultrasonic ranging states differ as to, for example, power and gain levels used by the transducer to receive ultrasonic responses.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.

Abstract: An aerial vehicle, comprising: one or more motors, one or more sensors, and a flight sub-system. The one or more sensors configured to detect data. The flight sub-system includes an attitude controller module; a rate controller module; and a compensator module. The compensator module is configured to: determine a maximum RPM of the one or more motors or a maximum torque of the one or more motors; receive a torque vector from the rate controller module; determine a rotational speed of the one or more motors to generate a desired flight orientation based upon the torque vector; and consider sensor data from the one or more sensors to adjust the rotational speed of the one or more motors.

Abstract: An image capture device may include an optical element through which visual content is captured. The image capture device may detect presence of a drop of liquid on the optical element during capture of the visual content. The image capture device may effectuate removal of the drop of liquid from the optical element.

Abstract: Systems and methods are disclosed for high dynamic range anti-ghosting and fusion. For example, methods may include receiving images from image sensors in a linear domain, each image having different exposures or gains, blending luminance values at each pixel from each of the images to generate a blended image, selecting an useful image based on degree of useful information for a pixel, calculating a distance value from the images for the pixel, locating from a look-up table (LUT) an anti-ghosting weight using the useful image and the distance value for the pixel, proportionally applying the located anti-ghosting weight to the pixel for each of the input images to generate an output image, all being performed in the linear domain, and storing, displaying, or transmitting the output image based on at least the anti-ghosting weight.

Abstract: A video edit may include two videos arranged in a sequence. Motion within the one or both of the videos may be assessed. A transition effect may be selected based on the motion assessed within the video(s), and the video edit may be modified to include the transition effect between the videos. The transition effect may emphasize the motion assessed within the video(s) and/or create continuity of motion during transition between the two videos within the video edit.

Abstract: Multiple single lens distortion regions and one or more boundary regions may be determined within an image. Individual single lens distortion regions may have pixel displacement defined by a single lens distortion and individual boundary regions may have pixel displacement defined by a blend of at least two lens distortions. Multiple lens distortions may be simulated within the image by shifting pixels of the image input positions to output positions based on locations of pixels within a single lens distortion region and the corresponding single lens distortion or within a boundary region and a blend of corresponding lens distortions.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.

Abstract: An image capture device may experience motion while capturing a video. A video clip may be generated from the video. The beginning of the video clip may be identified based on acceleration of the image capture device during capture of the video, while the ending of the video clip may be identified based on speed of the image capture device during capture of the video.

Abstract: Visual content that includes spatial portions is obtained. A determination is made that one of the spatial portions includes a face. Based on the determination, encoding quality parameters for the one of the spatial portions is identified. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions The visual content is encoded. The encoding quality parameters are stored, in association with but separate from, the one of the spatial portions. After decoding, the one of the spatial portions are rendered based on the encoding quality parameters. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.

Abstract: Apparatus and methods for enabling indexing and playback of media content before the end of a content capture. In one aspect, a method for enabling indexing of media data obtained as part of a content capture is disclosed. In one embodiment, the indexing enables playback of the media data during the capture and before cessation thereof. In one variant, the method includes generating an “SOS track” for one or more images. The SOS track does not contain the same information as a full index, but provides sufficient information to allow an index to be subsequently constructed. In one implementation, the provided information includes identifiable markers relating to video data, audio data, or white space, but it does not provide an enumerated or complete “table of contents” as in a traditional index.

Abstract: In one aspect of the present disclosure, a digital image capturing device (DICD) is described that includes a first integrated sensor-lens assembly (ISLA) defining a first optical axis and facing in a first direction; a second ISLA defining a second optical axis offset from the first optical axis and facing in a second direction generally opposite the first direction (i.e., such that the second ISLA is rotated approximately 180 from the first ISLA); and a bridge member that is positioned between the first and second ISLAs to fixedly secure together the first and second ISLAs. The bridge member is configured as a discrete structure (i.e., as being separate from both the first ISLA and the second ISLA), and defines a longitudinal axis that is generally parallel in relation to the first and second optical axes.

Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.

Abstract: This disclosure describes a method of controlling an unmanned aerial vehicle (UAV). The steps of controlling include acquiring images with an image capture device of an unmanned aerial vehicle (UAV). The steps include analyzing the images to determine navigation information of the UAV with a vision-based navigation system. The steps include tracking a position of the UAV with the vision-based navigation system. The steps include controlling rotors of the UAV to prevent deviations in movement from a desired flight path or position of the UAV. The steps include limiting travel or flight of the UAV to a physical region determined by the desired flight path.

Abstract: Music may be selected to provide accompaniment for a video edit of a video. Characteristics of the music may be determined and used to select the types of visual effects that are applied in the video edit. The characteristics of the music may be extracted from MIDI file/metadata track containing MIDI information for the music.

Abstract: A mounting system for an image capture device that includes three pivotably connected arms is disclosed. The first arm includes a first fastener that is lockable and unlockable to allow for connection and disconnection of the image capture device, and a second fastener that is lockable and unlockable to regulate the position of the image capture device relative to the first arm. The mounting system further includes a third fastener that is lockable and unlockable to regulate the relative positioning between the first arm and the second arm, and a fourth fastener that is lockable and unlockable to regulate the relative positioning between the second arm and the third arm. Whereas the first fastener is removable, each of the second, third, and fourth fasteners is captive to (nonremovable from) the mounting system.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: An image is processed using a combination of techniques, particularly, in which low frequency information is processed using multiple tone control and high frequency information is processed using local tone mapping. An image is divided into a plurality of blocks including a given block. Low frequency information and high frequency information of the given block are separated. The low frequency information is processed using multiple tone control. The high frequency information is processed using local tone mapping. A processed image is then produced based on the processed low frequency information and based on the processed high frequency information, the processed image corresponding to the image captured using the image sensor. The processed image is then output for storage or display. Processing the low frequency information can include using a gain curve and bilinear interpolation. Processing the high frequency information can include using an edge preservation filter.

Abstract: Lens mode auto-detection includes obtaining predicate lens mode data, obtaining probable lens mode data, obtaining a lens mode score in accordance with the predicate lens mode data and the probable lens mode data, determining whether the lens mode score is greater than a defined lens mode change threshold, and, in response to determining that the lens mode score is greater than the defined lens mode change threshold, outputting lens mode data.

Abstract: Target value detection for an unmanned aerial vehicle is described. The unmanned aerial vehicle includes a first transducer that transmits a first ultrasonic signal and receives a first ultrasonic response and a second transducer that transmits a second ultrasonic signal and receives a second ultrasonic response. The second transducer has a wider beam pattern than the first transducer. Determinations are made as to whether either or both of the first or second ultrasonic responses includes a target value within range areas associated with the respective beam patterns of the first and second transducers. A confidence value is generated based on the determinations. The target value is reflected from an object and the confidence value indicates a likelihood of a position of the unmanned aerial vehicle with respect to the object.

Abstract: Disclosed is a configuration of an autonomous vehicle for autonomously following a moving subject based on a radius of a virtual sphere surrounding the autonomous vehicle. The autonomous vehicle may be an unmanned ground vehicle or an unmanned aerial vehicle, which autonomously follows the subject (e.g., a device, a live entity, or any object) based on the virtual sphere. The radius of the virtual sphere may be dynamically configured according to a velocity of the autonomous vehicle or configurations of a camera coupled to the autonomous vehicle. Accordingly, the autonomous vehicle can follow the subject along a smooth trajectory, and capture images of abrupt movements of the subject in a cinematically pleasing manner.

Abstract: An image capture device includes a mechanical stabilization system is used in image signal processing. The mechanical image stabilization system has an operating bandwidth and includes a motor to control an orientation of an image sensor. A processing apparatus of the image capture device determines a temperature of the motor and adjusts a cutoff frequency of the operating bandwidth based on the temperature of the motor.

Abstract: A gimbal sleeve for connecting to a camera gimbal may float between a floor surface and a ceiling surface of an aerial vehicle chassis such that the gimbal sleeve has freedom of motion in yaw, pitch, and roll directions relative to the vehicle chassis. The gimbal sleeve may comprise a pair of connection points to the lower dampers on a floor surface of the vehicle chassis. The gimbal sleeve may furthermore comprise a ball joint coupled to a back surface of the vehicle chassis. The connection points include spring forces that enable the gimbal sleeve to return to an equilibrium position in response to external vibrations and reduce the magnitude of vibrations transferred from the aerial vehicle to the gimbal and camera systems.

Abstract: Image analysis and processing may include a first sensor readout unit receiving first Bayer format image data corresponding to a first input image, a second sensor readout unit receiving second Bayer format image data corresponding to a second input image, a first Bayer-to-RGB unit obtaining first RGB format image data based on the first Bayer format image data, a second Bayer-to-RGB unit obtaining second RGB format image data based on the second Bayer format image data, a high dynamic range unit configured obtaining high dynamic range image data based on a combination of the first RGB format image data and the second RGB format image data, an RGB-to-YUV unit obtaining YUV format image data based on the high dynamic range image data, and a three-dimensional noise reduction unit obtaining processed image data based on the YUV format image data.

Abstract: Modular lens assemblies and mounting systems are disclosed. A modular lens assembly includes a removable portion and a fixed portion. The removable portion includes a first lens stack configured to produce a near-collimated ray path or a collimated ray path. The fixed portion includes a second lens stack configured to receive the near-collimated ray path or the collimated ray path from the removable portion. The modular lens assembly may be implemented in an image capture device. An image sensor of the image capture device is positioned at an end of the modular lens assembly. The image sensor is configured to capture images based on light incident on the image sensor through the first lens stack and the second lens stack such that the light incident on an outer lens of the first lens stack is refracted through the second lens stack to the image sensor.

Abstract: A camera housing includes a first surface and a second surface noncoplanar with the first surface. A first interconnect mechanism is coupled to the first surface and rotatable between a collapsed position and an extended position. In the collapsed position, protrusions of the first interconnect mechanism extend parallel to the first surface. In the extended position, the protrusions of the first interconnect mechanism extend in a perpendicular manner away from the first surface. A second interconnect mechanism is coupled to the second surface and rotatable between a collapsed position and an extended position. In the collapsed position, protrusions of the second interconnect mechanism include coplanar surfaces and extend adjacent to the second surface. In the extended position, the protrusions of the second interconnect mechanism extend in a perpendicular manner away from the second surface.

Abstract: An aerial vehicle comprises one or more sensors to environmental data, a communication system to receive control inputs from a user, two or more actuators, with each actuator coupled to a rotary wing. The aerial vehicle also comprises a controller to determine a mode of the aerial vehicle based on the environmental data and the control inputs, each mode indicating a set of flight characteristics for the aerial vehicle, generate a gain value based on the mode, the gain value, when used to modify power signals transmitted to actuators of the aerial vehicle, causes the aerial vehicle to conform within the indicated flight characteristics of the determined mode, generate an output signal modified by the gain value based on the input signal, and transmit a power signal based on the output signal to each actuator of the aerial vehicle.

Abstract: Adaptive acquisition control includes obtaining a processed image by an image capture apparatus, which includes, a target exposure component that obtains a target exposure value in accordance with target exposure input data, an aggregate gain component that obtains a target aggregate gain value and a remaining gain value in accordance with aggregate gain input data, an auto-exposure compensation component that obtains an auto-exposure compensation tone curve in accordance with auto-exposure compensation input data, a contrast control component that obtains a contrast control tone curve and a contrast control black point value, and a tone control driver that obtains a tone control tone curve and a tone control black point value, and an image signal processor that processes the current input image in accordance with the tone control tone curve and the tone control black point value to produce the processed image.

Abstract: An image capture device includes an image sensor and a processor. The image sensor is configured to capture a first plurality of frames, a second plurality of frames, and a third plurality of frames. The processor includes a first denoising layer and a second denoising layer. The first denoising layer includes a first denoiser, a second denoiser, and a third denoiser. The first denoiser is configured to denoise the first plurality of frames and output a first denoised frame. The second denoiser is configured to denoise the second plurality of frames and output a second denoised frame. The third denoiser is configured to denoise the third plurality of frames and output a third denoised frame. The second denoising layer includes a fourth denoiser. The fourth denoiser is configured to output a denoised frame based on the first denoised frame, the second denoised frame, and the third denoised frame.

Abstract: Disclosed is a configuration to control automatic return of an aerial vehicle. The configuration stores a return location in a storage device of the aerial vehicle. The return location may correspond to a location where the aerial vehicle is to return. One or more sensors of the aerial vehicle are monitored during flight for detection of a predefined condition. When a predetermined condition is met a return path program may be loaded for execution to provide a return flight path for the aerial vehicle to automatically navigate to the return location.