Abstract: An image capture device may experience motion while capturing a video. A video clip may be generated from the video. The beginning of the video clip may be identified based on acceleration of the image capture device during capture of the video, while the ending of the video clip may be identified based on speed of the image capture device during capture of the video.

Abstract: This disclosure describes a method of controlling an unmanned aerial vehicle (UAV). The steps of controlling include acquiring images with an image capture device of an unmanned aerial vehicle (UAV). The steps include analyzing the images to determine navigation information of the UAV with a vision-based navigation system. The steps include tracking a position of the UAV with the vision-based navigation system. The steps include controlling rotors of the UAV to prevent deviations in movement from a desired flight path or position of the UAV. The steps include limiting travel or flight of the UAV to a physical region determined by the desired flight path.

Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.

Abstract: In one aspect of the present disclosure, a digital image capturing device (DICD) is described that includes a first integrated sensor-lens assembly (ISLA) defining a first optical axis and facing in a first direction; a second ISLA defining a second optical axis offset from the first optical axis and facing in a second direction generally opposite the first direction (i.e., such that the second ISLA is rotated approximately 180 from the first ISLA); and a bridge member that is positioned between the first and second ISLAs to fixedly secure together the first and second ISLAs. The bridge member is configured as a discrete structure (i.e., as being separate from both the first ISLA and the second ISLA), and defines a longitudinal axis that is generally parallel in relation to the first and second optical axes.

Abstract: Apparatus and methods for enabling indexing and playback of media content before the end of a content capture. In one aspect, a method for enabling indexing of media data obtained as part of a content capture is disclosed. In one embodiment, the indexing enables playback of the media data during the capture and before cessation thereof. In one variant, the method includes generating an “SOS track” for one or more images. The SOS track does not contain the same information as a full index, but provides sufficient information to allow an index to be subsequently constructed. In one implementation, the provided information includes identifiable markers relating to video data, audio data, or white space, but it does not provide an enumerated or complete “table of contents” as in a traditional index.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.

Abstract: Music may be selected to provide accompaniment for a video edit of a video. Characteristics of the music may be determined and used to select the types of visual effects that are applied in the video edit. The characteristics of the music may be extracted from MIDI file/metadata track containing MIDI information for the music.

Abstract: A mounting system for an image capture device that includes three pivotably connected arms is disclosed. The first arm includes a first fastener that is lockable and unlockable to allow for connection and disconnection of the image capture device, and a second fastener that is lockable and unlockable to regulate the position of the image capture device relative to the first arm. The mounting system further includes a third fastener that is lockable and unlockable to regulate the relative positioning between the first arm and the second arm, and a fourth fastener that is lockable and unlockable to regulate the relative positioning between the second arm and the third arm. Whereas the first fastener is removable, each of the second, third, and fourth fasteners is captive to (nonremovable from) the mounting system.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: Lens mode auto-detection includes obtaining predicate lens mode data, obtaining probable lens mode data, obtaining a lens mode score in accordance with the predicate lens mode data and the probable lens mode data, determining whether the lens mode score is greater than a defined lens mode change threshold, and, in response to determining that the lens mode score is greater than the defined lens mode change threshold, outputting lens mode data.

Abstract: An image is processed using a combination of techniques, particularly, in which low frequency information is processed using multiple tone control and high frequency information is processed using local tone mapping. An image is divided into a plurality of blocks including a given block. Low frequency information and high frequency information of the given block are separated. The low frequency information is processed using multiple tone control. The high frequency information is processed using local tone mapping. A processed image is then produced based on the processed low frequency information and based on the processed high frequency information, the processed image corresponding to the image captured using the image sensor. The processed image is then output for storage or display. Processing the low frequency information can include using a gain curve and bilinear interpolation. Processing the high frequency information can include using an edge preservation filter.

Abstract: Target value detection for an unmanned aerial vehicle is described. The unmanned aerial vehicle includes a first transducer that transmits a first ultrasonic signal and receives a first ultrasonic response and a second transducer that transmits a second ultrasonic signal and receives a second ultrasonic response. The second transducer has a wider beam pattern than the first transducer. Determinations are made as to whether either or both of the first or second ultrasonic responses includes a target value within range areas associated with the respective beam patterns of the first and second transducers. A confidence value is generated based on the determinations. The target value is reflected from an object and the confidence value indicates a likelihood of a position of the unmanned aerial vehicle with respect to the object.

Abstract: An image capture device includes a mechanical stabilization system is used in image signal processing. The mechanical image stabilization system has an operating bandwidth and includes a motor to control an orientation of an image sensor. A processing apparatus of the image capture device determines a temperature of the motor and adjusts a cutoff frequency of the operating bandwidth based on the temperature of the motor.

Abstract: Disclosed is a configuration of an autonomous vehicle for autonomously following a moving subject based on a radius of a virtual sphere surrounding the autonomous vehicle. The autonomous vehicle may be an unmanned ground vehicle or an unmanned aerial vehicle, which autonomously follows the subject (e.g., a device, a live entity, or any object) based on the virtual sphere. The radius of the virtual sphere may be dynamically configured according to a velocity of the autonomous vehicle or configurations of a camera coupled to the autonomous vehicle. Accordingly, the autonomous vehicle can follow the subject along a smooth trajectory, and capture images of abrupt movements of the subject in a cinematically pleasing manner.

Abstract: A gimbal sleeve for connecting to a camera gimbal may float between a floor surface and a ceiling surface of an aerial vehicle chassis such that the gimbal sleeve has freedom of motion in yaw, pitch, and roll directions relative to the vehicle chassis. The gimbal sleeve may comprise a pair of connection points to the lower dampers on a floor surface of the vehicle chassis. The gimbal sleeve may furthermore comprise a ball joint coupled to a back surface of the vehicle chassis. The connection points include spring forces that enable the gimbal sleeve to return to an equilibrium position in response to external vibrations and reduce the magnitude of vibrations transferred from the aerial vehicle to the gimbal and camera systems.

Abstract: Image analysis and processing may include a first sensor readout unit receiving first Bayer format image data corresponding to a first input image, a second sensor readout unit receiving second Bayer format image data corresponding to a second input image, a first Bayer-to-RGB unit obtaining first RGB format image data based on the first Bayer format image data, a second Bayer-to-RGB unit obtaining second RGB format image data based on the second Bayer format image data, a high dynamic range unit configured obtaining high dynamic range image data based on a combination of the first RGB format image data and the second RGB format image data, an RGB-to-YUV unit obtaining YUV format image data based on the high dynamic range image data, and a three-dimensional noise reduction unit obtaining processed image data based on the YUV format image data.

Abstract: An aerial vehicle comprises one or more sensors to environmental data, a communication system to receive control inputs from a user, two or more actuators, with each actuator coupled to a rotary wing. The aerial vehicle also comprises a controller to determine a mode of the aerial vehicle based on the environmental data and the control inputs, each mode indicating a set of flight characteristics for the aerial vehicle, generate a gain value based on the mode, the gain value, when used to modify power signals transmitted to actuators of the aerial vehicle, causes the aerial vehicle to conform within the indicated flight characteristics of the determined mode, generate an output signal modified by the gain value based on the input signal, and transmit a power signal based on the output signal to each actuator of the aerial vehicle.

Abstract: An image capture device includes an image sensor and a processor. The image sensor is configured to capture a first plurality of frames, a second plurality of frames, and a third plurality of frames. The processor includes a first denoising layer and a second denoising layer. The first denoising layer includes a first denoiser, a second denoiser, and a third denoiser. The first denoiser is configured to denoise the first plurality of frames and output a first denoised frame. The second denoiser is configured to denoise the second plurality of frames and output a second denoised frame. The third denoiser is configured to denoise the third plurality of frames and output a third denoised frame. The second denoising layer includes a fourth denoiser. The fourth denoiser is configured to output a denoised frame based on the first denoised frame, the second denoised frame, and the third denoised frame.

Abstract: Disclosed is a configuration to control automatic return of an aerial vehicle. The configuration stores a return location in a storage device of the aerial vehicle. The return location may correspond to a location where the aerial vehicle is to return. One or more sensors of the aerial vehicle are monitored during flight for detection of a predefined condition. When a predetermined condition is met a return path program may be loaded for execution to provide a return flight path for the aerial vehicle to automatically navigate to the return location.

Abstract: Features to be enabled for an image capture device may be determined based on user subscription to a feature plan and/or user usage of the image capture device. The features for the image capture device may be enabled through firmware update or code unlock.

Abstract: Adaptive acquisition control includes obtaining a processed image by an image capture apparatus, which includes, a target exposure component that obtains a target exposure value in accordance with target exposure input data, an aggregate gain component that obtains a target aggregate gain value and a remaining gain value in accordance with aggregate gain input data, an auto-exposure compensation component that obtains an auto-exposure compensation tone curve in accordance with auto-exposure compensation input data, a contrast control component that obtains a contrast control tone curve and a contrast control black point value, and a tone control driver that obtains a tone control tone curve and a tone control black point value, and an image signal processor that processes the current input image in accordance with the tone control tone curve and the tone control black point value to produce the processed image.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Placement of a face depicted within a video may be determined. One or more stabilization options for the video may be obtained. Stabilization option(s) may include angle stabilization option, a position stabilization option, and/or a size stabilization option. The video may be stabilized based on the placement of the face and the stabilization option(s).

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: A video may be presented with a timeline representation of the video. The timeline representation may enable a user to jump to different parts of the video. An action curve for the video may be presented along the timeline representation. The action curve may include values that represent different actions taken/experienced by an image capture device while capturing the video. The action curve may help the user identify/locate different parts of the video.

Abstract: An integrated image sensor and lens assembly is disclosed that includes: an image sensor assembly defining an optical axis; a lens holder; and a lens barrel. The lens holder is coupled to the image sensor assembly and includes a tubular body portion terminating in a tapered surface that extends at an angle to the optical axis. The lens barrel is coupled to the lens holder by an adhesive that is applied between the lens holder and the lens barrel such that the adhesive extends in non-perpendicular relation to the optical axis.

Abstract: An image capture device may capture a video. A part of the video may include depiction of an object of interest, and another part of the video may not include depiction of the object of interest. Stabilization of the video may switch between object stabilization and movement stabilization based on whether or not the video depicts the object of interest. The part of the video depicting the object of interest may be stabilized using object stabilization. The part of the video not depicting the object of interest may be stabilized using movement stabilization.

Abstract: Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.

Abstract: Video frames of a video may be marked with visual patterns to identify individual video frames. The video may be changed by applying one or more effects to the video. The accuracy with which the changes were made to the video by the effect(s) may be determined using the visual patterns marked on the video frames.

Abstract: An image head with a housing, an integrated sensor and lens assembly (ISLA), a port, and internal componentry. The housing has a front side; a rear side; a top side; and a bottom side. The ISLA extends from the front side and is configured to detect images. The port is located on the rear side that is configured to electrically connect the image head to a base when the image head is inserted into the base. The internal componentry includes: a first microphone located within the front side below the ISLA; a second microphone located within the top side of the housing; a speaker located at the bottom side of the housing; a printed circuit board in communication with the integrated sensor of the ISLA; and a memory located on the printed circuit board and configured to store the images.

Abstract: An apparatus including a body and a wireless communication system. The body partially encloses a camera. The wireless communication system is integrated within or coupled to the body of the apparatus. The wireless communication system includes: a sensor, an antenna, a switching unit, a wireless communication circuit, and a controller. The sensor is configured to determine an orientation of the wireless communication system. The antenna is configured to transmit or receive wireless signals and configured to have an antenna gain and polarization. The switching unit is configured to change a configuration of the antenna gain and polarization. The wireless communication circuit is electrically coupled to the antenna to transmit or receive the wireless signals. The sensor determines the orientation of the wireless communication system related to an external wireless communication system and the switching unit changes the configuration of the antenna gain and polarization.

Abstract: Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

Abstract: A method is provided for controlling a movable imaging assembly having a movable platform and an imaging device coupled to and movable relative to the movable platform. The method includes receiving user inputs that define an MIA position relative to a target and a frame position of the target within image frames captured by the imaging device. The user inputs include a horizontal distance, a circumferential position, and a horizontal distance that define the MIA position, and include a horizontal frame position and a vertical frame position that define the frame position. The method further includes predicting a future position of the target for a future time, and moving the MIA to be in the MIA position at the future time and moving the imaging device for the target to be in the frame position for an image frame captured at the future time.

Abstract: Systems and methods are disclosed for field of view adjustment for image capture devices. For example, methods may include receiving a field of view selection; oversampling, using an image sensor, to obtain an image at a capture resolution that is greater than an encode resolution; determining a crop setting based on the field of view selection; cropping the image using the crop setting to obtain a cropped image; down-scaling the cropped image to obtain a scaled image at the encode resolution; encoding the scaled image at the encode resolution; and storing, displaying, or transmitting an output image based on the scaled image.

Abstract: An automated control system including an unmanned aerial vehicle (UAV) and an input device. The UAV includes: a sensor, a receiver; and memory. The memory includes a task association data including one or more tasks for execution by the UAV. The input device includes a tagging block. The tagging block allows an operator to tag an object of interest and send a tag regarding the object of interest to the UAV, via the receiver, wherein the object of interest is located within a visual field of the UAV. The sensor processes data within the visual field and the input device is configured to communicate the object of interest from the visual field tagged by the operator. The task is selected from the task association data and the UAV executes the task with respect to the object of interest from the visual field.