Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

Abstract: An image capture device includes a processor for wind noise processing. The processor receives signals from a first microphone, a first plurality of microphones, and a second plurality of microphones. The processor may segment each signal into low frequency bins and high frequency bins. The processor may select a minimum level signal bin for each low frequency bin. For the high frequency bins, the processor may select a minimum level signal bin for a first group of microphones or a second group of microphones. The processor may generate a composite signal by combining the selected minimum level signal bins for each low frequency bin and the selected minimum level signal bins for each high frequency bin.

Abstract: Disclosed is a system and method for reducing the total latency for transferring a frame from the low latency camera system mounted on an aerial vehicle to the display of the remote controller. The method includes reducing the latency through each of the modules of the system, i.e. through a camera module, an encoder module, a wireless interface transmission, wireless interface receiver module, a decoder module and a display module. To reduce the latency across the modules, methods such as overclocking the image processor, pipelining the frame, squashing the processed frame, using a fast hardware encoder that can perform slice based encoding, tuning the wireless medium using queue sizing, queue flushing, bitrate feedback, physical medium rate feedback, dynamic encoder parameter tuning and wireless radio parameter adjustment, using a fast hardware decoder that can perform slice based decoding and overclocking the display module are used.

Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.

Abstract: A method is disclosed for improving the quality of photographs taken in low-light conditions by adjustment of shutter speed and digital gain based on a shutter prioritization value. Using a network of sensor, a digital camera processes various parameters, such as luminance of the scene and movement of the camera or of subjects within the scene, to compute a shutter prioritization value. The value is then used to select the most appropriate shutter speed and digital gain combination from a constant exposure curve. Higher prioritization values correspond to faster shutter speeds and higher digital gain. Lower prioritization values correspond to lower shutter speeds and lower digital gain. In further embodiments, the shutter prioritization value may be manually customized by a user in order to produce artistic effects.

Abstract: The position of a UAV within a three-dimensional space is changed based on a change in position of a controller of the UAV. First and second sensor data are produced using sensors of the controller to maintain stable altitude output for the UAV. The first sensor data indicates a geolocation of the controller, and the second sensor data indicates a barometric pressure of an environment in which the controller is located. The first and second sensor data are post-processed using a complementary filter based on respective altitude measurements of the first and second sensor data to determine an altitude of the controller. A position of the controller is determined within a three-dimensional space based on the altitude. Data indicative of the position of the controller within the three-dimensional space is then transmitted to the UAV to cause a change in a position of the UAV within the three-dimensional space.

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: The disclosure describes systems and methods for a stabilization mechanism. The stabilization mechanism may be used in conjunction with an imaging device. The method may be performed by a control system of the stabilization mechanism and includes obtaining a device setting from an imaging device. The method may also include obtaining a configuration of the stabilization mechanism. The method includes determining a soft stop based on the device setting, the configuration, or both. The soft stop may be a virtual hard stop that indicates to the stabilization mechanism to reduce speed as a field of view of the imaging device approaches the soft stop. The method may also include setting an image stabilization mechanism parameter based on the determined soft stop.

Abstract: A processor of a camera for capturing a time-lapse is configured to acquire a first frame of the time-lapse; calculate an exposure setting for a second frame of the time-lapse; and acquire the second frame of the time-lapse using the exposure setting. The exposure setting prevents a flickering effect in the time-lapse. The exposure setting is determined using one or more preview images that are previewed in a time gap between the first frame and the second frame.

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Abstract: A method and apparatus for night lapse video capture are disclosed. The apparatus includes an image sensor, an image processor, and a video encoder. The image sensor is configured to capture image data. The image data includes a first image that is temporally precedent to a second image. The image processor is configured to determine a motion estimation. The motion estimation is based on a comparison of a portion of the first image and a portion of the second image. The image processor is configured to subtract a mask from the second image to obtain a denoised image. The mask is based on the motion estimation. The video encoder is configured to receive the denoised image from the image processor. The video encoder is configured to encode the denoised image in a video format. The video encoder is configured to output a video file in the video format.

Abstract: Vehicles such as unmanned air vehicles that are capable of movement from an open, flight configuration to an enclosed configuration in which all major flight components can be protected by an outer shell are disclosed. In the enclosed configuration, the vehicles can take on standard geometric shapes such as a rectangular prism, sphere, cylinder, or another shape, so as to not be recognizable as an unmanned air vehicle. Embodiments of vehicles can also include interchangeable and/or wireless motor arms, motor arms which are electrically connected to the remainder of the vehicle only when in an open configuration, remote controllers removably attached to the remainder of the vehicle, and clip or other attachment mechanisms for attachment to objects such as backpacks.

Abstract: Apparatus and methods for encrypting captured media. In one embodiment, the method includes capturing media data via use of a lens of an image capture apparatus; obtaining a number used only once (NONCE) value from the captured media data; obtaining an encryption key for use in encryption of the captured media data; using the obtained NONCE value and the obtained encryption key for encrypting the captured media data; and storing the encrypted media data. In some variants, the media is encrypted prior to storage, thereby obviating any instances in which the captured media data resides in a wholly unencrypted instance. Apparatus and methods for decrypting encrypted captured media are also disclosed.

Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

Abstract: An image capture device may automatically capture images. An image sensor may generate visual content based on light that becomes incident thereon. A depiction of interest within the visual content may be identified, and one or more images may be generated to include one or more portions of the visual content including the depiction of interest.

Abstract: An image capture device may capture visual content during a capture duration. The context of capture of the visual content by the image capture device may be assessed and used to determine values of stabilization parameters for the visual content.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: Multiple video segments may be obtained from a repository of video segments. A selection of a video segment from the multiple video segments may be received. The selected video segment may be presented at a first resolution via a display. A selection of a point in time during presentation of the video segment may be received to extract a frame set from the video segment at or near the selected point in time. The frame set may include multiple frames, including one frame corresponding to the selected point in time, and other frames that correspond to points in time adjacent to the selected point in time. A selection of a single frame within the frame set may be received. The single frame may be received having a second resolution. The second resolution may be higher than the first resolution. The single frame may be presented via the display.

Abstract: Spherical video content may be presented on a display. The spherical video content may include an event of interest occurring within an event field of view during an event moment. Interaction information may be received during the presentation of the spherical content on the display. The interaction information may indicate a user's viewing selections of the spherical video content. Display fields of view may be determined based on the user's viewing selections. Relative positions of the event field of view with respect to the display fields of view may be determined. Progress differences between the event moment and moments corresponding to the display fields of view may be determined. A visual indicator graphically displaying the relative positions and the progress differences may be presented on the display.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: A method, system, and non-transitory computer-readable storage medium for temporal information synchronization of imaging devices are disclosed. The method comprises capturing media using an imaging device, generating a sequence identifier for each of the media, generating a timestamp for each of the media, determining that at least one of the media includes an unknown time tag, receiving an input including temporal information, determining a time offset between each timestamp and the temporal information, and updating the timestamp for each of the media that includes an unknown time tag using the time offset to provide an updated timestamp.

Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitate the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: Positions of an image capture device may be used to estimate a time-lapse video frame rate with which time-lapse video frames are generated. The time-lapse video frame rate may be adjusted based on apparent motion between pairs of generated time-lapse video frames. The adjusted time-lapse video frame rate may be used to generate additional time-lapse video frames.

Abstract: Implementations are directed to providing a digital media editing environment for editing at least a portion of a digital video using a mobile device, establishing communication between the mobile device and a data source, receiving, from the data source, a first portion of the digital video, the first portion including a first set of frames including less than all frames of the digital video, applying an edit to the first portion of the digital video, while less than all frames of the first digital video are stored on the mobile device, subsequent to applying the at least one edit, receiving, from the data source, a second portion of the digital video, the second portion including a second set of frames, and storing an edited digital video including at least one frame of the first set of frames, at least one frame of the second set of frames, and the edit.

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

Abstract: An image capture system and methods for auto-recording media data are herein disclosed. A method includes selecting an activity-specific monitor based on an activity type and capturing data. The activity-specific monitor defines one or more auto-recording conditions that, when satisfied, cause the image capture system to record data. The method includes executing the activity-specific monitor. The activity-specific monitor may receive sensor data, determine whether the one or more auto-recording conditions defined by the activity-specific monitor are met, and output a notification indicating that the one or more auto-recording conditions are met. The method further includes writing a portion of the data captured to the persistent storage of the image capture system.

Abstract: An integrated image sensor and lens assembly comprises a lens barrel holding camera lenses coupled to a lens mount. The lens mount is further coupled to an image sensor substrate that has an image sensor lying on an image plane. The optical distance between lenses and the image sensor is tuned such that the focal plane of the lenses coincides with the image plane. Due to thermal expansion, this optical distance may vary thereby to cause the focal plane of the lenses to shift away from the image plane. The integrated image sensor and lens assembly further comprises spacers that couple one or more lens elements to the lens barrel. The spacers and the lens elements are configured such that the optical distance is maintained to be constant or substantially constant.

Abstract: A camera mount comprising: a sliding mount component comprising: a sliding base; protrusions protruding outward from a bottom surface of the sliding base; and a sliding mount component locking mechanism; and a rail mount component comprising: a rail base; and a rail mount component locking mechanism; wherein the sliding mount component is configured for insertion into the rail mount component, and wherein the sliding mount component is connected to the rail mount component by the sliding mount component locking mechanism forming a connection with the rail mount component locking mechanism.

Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions.

Abstract: Systems and methods for controlling an unmanned aerial vehicle are disclosed. The system comprises an image sensor configured to generate output signals conveying visual information, the visual information including one or more images of a user, and one or more physical processors. The one or more physical processors are configured by computer-readable instructions to recognize one or more gestures from the user based on the visual information, interpret the one or more gestures from the user as flight control information, and provide flight control for the unmanned aerial vehicle based on the flight control information.

Abstract: An audio capture device selects between multiple microphones to generate an output audio signal depending on detected conditions. When the presence of wind noise or other uncorrelated noise is detected, the audio capture device selects, for each of a plurality of different frequency sub-bands, an audio signal having the lowest noise and combines the selected frequency sub-bands signals to generate an output audio signal. When wind noise or other uncorrelated noise is not detected, the audio capture device determines whether each of a plurality of microphones are wet or dry and selects one or more audio signals from the microphones depending on their respective conditions.

Abstract: A camera housing includes a first housing portion having a cavity to receive a camera and a second housing portion comprising a removable door to secure the camera in the cavity. The first housing portion includes a first fastening structure and a first hinge structure. The second housing portion includes a second fastening structure and a second hinge structure. The second hinge structure couples to the first hinge structure to form a hinge about which the removable door rotates. The second housing portion and the first housing portion enclose the cavity to secure the camera when the removable door is rotated into a closed position and the first fastening structure is coupled to the second fastening structure.

Abstract: A controller system of an aerial vehicle may receive environmental data from one or more sensors of the aerial vehicle and adjusts limits of the aerial vehicle given the environmental conditions. When the aerial vehicle receives an input, such as a flight input from a remote controller or an environmental input such as a gust of wind, the controller system calculates appropriate motor inputs that are provided to the thrust motors of the aerial vehicle such that the adjusted limits of the aerial vehicle are not exceeded. In calculating the appropriate input to the thrust motors, the controller system performs an iterative process. For example, for a given maximum torque that can be applied to the thrust motors, the controller system iteratively allocates the torque such that torque components that are important for the stability of the aerial are first fulfilled, whereas subsequent torque components may be fulfilled or scaled back.

Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.

Abstract: A noise cancelation system for an unmanned aerial vehicle may have an audio capture module, a metadata module and a filter. The audio capture module may be configured to receive an audio signal captured from a microphone, e.g., on a camera. The metadata module may be configured to retrieve noise information associated with noise generating components operating on the unmanned aerial vehicle (UAV). The filter may be configured to receive the audio signal and noise information from the audio capture module. The filter also may be configured to retrieve a baseline profile from a database based on the noise information. The baseline profile includes noise parameter to filter out audio frequencies from the audio signal corresponding to the noise generating component. The filter may generate a filtered audio signal for output.

Abstract: Systems and methods are disclosed for dual imaging module cameras. For example, methods may include: receiving a zoom control signal, receiving an input image that was captured using a first lens assembly of a dual imaging module, and determining, based on the zoom control signal, an intermediate lens distortion profile. The intermediate lens distortion profile has values that are between corresponding values of a first lens distortion profile for the first lens assembly and a second lens distortion profile for a second lens assembly of the dual imaging module. The method may include applying a warp based on the intermediate lens distortion profile to the input image to obtain an output image and transmitting, storing, or displaying an image based on the output image. For example, the systems and methods may eliminate or mitigate discontinuities in lens distortion at a switch-over between lens assemblies of a dual imaging module.

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

Abstract: Multiple image capture devices may individually generate time information and capture images. Individual image captures devices may receive time information of other image capture device(s). Individual image capture devices may transmit its time information to other image capture device(s) independent of reception of the time information of other image capture device(s). Individual image capture devices may generate time synchronization information for the captured images based on its time information and the received time information of other image capture device(s). Images captured by different image capture devices may be time-synchronized based on at least one of generated time-synchronization information.