Abstract: Systems, apparatus, and methods for encoding telemetry data as audio waveforms. Action cameras may be used to capture telemetry data, which in some applications, may be more useful than its audio/visual media capture. For example, a user may desire the “look-and-feel” of one camera but would like to use the telemetry track information from an action camera. In so-called “piggybacking” operation, the user may rigidly affix the two cameras and use the video track with the telemetry track in post-processing. Unfortunately, time-aligning the two tracks can result in relative drift over time. Various embodiments of the present disclosure transfer telemetry data as data-over-audio. The data-over-audio may be sampled according to the recipient device and recorded at capture. Subsequent post-processing may be performed with the time-aligned tracks.

Abstract: A system with an integrated internal battery, a removable battery, and a power management integrated circuit. The power management integrated circuit is configured to provide power to the image capture device from the removable battery; provide power to the image capture device from the integrated internal battery when the removable battery is disconnected from the image capture device or the removable battery does not have a sufficient charge to drive the image capture device; and recharge the integrated internal battery before the removable battery until the integrated internal battery has a sufficient charge to power the image capture device. The power is continuously supplied to the image capture device from the integrated internal battery while the removable battery is disconnected from the image capture device or does not have sufficient power to drive the image capture device.

Abstract: An image capture device may capture visual content based on a time-lapse video frame rate. Audio content may be captured along with the visual content based on the time-lapse video frame rate being a target time-lapse video frame rate. Capture of the audio content may be stopped based on the time-lapse video frame rate being different from the target time-lapse video frame rate.

Abstract: An image capture device reduces noise floor using multiple microphones. The image capture device includes a processor that obtains a front microphone signal from a front microphone, the front microphone signal having a noisy noise floor portion, obtains a rear microphone signal from a rear microphone, sets a splice point based on mitigation of the noisy noise floor portion relative to a speech frequency range, and combines a substantially clean noise floor portion of the rear microphone signal at or below the splice point with a remaining portion of the front microphone signal above the splice point to generate a microphone signal.

Abstract: A constraint model that includes a representation of feasible viewing window placement within a source field of view of visual content may be generated by using a roll-pitch-yaw axes representation of viewing window placement and having a diagonal dimension of the viewing window that fit within vertical and horizonal dimensions of the source field of view. The constraint model may enable full horizon leveling of the visual content.

Abstract: A video may be captured by an image capture device. A stabilized view of the video may be generated by using a punchout of the video. The shape and/or size of the punchout may be dynamically changed based on stabilization performance of the video. The shape and/or size of the punchout may be changed when the punchout is moving within the video. The shape and/or size of the punchout may not be changed when the punchout is not moving within the video.

Abstract: Video frames are captured by an image capture device and stabilized to generate stabilized video frames. Multiple stabilized video frames are combined into single motion blurred video frames. Combination of multiple stabilized video frames into single motion blurred video frames produces motion blur within the single motion blurred video frames that is both physical and real.

Abstract: A playback of a video may be generated to include accompaniment of music. For parts of the video that includes voice, an instrumental version of the music may be used. For parts of the video that does not include voice, a singing version of the music may be used.

Abstract: Wind processing performance is improved by the placement of one or more microphones on a device. The device includes one or more microphones on the front surface, one or more microphones on the top surface, and one or more microphones on the rear surface. The rear surface is a heatsink, and the one or more microphones on the rear surface are located in recesses created by two or more fins of the heatsink. The device includes a processor that performs wind processing based on signals from the one or more microphones on the front surface, signals from the one or more microphones on the top surface, signals from the one or more microphones on the rear surface, or any combination thereof.

Abstract: The lens attachment includes a body that overlays a lens of an image capture device and one or more lights integrated with the body that emits light in a direction so that the light is not directed into the lens of the image capture device. The lens attachment includes a connector integrated with the body that secures the lens attachment against a housing of the image capture device.

Abstract: A camera system with six faces and a front housing is configured to capture images and audio content from external the camera body. The camera system includes an interior audio assembly protected from external environments by a waterproof membrane. The camera system includes drainage ports on the bottom face and the left face of the camera system to encourage moisture to drain from the system. A first drainage channel couples the internal audio assembly to the first drainage port on left face of the camera system and a second drainage channel couples the drainage port on the left face of the camera system to the drainage port on the bottom face of the camera system. A third drainage channel exists between the front face of the camera system and the front housing, the third drainage channel coupling the first and second drainage channels.

Abstract: Image captured through a non-rectilinear lens may exhibit distortions. The distortions may be reduced by warping the image. However, warping the image may degrade the fidelity of the image. The warped image may be enhanced to increase the fidelity of the image. The enhancement may be applied to the portions of the image that were degraded from the warping.

Abstract: Systems, apparatus, and methods for selectively parsing a live stream for a connected device. GoPro® cameras capture 2 video streams for every recording: a main resolution video (MRV) and a frame aligned low-resolution video (LRV). Currently, the LRV is streamed to other devices for playback in real-time. Unfortunately, not all devices in the mobile ecosystem can keep up with these transfer and playback speeds of the LRV; thus, exemplary embodiments of the present disclosure pick frames from the LRV to provide an IDR-only version that can be replayed with minimal processing burden. As a related issue, operating codecs in parallel at different resolutions can result in misaligned frame structures since each codec independently determines its “group of pictures” (GOP), etc. The described techniques define a frame correspondence that can also be used to improve post-processing at best effort.

Abstract: A limited input device, such as a camera, is authenticated based on a request received from an authenticated application. The camera provides an authorization code to the authenticated application and receives an access token. The access token is associated with a user account. The access token is received based on a verification of the authorization code. The camera transmits one or more images associated with the user account to the first device based on the verification.

Abstract: Systems, apparatus, and methods for motion transfer between different media. Two videos shot simultaneously are combined with aspects of each used to produce a higher-resolution frame interpolated video than would otherwise be possible by the devices alone. The interpolated video may be used in slow motion footage, a higher frame rate (e.g., virtual reality) application, or to add a realistic motion blur effect in post-processing (rather than in capture). A post-processing device may receive high-speed video from a high-speed camera and a low-speed video from a low-speed camera. The post-processing device may use motion data from the high-speed video to interpolate frames of (high-resolution) low-speed video producing low-speed interpolated video.

Abstract: Methods and apparatus for blending unknown pixels in overlapping images. In one embodiment, an action camera captures two hyper-hemispherical fisheye images that are stitched to a 360° panorama. In order to remove exposure differences between the two cameras, the images are pre-processed prior to multiband blending. The pre-processing leverages image information from pixels to make informed guesses about pixels that were not captured. In particular, various pixels with different knowability (e.g., known, unknown, consistent, and conflicting) may be handled differently so as to emphasize/de-emphasize their importance in pre-processing.

Abstract: An image capture device may include a touchscreen display, which may be used to receive user input. The image capture device may determine whether it is under water based on analysis of visual content captured by the image capture device. Responsive to determination that it is under water, the image capture device may change operation with respect to the touchscreen display.

Abstract: Systems and methods are disclosed for circular stitching of images. For example, methods may include accessing a first image captured using a first image sensor; accessing a second image captured using a second image sensor; determining a cost table for a circular stitching boundary that includes overlapping regions of the first image and the second image; determining an extended disparity profile based on a periodic extension of the cost table and a smoothness criterion, wherein the extended disparity profile has a length greater than the width of the cost table; determining a binocular disparity profile of a length equal to the width of the cost table based on a contiguous subsequence of the extended disparity profile; and stitching the first image and the second image using the binocular disparity profile to obtain a combined image.

Abstract: This disclosure relates to systems and methods for controlling an unmanned aerial vehicle. Boundaries of a user-defined space may be obtained. The boundaries of the user-defined space may be fixed with respect to some reference frame. A user-defined operation associated with the user-selected space may be obtained. Position of the unmanned aerial vehicle may be tracked during an unmanned aerial flight. Responsive to the unmanned aerial vehicle entering the user-defined space, the unmanned aerial vehicle may be automatically controlled to perform the user-defined operation.

Abstract: A vehicle includes systems and methods to guide the vehicle. A sensor detects objects around the vehicle and processor includes a predicted motion component and a predicted imaging component to avoid objects around the vehicle. The system and method then avoid the object if the processor determines that an intersection will occur between the object and the vehicle.

Abstract: Encoded content is accessed. The encoded content includes an encoded first centrally located tile corresponding to a first centrally located tile of a first image, an encoded first peripherally located tile of the first image, and an encoded second peripherally located tile of a second image. The encoded first peripherally located tile is decoded to obtain a decoded first peripherally located tile. The encoded second peripherally located tile is decoded to obtain a decoded second peripherally located tile. The decoded first peripherally located tile and the decoded second peripherally located tile are stitched to obtain a stitched image portion. The stitched image portion is encoded to obtain an encoded stitched image portion. An encoded stitched image of the first image and the second image is obtained by combining the encoded first centrally located tile, and the encoded stitched image portion.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.

Abstract: An image capture device may capture multiple audio content during capture of visual content. The field of view of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of the visual content with the field of view.

Abstract: A video including visual content may be captured by an image capture device in motion. Stabilization performance information for the visual content may be determined. The stabilization performance information may characterize an extent to which desired stabilization is able to be performed using the visual content. The stabilization for the visual content may be changed based on the stabilization performance information.

Abstract: The present teachings provide a system including image sensors, remote controllers, and one or more physical processors. The image sensors are configured to generate output signals conveying visual information regarding the one or more images of one or more individuals. The remote controllers are configured to be worn by individuals, and the remote controllers are in communication with the image sensors to provide location information to the image sensors regarding a location of the individuals wearing the remote controllers. The one or more physical processors are configured by computer-readable instructions to recognize the remote controllers worn by the individuals. The one or more physical processors are configured to track the individuals based on the location of the remote controllers. The one or more physical processors are configured to control the image sensors to capture images of the individuals based upon the location of the remote controllers.

Abstract: A pipeline in a controller may be configured to interface between sensors and actuators. The pipeline may elements such as drivers, filters, a combine, estimators, controllers, a mixer, and actuator controllers. The drivers may receive sensor data and pre-process the received sensor data. The filters may filter the pre-processed sensor data to generate filtered sensor data. The combine may package the filtered sensor data to generate packaged sensor data. The estimators may determine estimates of a position of a vehicle based on the packaged sensor data. The controllers may generate control signals based on the determined estimates. The mixer may modify the generated control signals based on limitations of the vehicle. The actuator controllers may generate actuator control signals based on the modified control signals to drive the actuators.

Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: Positions of an image capture device may be used to estimate a time-lapse video frame rate with which time-lapse video frames are generated. The time-lapse video frame rate may be adjusted based on apparent motion between pairs of generated time-lapse video frames. The adjusted time-lapse video frame rate may be used to generate additional time-lapse video frames.

Abstract: A system including an unmanned aerial vehicle. The unmanned aerial vehicle includes image sensors and one or more physical computer processors. The image sensors are configured to capture images and/or video segments. The one or more physical computer processors create a user ID and/or other identifying information for a user and/or a consumer when a user and/or consumer registers with an authentication component. The processors associate the user ID and/or the other identifying information with one or more client computing platforms. The processors store the user ID and/or the other identifying information associated with the user and/or the consumer on the authentication component. The processors associate the user and/or the consumer with one or more accounts. The processors authenticate the user and/or the consumer with the authentication component so that the user and/or the consumer is permitted to access a repository of the images and/or the video segments.

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

Abstract: Disclosed is an aerial vehicle. The aerial vehicle may include a removable battery. Various embodiments of removable battery assemblies include a pull-bar battery assembly, a latch battery assembly, and a lever battery assembly. The aerial vehicle may also include a propeller locking mechanism to which propellers may be removably coupled. The propeller locking mechanism may obviate the need for tools for coupling or decoupling propellers to the aerial vehicle. Vents in the arm of the aerial vehicle may provide an air pathway, providing convective cooling for the electronics aerial vehicle.

Abstract: An image capture device includes a processor for wind noise processing. The processor receives signals from microphones. The processor may segment the signals into low frequency bins and high frequency bins. The processor may select a minimum level signal bin for the low frequency bins. The processor may select a minimum level signal bin for the high frequency bins. The processor may generate a composite signal by combining the selected minimum level signal bins for the low frequency bins and the selected minimum level signal bins for the high frequency bins.

Abstract: A propeller blade includes a first material and a second material. The first material includes fibers. The second material is different from the first material. The fibers are interspersed through the second material and the fibers are oriented in a same direction within the second material. The propeller blade is anisotropic and includes sections of the fibers.

Abstract: Systems, apparatus, and methods adding post-processing motion blur to video and/or frame interpolation with occluded motion. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems. Various embodiments use a combination of video frame interpolation techniques for better interpolated frames with faster/more efficient rendering times.

Abstract: Systems, apparatus, and methods for adding post-processing motion blur to video. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems.

Abstract: Scene-based automatic white balance correction may be performed by obtaining an input image. A histogram may be computed from an image thumbnail. The scene-based automatic white balance correction may include classifying a scene. The scene-based automatic white balance correction may include learning a first filter and a second filter. The first filter and the second filter may be learned from one or several different instances of the raw image thumbnail, the augmented image thumbnail, the scene classification, or any combination thereof. The scene-based automatic white balance correction may include applying the filter to the histogram to determine white balance correction coefficients and obtain a processed image.

Abstract: An image capture system for enhanced electronic image stabilization (EIS) includes an image capture device and an adapter lens. The image capture device includes an image sensor, a lens housing, a processor, and a lens assembly that includes a first group of optical elements disposed within the lens housing. The first group of optical elements are used project an image onto the image sensor. The processor performs EIS. The adapter lens is used to enhance EIS of the image capture device. The adapter lens has an adapter lens housing that interfaces with the lens housing. The adapter lens has a second group of optical elements disposed within the adapter lens housing. The second group of optical elements are used to project the image as an image circle on the image sensor.

Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.). In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: An image capture device may analyze visual content to determine a smile aggregation value. The smile aggregation value satisfying a smile aggregation criterion may indicate that people depicted in the visual content are smiling. When the smile aggregation value satisfies the smile aggregation criterion, the capture of visual content may be started. When the smile aggregation value fails to satisfy the smile aggregation criterion, the capture of visual content may be stopped.

Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.

Abstract: An image capture device may capture visual content with an optical element having a field of view. The location of the image capture device, the direction of north with respect to the image capture device, and rotation of the image capture device may be used to determine location of celestial pole with respect to the field of view. A graphical user interface may be presented on an electronic display. The graphical user interface may indicate the location of the celestial pole within the field of view.

Abstract: A camera with image and audio capture capabilities is configured to protect the internal audio components from the external environment. The camera includes a housing that allows passage of sound waves via a port from an external area of the camera to an internal area of the camera. The camera includes a circuit board with an opening and a microphone attached to a first surface of the circuit board adjacent to the opening. The camera includes a compressible spacer attached to a second surface of the circuit board. The second surface of the circuit board may be diametrically opposite to the first surface. The camera includes a waterproof membrane between the housing and the compressible spacer.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. Different field of view punchouts, such as wide field of view punchout and linear field of view punchout, may be used to stabilize the video. Different field of view punchouts may provide different stabilization margins to stabilize the video. The video may be stabilized by switching between different field of view punchouts based on the amount of stabilization margin needed to stabilize the video.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: An image capture device includes a first housing, a second housing, a first integrated sensor-lens assembly (ISLA), and a second ISLA. The second housing is coupled to the first housing to form an internal compartment. The first ISLA includes a first image sensor coupled to a first lens in fixed alignment. The second ISLA includes a second image sensor coupled to a second lens in fixed alignment. The first ISLA is positively statically connected to the first housing, and the second ISLA is coupled to the first housing indirectly via the first ISLA.