Abstract: A camera system with six faces and a front housing is configured to capture images and audio content from external the camera body. The camera system includes an interior audio assembly protected from external environments by a waterproof membrane. The camera system includes drainage ports on the bottom face and the left face of the camera system to encourage moisture to drain from the system. A first drainage channel couples the internal audio assembly to the first drainage port on left face of the camera system and a second drainage channel couples the drainage port on the left face of the camera system to the drainage port on the bottom face of the camera system. A third drainage channel exists between the front face of the camera system and the front housing, the third drainage channel coupling the first and second drainage channels.

Abstract: Image captured through a non-rectilinear lens may exhibit distortions. The distortions may be reduced by warping the image. However, warping the image may degrade the fidelity of the image. The warped image may be enhanced to increase the fidelity of the image. The enhancement may be applied to the portions of the image that were degraded from the warping.

Abstract: Systems, apparatus, and methods for selectively parsing a live stream for a connected device. GoPro® cameras capture 2 video streams for every recording: a main resolution video (MRV) and a frame aligned low-resolution video (LRV). Currently, the LRV is streamed to other devices for playback in real-time. Unfortunately, not all devices in the mobile ecosystem can keep up with these transfer and playback speeds of the LRV; thus, exemplary embodiments of the present disclosure pick frames from the LRV to provide an IDR-only version that can be replayed with minimal processing burden. As a related issue, operating codecs in parallel at different resolutions can result in misaligned frame structures since each codec independently determines its “group of pictures” (GOP), etc. The described techniques define a frame correspondence that can also be used to improve post-processing at best effort.

Abstract: A limited input device, such as a camera, is authenticated based on a request received from an authenticated application. The camera provides an authorization code to the authenticated application and receives an access token. The access token is associated with a user account. The access token is received based on a verification of the authorization code. The camera transmits one or more images associated with the user account to the first device based on the verification.

Abstract: Systems, apparatus, and methods for motion transfer between different media. Two videos shot simultaneously are combined with aspects of each used to produce a higher-resolution frame interpolated video than would otherwise be possible by the devices alone. The interpolated video may be used in slow motion footage, a higher frame rate (e.g., virtual reality) application, or to add a realistic motion blur effect in post-processing (rather than in capture). A post-processing device may receive high-speed video from a high-speed camera and a low-speed video from a low-speed camera. The post-processing device may use motion data from the high-speed video to interpolate frames of (high-resolution) low-speed video producing low-speed interpolated video.

Abstract: Methods and apparatus for blending unknown pixels in overlapping images. In one embodiment, an action camera captures two hyper-hemispherical fisheye images that are stitched to a 360° panorama. In order to remove exposure differences between the two cameras, the images are pre-processed prior to multiband blending. The pre-processing leverages image information from pixels to make informed guesses about pixels that were not captured. In particular, various pixels with different knowability (e.g., known, unknown, consistent, and conflicting) may be handled differently so as to emphasize/de-emphasize their importance in pre-processing.

Abstract: An image capture device may include a touchscreen display, which may be used to receive user input. The image capture device may determine whether it is under water based on analysis of visual content captured by the image capture device. Responsive to determination that it is under water, the image capture device may change operation with respect to the touchscreen display.

Abstract: This disclosure relates to systems and methods for controlling an unmanned aerial vehicle. Boundaries of a user-defined space may be obtained. The boundaries of the user-defined space may be fixed with respect to some reference frame. A user-defined operation associated with the user-selected space may be obtained. Position of the unmanned aerial vehicle may be tracked during an unmanned aerial flight. Responsive to the unmanned aerial vehicle entering the user-defined space, the unmanned aerial vehicle may be automatically controlled to perform the user-defined operation.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.

Abstract: Encoded content is accessed. The encoded content includes an encoded first centrally located tile corresponding to a first centrally located tile of a first image, an encoded first peripherally located tile of the first image, and an encoded second peripherally located tile of a second image. The encoded first peripherally located tile is decoded to obtain a decoded first peripherally located tile. The encoded second peripherally located tile is decoded to obtain a decoded second peripherally located tile. The decoded first peripherally located tile and the decoded second peripherally located tile are stitched to obtain a stitched image portion. The stitched image portion is encoded to obtain an encoded stitched image portion. An encoded stitched image of the first image and the second image is obtained by combining the encoded first centrally located tile, and the encoded stitched image portion.

Abstract: Systems and methods are disclosed for circular stitching of images. For example, methods may include accessing a first image captured using a first image sensor; accessing a second image captured using a second image sensor; determining a cost table for a circular stitching boundary that includes overlapping regions of the first image and the second image; determining an extended disparity profile based on a periodic extension of the cost table and a smoothness criterion, wherein the extended disparity profile has a length greater than the width of the cost table; determining a binocular disparity profile of a length equal to the width of the cost table based on a contiguous subsequence of the extended disparity profile; and stitching the first image and the second image using the binocular disparity profile to obtain a combined image.

Abstract: A vehicle includes systems and methods to guide the vehicle. A sensor detects objects around the vehicle and processor includes a predicted motion component and a predicted imaging component to avoid objects around the vehicle. The system and method then avoid the object if the processor determines that an intersection will occur between the object and the vehicle.

Abstract: A video including visual content may be captured by an image capture device in motion. Stabilization performance information for the visual content may be determined. The stabilization performance information may characterize an extent to which desired stabilization is able to be performed using the visual content. The stabilization for the visual content may be changed based on the stabilization performance information.

Abstract: An image capture device may capture multiple audio content during capture of visual content. The field of view of the visual content may be used to generate modified audio content from the multiple audio content. The modified audio content may provide sound for playback of the visual content with the field of view.

Abstract: The present teachings provide a system including image sensors, remote controllers, and one or more physical processors. The image sensors are configured to generate output signals conveying visual information regarding the one or more images of one or more individuals. The remote controllers are configured to be worn by individuals, and the remote controllers are in communication with the image sensors to provide location information to the image sensors regarding a location of the individuals wearing the remote controllers. The one or more physical processors are configured by computer-readable instructions to recognize the remote controllers worn by the individuals. The one or more physical processors are configured to track the individuals based on the location of the remote controllers. The one or more physical processors are configured to control the image sensors to capture images of the individuals based upon the location of the remote controllers.

Abstract: A pipeline in a controller may be configured to interface between sensors and actuators. The pipeline may elements such as drivers, filters, a combine, estimators, controllers, a mixer, and actuator controllers. The drivers may receive sensor data and pre-process the received sensor data. The filters may filter the pre-processed sensor data to generate filtered sensor data. The combine may package the filtered sensor data to generate packaged sensor data. The estimators may determine estimates of a position of a vehicle based on the packaged sensor data. The controllers may generate control signals based on the determined estimates. The mixer may modify the generated control signals based on limitations of the vehicle. The actuator controllers may generate actuator control signals based on the modified control signals to drive the actuators.

Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: Positions of an image capture device may be used to estimate a time-lapse video frame rate with which time-lapse video frames are generated. The time-lapse video frame rate may be adjusted based on apparent motion between pairs of generated time-lapse video frames. The adjusted time-lapse video frame rate may be used to generate additional time-lapse video frames.

Abstract: A system including an unmanned aerial vehicle. The unmanned aerial vehicle includes image sensors and one or more physical computer processors. The image sensors are configured to capture images and/or video segments. The one or more physical computer processors create a user ID and/or other identifying information for a user and/or a consumer when a user and/or consumer registers with an authentication component. The processors associate the user ID and/or the other identifying information with one or more client computing platforms. The processors store the user ID and/or the other identifying information associated with the user and/or the consumer on the authentication component. The processors associate the user and/or the consumer with one or more accounts. The processors authenticate the user and/or the consumer with the authentication component so that the user and/or the consumer is permitted to access a repository of the images and/or the video segments.

Abstract: An image capture device includes a processor for wind noise processing. The processor receives signals from microphones. The processor may segment the signals into low frequency bins and high frequency bins. The processor may select a minimum level signal bin for the low frequency bins. The processor may select a minimum level signal bin for the high frequency bins. The processor may generate a composite signal by combining the selected minimum level signal bins for the low frequency bins and the selected minimum level signal bins for the high frequency bins.

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

Abstract: Disclosed is an aerial vehicle. The aerial vehicle may include a removable battery. Various embodiments of removable battery assemblies include a pull-bar battery assembly, a latch battery assembly, and a lever battery assembly. The aerial vehicle may also include a propeller locking mechanism to which propellers may be removably coupled. The propeller locking mechanism may obviate the need for tools for coupling or decoupling propellers to the aerial vehicle. Vents in the arm of the aerial vehicle may provide an air pathway, providing convective cooling for the electronics aerial vehicle.

Abstract: A propeller blade includes a first material and a second material. The first material includes fibers. The second material is different from the first material. The fibers are interspersed through the second material and the fibers are oriented in a same direction within the second material. The propeller blade is anisotropic and includes sections of the fibers.

Abstract: Systems, apparatus, and methods adding post-processing motion blur to video and/or frame interpolation with occluded motion. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems. Various embodiments use a combination of video frame interpolation techniques for better interpolated frames with faster/more efficient rendering times.

Abstract: Systems, apparatus, and methods for adding post-processing motion blur to video. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems.

Abstract: Scene-based automatic white balance correction may be performed by obtaining an input image. A histogram may be computed from an image thumbnail. The scene-based automatic white balance correction may include classifying a scene. The scene-based automatic white balance correction may include learning a first filter and a second filter. The first filter and the second filter may be learned from one or several different instances of the raw image thumbnail, the augmented image thumbnail, the scene classification, or any combination thereof. The scene-based automatic white balance correction may include applying the filter to the histogram to determine white balance correction coefficients and obtain a processed image.

Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

Abstract: An image capture system for enhanced electronic image stabilization (EIS) includes an image capture device and an adapter lens. The image capture device includes an image sensor, a lens housing, a processor, and a lens assembly that includes a first group of optical elements disposed within the lens housing. The first group of optical elements are used project an image onto the image sensor. The processor performs EIS. The adapter lens is used to enhance EIS of the image capture device. The adapter lens has an adapter lens housing that interfaces with the lens housing. The adapter lens has a second group of optical elements disposed within the adapter lens housing. The second group of optical elements are used to project the image as an image circle on the image sensor.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.). In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: An image capture device may analyze visual content to determine a smile aggregation value. The smile aggregation value satisfying a smile aggregation criterion may indicate that people depicted in the visual content are smiling. When the smile aggregation value satisfies the smile aggregation criterion, the capture of visual content may be started. When the smile aggregation value fails to satisfy the smile aggregation criterion, the capture of visual content may be stopped.

Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.

Abstract: An image capture device may capture visual content with an optical element having a field of view. The location of the image capture device, the direction of north with respect to the image capture device, and rotation of the image capture device may be used to determine location of celestial pole with respect to the field of view. A graphical user interface may be presented on an electronic display. The graphical user interface may indicate the location of the celestial pole within the field of view.

Abstract: An image capture device includes a housing and a heatsink that forms an integral portion of the housing and draws heat from a heat generating component of the heatsink. The image capture device includes a circuit board enclosed by the housing and comprising a chip. The image capture device includes a gasket that connects the heatsink and the circuit board. The gasket encloses sides of the chip and the heatsink encloses a top of the chip so that electromagnetic interference does not affect other components of the image capture device.

Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor, detecting, in a linear domain, color fringing areas in the image, correcting detected color fringing areas to obtain a corrected image, performing tone mapping to the corrected image to obtain a tone mapped image and storing, displaying, or transmitting an output image based on at least the tone mapped image.

Abstract: A camera with image and audio capture capabilities is configured to protect the internal audio components from the external environment. The camera includes a housing that allows passage of sound waves via a port from an external area of the camera to an internal area of the camera. The camera includes a circuit board with an opening and a microphone attached to a first surface of the circuit board adjacent to the opening. The camera includes a compressible spacer attached to a second surface of the circuit board. The second surface of the circuit board may be diametrically opposite to the first surface. The camera includes a waterproof membrane between the housing and the compressible spacer.

Abstract: A pipeline in a controller may be configured to interface between sensors and actuators. The pipeline may elements such as drivers, filters, a combine, estimators, controllers, a mixer, and actuator controllers. The drivers may receive sensor data and pre-process the received sensor data. The filters may filter the pre-processed sensor data to generate filtered sensor data. The combine may package the filtered sensor data to generate packaged sensor data. The estimators may determine estimates of a position of a vehicle based on the packaged sensor data. The controllers may generate control signals based on the determined estimates. The mixer may modify the generated control signals based on limitations of the vehicle. The actuator controllers may generate actuator control signals based on the modified control signals to drive the actuators.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. Different field of view punchouts, such as wide field of view punchout and linear field of view punchout, may be used to stabilize the video. Different field of view punchouts may provide different stabilization margins to stabilize the video. The video may be stabilized by switching between different field of view punchouts based on the amount of stabilization margin needed to stabilize the video.

Abstract: An image capture device includes a first housing, a second housing, a first integrated sensor-lens assembly (ISLA), and a second ISLA. The second housing is coupled to the first housing to form an internal compartment. The first ISLA includes a first image sensor coupled to a first lens in fixed alignment. The second ISLA includes a second image sensor coupled to a second lens in fixed alignment. The first ISLA is positively statically connected to the first housing, and the second ISLA is coupled to the first housing indirectly via the first ISLA.

Abstract: A image capture device including: heat generating devices, one or more batteries, and a sensor heat spreader. The heat generating devices generate a thermal load. The sensor heat spreader is in thermal communication with one or more of the heat generating devices and extends from the one or more of the heat generating devices to the one or more batteries so that all or a portion of the thermal load is transferred to the one or more batteries.

Abstract: An image capture device includes a housing having a pattern of apertures and a membrane assembly. The membrane assembly includes a support that has internal and external surfaces and a channel that aligns with at least one aperture of the pattern of apertures and extends between the internal and external surfaces. The membrane assembly includes indents that are adjacent to the channel, aligned with the pattern of apertures, and disposed on the external surface. The indents have a depth that is less than a depth of the channel.

Abstract: An image capture device is disclosed that includes a body defining a peripheral cavity and a removable door assembly that is configured to close and seal the peripheral cavity. The door assembly includes a door body; a locking mechanism; and a biasing member that is configured for engagement with the locking mechanism to resist unlocking of the locking mechanism until a threshold force is applied, at which time, the biasing member is moved from a normal position, in which the biasing member extends at a first angle in relation to the locking mechanism, to a deflected position, in which the biasing member extends at a second angle in relation to the locking mechanism. When locked, the door assembly is rotationally fixed in relation to the body of the image capture device, and when unlocked, the door assembly is rotatable in relation to the body of the image capture device.

Abstract: An image capture device with beamforming for wind noise optimized microphone placements is described. The image capture device includes a front facing microphone configured to capture an audio signal. The front facing microphone co-located with at least one optical component. The image capture device further includes at least one non-front facing microphone configured to capture an audio signal. The image capture device further includes a processor configured to generate a forward facing beam using the audio signal captured by the front facing microphone and the audio signal captured by the at least one non-front facing microphone, generate an omni beam using the audio signal captured by the at least one non-front facing microphone, and output an audio signal based on the forward facing beam and the omni beam.

Abstract: An image capture device is disclosed that includes a body defining a peripheral cavity and a door assembly that is movable between an open position and a closed position to close and seal the peripheral cavity. The door assembly includes a door body; a slider that is supported by the door body for axial movement between a first position and a second position; a biasing member that is configured for engagement (contact) with the slider; a door lock including a stop that is configured for engagement (contact) with the biasing member; and a sealing member that is fixedly connected to the door lock.

Abstract: In one aspect of the present disclosure, a module is disclosed for use with a digital image capturing device (DICD) including an integrated sensor-lens assembly (ISLA). The module includes a cradle configured for connection to a housing of the DICD, and at least one dampener that is configured for positioning between the module and the housing of the DICD to reduce vibrations transmitted to the ISLA.

Abstract: Multiple punchouts of a video may be presented based on multiple viewing windows. The video may include visual content having a field of view. Multiple viewing windows may be determined for the video, with individual viewing window defining a set of extents of the visual content. Different punchouts of the visual content may be presented based on the different viewing windows. Individual punchout of the visual content may include the set of extents of the visual content defined by corresponding viewing window.

Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.