Abstract: An image capture device captures video frames using a capture rate. The image capture device performs face detection on the video frames using a face detection rate slower than the capture rate. Temporal filtering is applied to determine the positions and sizes of the faces within the video frames in which face detection has not been performed. Tracking filtering is applied to determine the positions and sizes of the faces within the video frames in which face detection has failed. One or more of the faces within the video frames are blurred, and the blurred video frames are transmitted to a computing device.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.). In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: Modular lens assemblies and mounting systems are disclosed. A modular lens assembly includes a removable portion and a fixed portion. The removable portion includes a first lens stack configured to produce a near-collimated ray path or a collimated ray path. The fixed portion includes a second lens stack configured to receive the near-collimated ray path or the collimated ray path from the removable portion. The modular lens assembly may be implemented in an image capture device. An image sensor of the image capture device is positioned at an end of the modular lens assembly. The image sensor is configured to capture images based on light incident on the image sensor through the first lens stack and the second lens stack such that the light incident on an outer lens of the first lens stack is refracted through the second lens stack to the image sensor.

Abstract: An image capture device may include an electronic display. A graphical user interface may be presented on the electronic display. The graphical user interface may provide a dynamic view of the settings of the image capture device. Settings shown within the graphical user interface may dynamically change to show the available settings of the image capture device.

Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.

Abstract: Image capture devices and methods may be used to pre-buffer media storage. The pre-buffering method includes recording an image capture segment of a variable bitrate input stream in a circular buffer. The circular buffer includes a number of recordable segments. The method includes recording a next image capture segment in a next adjacent recordable segment of the circular buffer if the next adjacent recordable segment of the predetermined number of recordable segments is available. The method includes overwriting an oldest recordable segment if the next adjacent recordable segment of the predetermined number of recordable segments is not available.

Abstract: Automatic exposure with simulated histograms may include obtaining a noise-blur exposure duration value in accordance with a minimal simulated noise-blur cost value obtained in accordance with simulated noise data and simulated blur data, obtaining a saturation exposure value in accordance with a minimal simulated saturation cost value obtained in accordance with simulated black saturation data and simulated white saturation data, comparing the noise-blur exposure duration value and the saturation exposure value, and obtaining a target gain value and a target exposure duration value based on the comparison, wherein the comparing may include obtaining the target exposure duration value in accordance with a minimal simulated blur-saturation cost value obtained in accordance with the simulated blur data and the simulated black saturation data or in accordance with a minimal simulated noise-saturation cost value obtained in accordance with the simulated noise data and the simulated white saturation data.

Abstract: A video may include visual content having a field of view. Extents of the visual content within a viewing window may be presented on an electronic display. For a time point in the video, the video may be framed by positioning the viewing window within the field of view of the visual content. The framing of the video at the time point in the video may be extended to a duration in the video. The extended framing of the video over the duration may be presented within a graphical user interface.

Abstract: Systems, apparatus, and methods for augmenting dense depth maps using sparse data. Various embodiments combine single-image depth estimation (SIDE) techniques with structure-from-motion techniques for improved depth accuracy. In some examples, a machine learning (ML) model is used to generate a dense depth map based on one or more frames/images of a video. Structure-from-motion (SfM) analysis is performed on the video to determine depth information from camera movement in the video. The structure-from-motion techniques may generate more accurate data than the ML model, however, the data from the ML model may be denser compared with the SFM depth data. The dense ML model depth map may be augmented by the SFM depth data. Augmentation may include fitting the relative depths determined by the ML model depth map to the absolute depth in the SFM data resulting in more accurate dense depth information.

Abstract: A user may carry a computing device. Communication between the computing device and an image capture device may be used to determine when the image capture device becomes separated from the computing device. When the image capture device becomes separated from the computing device, the operation(s) of the image capture device may be changed to assist the user in locating the image capture device. Information on location of the image capture device may be provided to the user through the computing device to assist the user in locating the image capture device.

Abstract: Multiple punchouts of a video may be presented based on multiple viewing windows. The video may include visual content having a field of view. Multiple viewing windows may be determined for the video, with individual viewing window defining a set of extents of the visual content. Different punchouts of the visual content may be presented based on the different viewing windows. Individual punchout of the visual content may include the set of extents of the visual content defined by corresponding viewing window.

Abstract: Systems, apparatus, and methods for encoding timelapse videos. Timelapse photography involves capturing a sequence of images at set intervals over a period of time and then playing them back at a higher speed. Unfortunately, timelapse photography introduces a variety of problems that conventional photography does not have. Exemplary embodiments capture light information in a power efficient manner and encode them in bulk (a video segment at a time). In some variants, the light information may be stored as raw data; in other variants, the light information may be stored as compressed images. The segment-based encoding has the additional benefit of creating identifiable breakpoints that allow for file access without interfering with the capture; this may be used to check the status of the video mid-recording.

Abstract: An image signal processor accesses raw images from an image sensor. The image signal processor obtains adaptive acquisition control data for the raw images. The adaptive acquisition control data comprises at least one of a luminance value, a contrast value, a gain value, an exposure value, or a white balance value. The image signal processor obtains, in accordance with the adaptive acquisition control data, an indication of whether to use a star trails scene classification for the raw images. The image signal processor transmits, to buffers for storing data in accordance with the raw images, the indication of whether to use the star trails scene classification.

Abstract: Systems, apparatus, and methods for adding post-processing motion blur to video. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems.

Abstract: Systems, apparatus, and methods for super-resolution of non-uniform spatial blur. Non-uniform spatial blur presents unique challenges for conventional neural network processing. Existing implementations attempt to handle super-resolution with a “brute force” optimization. Various embodiments of the present disclosure subdivide the super-resolution function into sub-steps. “Unfolding” super-resolution into smaller closed-form functions allows for operation using generic plug-and-play convolutional neural network (CNN) logic. Additionally, each step can be optimized with its own step-specific hyper parameters to improve performance.

Abstract: Systems and methods are disclosed for sensor prioritization for composite image capture. For example, methods may include selecting an image sensor as a prioritized sensor from among an array of two or more image sensors; determining one or more image processing parameters based on one or more images captured using the prioritized sensor; applying image processing using the one or more image processing parameters to images captured with each image sensor in the array of two or more image sensors to obtain respective processed images for the array of two or more image sensors; and stitching the respective processed images for the array of two or more image sensors to obtain a composite image.

Abstract: A video may be framed using information on the direction of gravity and the direction of north with respect to an image capture device during video capture, information on changes in the orientation of the image capture device during video capture, and information on the direction of motion of the image capture device during video capture. The changes in the orientation of the image capture device may be in an image capture device reference frame, and the direction of motion of the image capture device may be in the earth reference frame. The changes in the orientation of the image capture device and the direction of motion of the image capture device may be merged into a single reference frame using the direction of gravity and the direction of north with respect to the image capture device, and the video may be framed in the single reference frame to include the extents of the video in the direction of the motion of the image capture device during video capture.

Abstract: The present disclosure relates to a helmet including a shell, a housing comprising a front panel and a rear panel that form a chin portion of the shell, an electronic board disposed within the housing, a battery disposed within the housing and coupled to the electronic board, a camera disposed within the housing and coupled to the electronic board and the battery. The camera comprises a lens that extends through the front panel of the housing. The housing is embedded within an external profile shape of the helmet.

Abstract: An image capture device is disclosed that includes: a body; a first integrated sensor-lens assembly (ISLA) that is supported by the body and which is oriented in a first direction; and a second ISLA that is supported by the body and which is oriented in a second direction that is opposite to the first direction. The first ISLA and the second ISLA are each configured in a tilted orientation so as to define first and second stitch distances that are unequal, which inhibits (if not entirely prevents) the inclusion of extraneous objects in the captured content and improves the overall quality of the (spherical) image that is ultimately output (generated) by the image capture device.

Abstract: An image capture system for enhanced electronic image stabilization (EIS) includes an image capture device and an adapter lens. The image capture device includes an image sensor, a lens housing, a processor, and a lens assembly that includes a first group of optical elements disposed within the lens housing. The first group of optical elements are used project an image onto the image sensor. The processor performs EIS. The adapter lens is used to enhance EIS of the image capture device. The adapter lens has an adapter lens housing that interfaces with the lens housing. The lens housing automatically detects the adapter lens.

Abstract: An image capture device includes an image capture module and a base module. The image capture module is releasably connectable to the base module. The image capture module includes an integrated image sensor and optical component for capturing image data. The base module includes a processor. The processor is configured and the base module is calibrated based on identification data provided by the image capture module when releasably connected to the base module. The image information and identification data may be wirelessly transferred from the image capture module to the base module.

Abstract: Framing options of different types may be determined for various moments in the video based on one or more aspects of the video. The aspects of the video may include capture aspects of the video (e.g., how the image capture device moved during capture of the video) and/or content aspects (e.g., what is captured/depicted within the video) of the video. The video may be framed by automatically switching between different framing options based on a priority matrix. The values of the priority matrix may be set/updated based on user data to provide views of the video that are customized for the user. The framing options selected for the video may be used to select which moments of the video are included in the framed video (e.g., video edit with the framed views, video playback with the framed views). The present disclosure may be used to automatically determine which spatial extents and which temporal parts of the video are included in the framed video.

Abstract: An image capture apparatus including a body and a multi-function interconnect mechanism connected to the body. The interconnect mechanism includes: a base plate; protrusions; and magnetic members, wherein the base plate includes: a receptacle configured to engage an accessory such that the accessory is directly connectable to the image capture apparatus via the interconnect mechanism; locating features configured to receive alignment members on an adapter to facilitate proper registration of the adapter and the interconnect mechanism; and latching features configured for engagement with latch members on the adapter to thereby connect the adapter to the interconnect mechanism. The protrusions include apertures extending therethrough and are pivotably connected to the base plate such that the interconnect mechanism is reconfigurable between collapsed and extended configurations.

Abstract: An image capture device including first and second heatsinks and a printed circuit board that separates the first and second heatsinks and includes a processor configured to generate heat. The image capture device includes a conductor assembly that is configured to transfer heat by conduction and extends between the first heatsink, the processor, and the second heatsink.

Abstract: Obtaining a processed spherical image includes obtaining a first luminance thumbnail image for a first hemispherical input image, obtaining a second luminance thumbnail image for a second hemispherical input image, obtaining a first distortion correcting weight map, obtaining a second distortion correcting weight map, obtaining, as an aggregate weighted mean value for the input spherical image, an aggregate of a first normalized weighted mean value for the first luminance thumbnail image and a second normalized weighted mean value for the second luminance thumbnail image, obtaining at least one of a target exposure value, a target aggregate gain value, or a region of interest ratio value in accordance with the aggregate weighted mean value, and obtaining the processed spherical image from the input spherical image in accordance with at least one of the target exposure value, the target aggregate gain value, or the region of interest ratio value.

Abstract: An image capture device includes a lens barrel disposed in a body of the image device, a bayonet, a replaceable lens module that is configured to releasably couple to the bayonet, and a biasing element coupled to the housing or coupled to the bayonet that is configured to bias the housing against the lens barrel. The replaceable lens module includes a housing and a lens positioned in a lens recess of the housing. Additionally, when an impact force that meets a predetermined threshold is applied to an exterior surface of the replaceable lens module, the housing is configured to compress the biasing element and disengage the lens barrel.

Abstract: An antenna system is configured for use with an electronic device having a housing. The antenna system includes a first antenna element configured to be disposed at a first location adjacent to a side of the housing and a second antenna element configured to be disposed at a second location adjacent to the side of the housing. The first antenna element includes a first body extending between a first lower end and a first upper end. The first body includes a first flat portion, a first arcuate portion, and a first cutout configured to facilitate dual-band radiation associated with the first antenna element. The second antenna element includes a second body extending between a second lower end and a second upper end. The second body includes a second flat portion, a second arcuate portion, and a second cutout configured to facilitate dual-band radiation associated with the second antenna element.

Abstract: A system including an image capture module and a handheld module. The image capture module includes a body; an image sensor; and a mechanical stabilization system comprising a first gimbal, a second gimbal, and a third gimbal connected to the body and configured to control an orientation of the image sensor of the image capture module relative to the body. The handheld module defines a slot that is keyed to the body of the image capture module. The image capture module, when located within the handheld module, has a low profile so that the third gimbal is protected from damage by the handheld module.

Abstract: An image capture device includes a housing that defines a cavity and an aperture positioned within the cavity and an audio device disposed within the housing at a location of the aperture. The image capture device includes stanchions that extend outward from the cavity and a cover coupled to the stanchions. The cover is free of contact with the housing.

Abstract: An image capture device is disclosed that includes: a body; an optical module that is positioned within the body and which defines an optical axis; and an isolation assembly that supports (suspends) the optical module within the body and which facilitates resilient displacement of the optical module in relation to the body upon the application of an external force to the image capture device to thereby inhibit transmission of the external force to the optical module.

Abstract: Adaptive acquisition control timing control for image and video acquisition and processing includes obtaining, by an auto-exposure compensation component of an image processing pipeline of an image capture apparatus, during a current sensor readout window corresponding to obtaining current input image data from an image sensor of the image capture apparatus, in accordance with defined image acquisition and processing timing data, current auto-exposure compensation data for processing subsequent input image data obtained from the image sensor during a subsequent sensor readout window sequentially immediately subsequent to the current sensor readout window, and outputting, to a second data storage unit instance of the image processing pipeline, by the auto-exposure compensation component, during the current sensor readout window, the current auto-exposure compensation data.

Abstract: An image capture device includes a housing, a processor, and three or more microphones. The housing includes a forward wall including a sensor, a rearward wall located opposite the forward wall, and a top wall connecting the forward wall and the rearward wall. The three or more microphones are configured to capture sound. The three or more microphones include a first microphone, a second microphone, and a third microphone. The processor is configured to receive the sound from the three or more microphones and to estimate a direction of arrival, reduce or remove wind noise, perform beamforming, or a combination thereof. The first microphone is located on or within the forward wall, the second microphone is located on or within the top wall, and the third microphone is located on or within the top wall and spaced apart from the second microphone.

Abstract: Methods and apparatus for navigation-based prefetching for just-in-time delivery. Existing content delivery networks (CDNs) are optimized for providing mass media to many consumers. This delivery model is poorly suited to user-specific content. An exemplary client application uses a first user agent to play media, and one or more second user agent(s) that prefetch media. A prefetch process “pre-warms” the CDN, such that the media content is transferred to the appropriate edge server for just-in-time playback by the player agent. In one specific implementation, the prefetch agent monitors user actions (e.g., navigation, etc.) to anticipate user media selections. Anticipated candidates are eagerly prefetched.