Abstract: An image capture device may capture visual content during a capture duration. The context of capture of the visual content by the image capture device may be assessed and used to determine values of stabilization parameters for the visual content.

Abstract: A noise cancelation system for an unmanned aerial vehicle may have an audio capture module, a metadata module and a filter. The audio capture module may be configured to receive an audio signal captured from a microphone, e.g., on a camera. The metadata module may be configured to retrieve noise information associated with noise generating components operating on the unmanned aerial vehicle (UAV). The filter may be configured to receive the audio signal and noise information from the audio capture module. The filter also may be configured to retrieve a baseline profile from a database based on the noise information. The baseline profile includes noise parameter to filter out audio frequencies from the audio signal corresponding to the noise generating component. The filter may generate a filtered audio signal for output.

Abstract: A device including a frame that has first and second openings and a pair of temple arms that pivot relative to the frame. The device includes an imaging unit connected to the frame at a location adjacent to the first opening and capture images through the first opening. The device includes a mechanical switch disposed on the frame or the imaging unit adjacent to the first opening. The device includes lenses fitted within the first and second openings, and the lens that fits within the first opening includes a key interfaceable with the mechanical switch and configured to adjust firmware of the imaging unit based on physical features of the lenses upon interface with the mechanical switch.

Abstract: An image capture device may be calibrated using calibration parameters. Optical medium through which the image capture device captures images may be changed. The calibration parameters of the image capture device may be dynamically modified to account for the change in the optical medium. The image capture device may be operated in accordance with the modified calibration parameters to capture images through the optical medium.

Abstract: A method includes obtaining visual content comprising spatial portions; determining respective spatial qualities of the spatial portions, wherein the respective spatial qualities are based on locations of the spatial portions within the visual content; and encoding the spatial portions of the visual content based on the respective spatial qualities. An apparatus includes a camera, a display, and a processor. The processor is configured to identify, using facial recognition, a face of a user of the apparatus; identify a distance of the face of the user to the display; and render visual content on the display using a quality that is based on the distance.

Abstract: An image capture device may process first frames from a first image sensor obtained at a first frame rate and store the processed first frames in a memory. The image capture device may obtain first camera control statistics based at least on partially processed second frames from a second image sensor obtained at a second frame rate. The image capture device may switch a capture mode to obtain third frames at the second frame rate from the first image sensor and to obtain fourth frames at the first frame rate from the second image sensor.

Abstract: A method for deblurring a target image includes receiving a burst of images that includes the target image; partitioning respective images of the burst of images into respective patches; converting, to a frequency domain, the respective patches into respective transform patches; selecting a first set of corresponding transform patches from the respective transform patches, where the first set of the corresponding transform patches includes a respective transform patch for a respective image of the burst of images; obtaining, using a neural network, respective weight maps for the corresponding transform patches; obtaining a deblurred transform patch by combining the first set of corresponding transform patches using the respective weight maps; obtaining a first deblurred patch by converting the deblurred transform patch to a pixel domain; and obtaining a deblurred image of the target image using the first deblurred patch.

Abstract: An underwater system is disclosed for use with a digital image capturing device (DICD) in underwater environments. The underwater system includes a center band having first and second support bands; a first housing fixedly connected to the first support band and including an optically clear material; a second housing fixedly connected to the second support band and including an optically clear material; a cradle connected to the first support band and configured to receive the DICD; and a latching mechanism positioned between the cradle and the first support band. The second support band is pivotally connected to the first support band such that the underwater system is repositionable between an open position and a closed position, and the latching mechanism is repositionable between a locked position, in which the latching mechanism securely engages the DICD, and an unlocked position, in which the latching mechanism is disengaged from the DICD.

Abstract: The disclosure describes systems and methods for a stabilization mechanism. The stabilization mechanism may be used in conjunction with an imaging device. The method may be performed by a control system of the stabilization mechanism and includes obtaining a device setting from an imaging device. The method may also include obtaining a configuration of the stabilization mechanism. The method includes determining a soft stop based on the device setting, the configuration, or both. The soft stop may be a virtual hard stop that indicates to the stabilization mechanism to reduce speed as a field of view of the imaging device approaches the soft stop. The method may also include setting an image stabilization mechanism parameter based on the determined soft stop.

Abstract: A device includes an audio assembly and a housing defining an aperture that interfaces with the audio assembly at an interior surface of the housing. The device includes stanchions coupled to an exterior surface of the housing at a location of the aperture and a cover coupled to the stanchions and free of contact with the housing. The device includes a drainage channel extending between the cover, the exterior surface of the housing, and the stanchions. The drainage channel includes a first portion defining an inlet of the drainage channel, and the first portion has a first width defined by the stanchions. The drainage channel includes a second portion defining an outlet of the drainage channel, and the second portion has a second width defined by the stanchions. The stanchions are tapered in shape so that the first width is wider than the second width.

Abstract: An image capture device with beamforming for wind noise optimized microphone placements is described. The image capture device includes a front facing microphone configured to capture an audio signal. The front facing microphone co-located with at least one optical component. The image capture device further includes at least one non-front facing microphone configured to capture an audio signal. The image capture device further includes a processor configured to generate a forward facing beam using the audio signal captured by the front facing microphone and the audio signal captured by the at least one non-front facing microphone, generate an omni beam using the audio signal captured by the at least one non-front facing microphone, and output an audio signal based on the forward facing beam and the omni beam.

Abstract: An electronic device includes a body, electronic components contained in the body, and two finger members. The two finger members movable relative to the body between an extended state and a collapsed state. In the extended state, the two finger members extend outward from the body for receipt by a mount of an external support. In the collapsed state, the two finger members are collapsed toward the body. In the extended state, the two finger members may extend parallel with each other for receipt in parallel slots of the mount of the external support.

Abstract: Multiple single lens distortion regions and one or more boundary regions may be determined within an image. Individual single lens distortion regions may have pixel displacement defined by a single lens distortion and individual boundary regions may have pixel displacement defined by a blend of at least two lens distortions. Multiple lens distortions may be simulated within the image by shifting pixels of the image input positions to output positions based on locations of pixels within a single lens distortion region and the corresponding single lens distortion or within a boundary region and a blend of corresponding lens distortions.

Abstract: Vehicles such as unmanned air vehicles that are capable of movement from an open, flight configuration to an enclosed configuration in which all major flight components can be protected by an outer shell are disclosed. In the enclosed configuration, the vehicles can take on standard geometric shapes such as a rectangular prism, sphere, cylinder, or another shape, so as to not be recognizable as an unmanned air vehicle. Embodiments of vehicles can also include interchangeable and/or wireless motor arms, motor arms which are electrically connected to the remainder of the vehicle only when in an open configuration, remote controllers removably attached to the remainder of the vehicle, and clip or other attachment mechanisms for attachment to objects such as backpacks.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. Different field of view punchouts, such as wide field of view punchout and linear field of view punchout, may be used to stabilize the video. Different field of view punchouts may provide different stabilization margins to stabilize the video. The video may be stabilized by switching between different field of view punchouts based on the amount of stabilization margin needed to stabilize the video.

Abstract: An accessory for an image capture device is disclosed that includes: a body; a rotatable first support that is configured for connection to the image capture device; a second support that is pivotably reconfigurable between stowed and deployed configurations; and a third support including first and second legs that are pivotably connected to the body such that the third support is reconfigurable between collapsed and expanded configurations. In the stowed configuration, the second support is concealed within the body, and in the deployed configuration, the second support extends outwardly from the body to facilitate connection of the accessory to an ancillary product. In the collapsed configuration, the third support defines a grip for the image capture device, and in the expanded configuration, the body defines a third leg that cooperates with the first and second legs to provide a freestanding base for the image capture device.

Abstract: Systems and methods are disclosed for image capture. For example, systems may include an image capture module including an image sensor configured to capture images, a connector, and an integrated mechanical stabilization system configured to control an orientation of the image sensor relative to the connector; an aerial vehicle configured to be removably attached to the image capture module by the connector and to fly while carrying the image capture module; and a handheld module configured to be removably attached to the image capture module by the connector, wherein the handheld module includes a battery and an integrated display configured to display images received from the image sensor.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Methods and apparatus for just-in-time streaming media. Existing content delivery networks are optimized for providing mass media to many consumers. This delivery model is poorly suited to user-specific content. Exemplary embodiments of the present disclosure create a program instance that can service a client's media requests from their archival data. In one specific implementation, the archival data is stored segments that are ready for streaming; a content server may provide either a consolidated file or a media “quasi-stream” from the same storage object(s). The quasi-stream supports progressive playback (media playback as it is being downloaded.) The program instance provides the client device the illusion of a static file system, however client requested access to HTTP file downloads are provided in packets that are transmuxed/transcoded from archival data.

Abstract: A method for encoding images includes decoding a first encoded image to obtain a first decoded image, where the first decoded image includes a first decoded portion corresponding to a first encoded portion of the first encoded image and a second decoded portion corresponding to a second encoded portion of the first encoded image; decoding a second encoded image to obtain a second decoded image; combining the first decoded image and the second decoded image to obtain a single decoded image; and encoding the single decoded image to obtain a single encoded image that includes a third and a fourth encoded portions. Encoding the single decoded image includes obtaining the third encoded portion of the single encoded image by copying the first encoded portion of the first encoded image; and obtaining the fourth encoded portion of the single encoded image by encoding the second decoded portion using an encoder.

Abstract: The present teachings provide an image capture device including an optical system having a bayonet. The bayonet is connected to a body of the image capture device. The bayonet includes a forward surface, a rearward surface opposing the forward surface, and a bayonet axial surface; and. The optical system includes an integrated sensor and lens assembly (ISLA) extending away from the rearward surface of the bayonet; and a lens module extending away from the forward surface of the bayonet and comprising a lens module axial surface, wherein the lens module axial surface contacts the bayonet axial surface so that the lens module is axially aligned with the bayonet.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Abstract: An image capture device may detect presence of drop of liquid on its optical element during capture of visual content. The image capture device may effectuate removal of the drop of liquid from the optical element.

Abstract: An image capture device may include an image sensor, a processor, and memory. The image sensor may be configured to obtain an image. The processor may be configured to: generate a grid on the image forming tiles; determine a fringing level of each vertex of the vertices; sort all of the tiles based on the fringing level of each tile so that the tiles are sorted in a descending order from the tile with a highest of the fringing levels to the tile with a lowest of the fringing levels; and apply a fringing compensation to a subset of the sorted tiles to obtain a processed image. The memory may be configured to store the processed image.

Abstract: A motor controller of an unmanned aerial vehicle (UAV) is optimized to improve operation of the UAV. The motor control optimizations include controlling a motor of a UAV to reduce an operating temperature of the UAV, reducing an amount of latency or jitter resulting from motor operation, and applying a smoothing filter for motor operation. For example, controlling a motor of a UAV to reduce an operating temperature of the UAV can include using a temperature model for the unmanned aerial vehicle or an operating temperature measurement to determine a current operating temperature and comparing that current operating temperature to a threshold. If the threshold is exceeded, settings of the motor are adjusted to cause the motor to operate in a manner that reduces the current operating temperature.

Abstract: Consumption information associated with a user consuming video segments may be obtained. The consumption information may define user engagement during a video segment and/or user response to the video segment. Sets of flight control settings associated with capture of the video segments may be obtained. The flight control settings may define aspects of a flight control subsystem for the unmanned aerial vehicle and/or a sensor control subsystem for the unmanned aerial vehicle. The preferences for the flight control settings of the unmanned aerial vehicle may be determined based upon the first set and the second set of flight control settings. Instructions may be transmitted to the unmanned aerial vehicle. The instructions may include the determined preferences for the flight control settings and being configured to cause the unmanned aerial vehicle to adjust the flight control settings to the determined preferences.

Abstract: An image capture device includes a heatsink that absorbs thermal energy and a first component that generates thermal energy. The image capture device includes a second component that generates thermal energy and a first conductor that extends between the first component and the heatsink, and the first conductor moves thermal energy from the first component to the heatsink by conduction. The image capture device includes a second conductor that extends between the second component and the heatsink, and the second conductor has a portion perpendicularly extended relative to the first conductor. The second conductor moves thermal energy from the second component to the heatsink by conduction.

Abstract: A face located along a stitch line in a spherical image is detected by rendering views of regions of the spherical image along the stitch line. The spherical image may be produced by combining first and second images. A first view of a projection of the spherical image is rendered. A scaling factor for rendering a second view of the projection is determined based characteristics of the first portion of the face. The second view is then rendered according to the scaling factor. The use of the scaling factor to render the second view causes a change in the depiction of the second portion of the face. For example, the scaling factor can indicate to change the resolution or expected size of the second portion of the face when rendering the second view. A face is then detected within the spherical image based on the rendered first and second views.

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

Abstract: An image capture device is described that includes a body; a mounting structure that is connected to the body; an integrated sensor-lens assembly (ISLA) that defines an optical axis and extends through the body and the mounting structure; and an accessory that is releasably connectable to the mounting structure via rotation through a range of motion less than approximately 90 degrees. The mounting structure and the accessory include corresponding angled bearing surfaces that are configured for engagement such that rotation of the accessory relative to the mounting structure creates a bearing effect that displaces the accessory along the optical axis to thereby reduce any axial force required during connection and disconnection of the accessory.

Abstract: Media items captured by a media capture device may include and/or be associated with values of a clock-change identifier. The values of the clock-change identifier may be set based on when and how many times the time of the media capture device was changed. Based on a capture-time of a media item being incorrect, other media items with the same value of the clock-change identifier may be determined to be incorrect. Capture-times of the other media items may be corrected based on capture-time correction of the media item.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: An image capture device includes a housing that includes a pattern of apertures and a microphone disposed within the housing and proximate to the apertures. The image capture device includes a membrane assembly. The membrane assembly includes a support disposed between the housing and the microphone and a channel defined in the support that directs sound waves from only one of the apertures in the pattern to the microphone. The membrane assembly further includes a membrane that extends across the channel and separates the one of the apertures and the microphone.

Abstract: A remapping space may define correspondence between times within a video and times within a time-remapped video. Responsive to user selection of a moment within the video for initiation of time remapping using a selected playback speed, a start point and an end point may be inserted at the selected moment within the remapping space. Responsive to user selection of a segment within the video to apply the selected playback speed in the time remapping, the start point and/or the end point may be moved to change the correspondence between times within the video and times within the time-remapped video.

Abstract: A condition of an unmanned aerial vehicle (UAV) is detected using one or more sensors of the UAV and signaled according to an alert definition associated with the condition. For example, an alert definition can indicate to signal the condition by using a motor of the UAV to produce an audible tone. A tonal signal having a frequency within an audible spectrum can be generated according to the alert definition. The tonal signal and a drive signal used for supplying current to the motor can be combined to produce a combined signal. The combined signal can then be transmitted to the motor to cause the motor to produce the audible tone. In some cases, an amplitude of the tonal signal can be modulated, such as where the amplitude of the combined signal exceeds a threshold associated with an operating margin of the UAV.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. Context of the video may be assessed and used to suggest framing of the video.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.

Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

Abstract: A method and system for configuring a USB3 input/output port in a camera are disclosed. The method comprises responsive to an indication that a peripheral device is a non-USB3 device, remapping pins of the USB3 input/output port to a first predefined port configuration associated with an I2C protocol by remapping a RX1? pin to communicate a first I2C signal and remapping a RX1+ pin to communicate a second I2C signal, and responsive to successful authentication between the camera and the peripheral device via the I2C protocol, enabling communication with the peripheral device and remapping the pins of the USB3 input/output port to a second predefined port configuration compatible with operation of the authenticated peripheral device by remapping a TX2+ pin to communicate a first general purpose input/output signal and remapping a TX2? pin to communicate a second general purpose input/output signal.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: An image capture device may include a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Abstract: An image capture device may capture a video while experiencing motion. Motion of the image capture device during video capture may be determined based on optical flow and structure from motion solve of the video. Optical flow derived motion and/or the motion solve derived motion of the image capture device may be selected to perform stabilization of the video.

Abstract: Disclosed is an electronic motor with two bearings. The motor is structured so that, when loaded, the majority of the load (e.g., a radial load) is borne by one of the bearings. The bearing that bears a greater load may be larger and, thus, better suited for a heavy load. In some embodiments, the larger bearing may include rolling elements that have respective radii larger than respective radii of rolling elements of the other bearing by a ratio of at least 1.5 (150%). In some embodiments, the larger bearing may have an outer race with a radius that is greater than a radius of the outer race of the smaller bearing by a ratio of at least 1.5. In some embodiments, the motors may include a third bearing between the two bearings. The third bearing may reduce vibration in the motor.