Abstract: Systems and methods are disclosed for lens water dispersion. For example, an image capture device may include a lens mounted on a body of the image capture device; an image sensor mounted within the body, behind the lens and configured to capture images based on light incident on the image sensor through the lens; and a dispersion structure around a perimeter of the lens on an external surface of the body, wherein the dispersion structure includes gaps sized to cause capillary action to move water away from the lens, from a first edge of the dispersion structure to a second edge of the dispersion structure.

Abstract: An image capture device may automatically capture images. An image sensor may generate visual content based on light that becomes incident thereon. A depiction of interest within the visual content may be identified, and one or more images may be generated to include one or more portions of the visual content including the depiction of interest.

Abstract: Systems and methods are disclosed for operation of image capture devices. For example, systems may include an image sensor configured to capture images; a mechanical stabilization system, including gimbals and motors, that is integrated with the image sensor and configured to control an orientation of the image sensor; and a processing apparatus configured to: detect an occurrence of a triggering event; and, responsive to the occurrence of the triggering event, send commands to motor controllers of the mechanical stabilization system to electronically control the gimbals and motors to assume a fold-flat position, maintain the fold-flat position for a time period, and, after the time period expires, power off the gimbals and motors.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: In one aspect of the present disclosure, a gimbal assembly is described for use with an image capturing device. The gimbal assembly includes a motor assembly, a first housing defining an internal compartment that is configured and dimensioned to receive the motor assembly, and a second housing that is mechanically connected to the motor assembly such that actuation of the motor assembly causes relative rotation between the first and second housings. The first housing includes a first guide that is configured and dimensioned to support transmission media adapted to communicate electrical and/or digital signals. The second housing defines a channel that is configured and dimensioned to receive the first guide such that the first guide extends into the second housing through the channel. The transmission media is supported on the first guide such that the first guide routes the transmission media from the first housing into the second housing.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: A method, system, and non-transitory computer-readable storage medium for temporal information synchronization of imaging devices are disclosed. The method comprises capturing media using an imaging device, generating a sequence identifier for each of the media, generating a timestamp for each of the media, determining that at least one of the media includes an unknown time tag, receiving an input including temporal information, determining a time offset between each timestamp and the temporal information, and updating the timestamp for each of the media that includes an unknown time tag using the time offset to provide an updated timestamp.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include accessing an image from an image sensor; detecting an object area on the image; classifying the object area on the image; applying a filter to an object area of the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

Abstract: Methods and apparatus for just-in-time streaming media. Existing content delivery networks are optimized for providing mass media to many consumers. This delivery model is poorly suited to user-specific content. Exemplary embodiments of the present disclosure create a program instance that can service a client's media requests from their archival data. In one specific implementation, the archival data is stored segments that are ready for streaming; a content server may provide either a consolidated file or a media “quasi-stream” from the same storage object(s). The quasi-stream supports progressive playback (media playback as it is being downloaded.) The program instance provides the client device the illusion of a static file system, however client requested access to HTTP file downloads are provided in packets that are transmuxed/transcoded from archival data.

Abstract: Multiple lookup tables (LUTs) storing different numbers of control point values are used to process pixels within different blocks of an image, such as after image processing using tone mapping and/or tone control, and/or to collect histogram information or implement 3D LUTs. First control point values stored within a first LUT are applied against pixels of a given block of an image to produce a distorted image block. Second control point values stored within a second lookup table are applied against a pixel of the distorted image block to produce a processed pixel. The second LUT is one of a plurality of second LUTs and stores fewer values than the first LUT. A processed image is produced using the processed pixel. The processed image is then output for further processing or display.

Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.

Abstract: Flare compensation includes receiving a first image and a second image; converting the first and the second images from an RGB domain to a YUV domain; obtaining an intensity differences profile along a stitch line between the first and the second images, where the intensity differences profile is obtained for the Y component; obtaining a dark corner intensity differences profile between the first and the second images based on a relative illumination of an area outside a first image circle of the first image and a second image circle of the second image, where the dark corner intensity differences profile is obtained for the Y component; obtaining a flare profile using the intensity differences profile and the dark corner intensity differences profile; converting the flare profile of the Y component to an RGB flare profile; and modifying one of the first or second images based on the RGB flare profile.

Abstract: A camera includes a lens, an image sensor, and a display. The lens and the image sensor are configured to capture images. The display may include an array of lights that are selectively illuminable to display the graphics. The lights may be arranged in a grid with each of the lights forming a pixel of the display. The display is hidden from view when not illuminated and displays graphics when illuminated. The camera may include a body that hides the display from view when not illuminated and permits light from the display to pass therethrough when illuminated. The body may include an elastomeric, light-permeable outer layer through which light from the display passes. The body may have a first side having the lens and on which the display displays the graphics. The camera may include a second display on a second side of the body facing opposite the first side.

Abstract: Placement of a face depicted within a video may be determined. One or more stabilization options for the video may be obtained. Stabilization option(s) may include angle stabilization option, a position stabilization option, and/or a size stabilization option. The video may be stabilized based on the placement of the face and the stabilization option(s).

Abstract: Breathable membranes for lens assemblies are described. For example, a system may include a lens barrel having an inner channel extending from a first end of the lens barrel to a second end of the lens barrel. The lens barrel can include one or more inner lenses positioned within the inner channel. The lens barrel has a vent hole in a side of the lens barrel that extends from the inner channel to an exterior surface of the lens barrel. The system includes a membrane attached to the lens barrel and positioned to cover the vent hole. The membrane has pores large enough to permit nitrogen gas to flow through the membrane and the vent hole.

Abstract: Devices and methods for sharing power between power sources are disclosed. The power sources may be internal to an electronic device, external to the electronic device, or both. An electronic device may include a power source, a switch circuit, a processor, and a power management integrated circuit (PMIC). The processor may determine a load current estimate. The load current estimate may be based on a device setting, an external temperature, or both. The processor may determine a power source voltage, an external power source voltage, or both. The processor may determine a power source current, an external power source current, or both. The PMIC may set an output power source current of the power source. The PMIC may set an output external power source current of the external power source.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include determining an orientation setpoint for an image sensor; based on a sequence of orientation estimates for the image sensor and the orientation setpoint, invoking a mechanical stabilization system to adjust an orientation of the image sensor toward the orientation setpoint; receiving an image from the image sensor; determining an orientation error between the orientation of the image sensor and the orientation setpoint during capture of the image; based on the orientation error, invoking an electronic image stabilization module to correct the image for a rotation corresponding to the orientation error to obtain a stabilized image; and storing, displaying, or transmitting an output image based on the stabilized image.

Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.

Abstract: Video information may define spherical video content having a duration. Spherical video content may define visual content viewable from a point of view as a function of progress through the spherical video content. Path information may define a path selection for the spherical video content. Path selection may include movement of a viewing window within the spherical video content. The viewing window may define extents of the visual content viewable from the point of view as the function of progress through the spherical video content. Time lapse parameter information may define at least two of a time portion of the duration, an image sampling rate, and a time lapse speed effect. A time lapse video may be generated based on the video information, the path information, and the time lapse parameter information.

Abstract: Disclosed is an electronic gimbal with camera and mounting configuration. The gimbal can include an inertial measurement unit which can sense the orientation of the camera and three electronic motors which can manipulate the orientation of the camera. The gimbal can be removably coupled to a variety of mount platforms, such as an aerial vehicle, a handheld grip, or a rotating platform. Moreover, a camera can be removably coupled to the gimbal and can be held in a removable camera frame. Also disclosed is a system for allowing the platform, to which the gimbal is mounted, to control settings of the camera or to trigger actions on the camera, such as taking a picture, or initiating the recording of a video. The gimbal can also provide a connection between the camera and the mount platform, such that the mount platform receives images and video content from the camera.

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions.

Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

Abstract: A video including visual content may be captured by an image capture device in motion. Stabilization performance information for the visual content may be determined. The stabilization performance information may characterize an extent to which desired stabilization is able to be performed using the visual content. The stabilization for the visual content may be changed based on the stabilization performance information.

Abstract: Optical element(s) of an image capture device may be changed. Characteristic(s) of the optical element(s) may be determined based on shading map corresponding to an image captured by the image capture device and the lighting condition during the capture of the image. The image capture device may be operated in accordance with the determined characteristic(s) of the optical element(s).

Abstract: After a command to stop recording a video is received, an image capture device may buffer footage in a buffer memory. The buffer memory may be used as a post-capture cache. The footage buffered in the buffer memory may be appended to the end of previously captured footage, appended to the beginning of subsequently captured footage, and/or used to bridge two separately captured footage.

Abstract: A video may be captured by an image capture device in motion. A stabilization trajectory for the video may reflect stabilization rotational positions to compensate for at least some of the motion of the image capture device. The stabilization trajectory may have a stabilization trajectory length. The stabilization of the visual content may be assessed based on the stabilization trajectory length.

Abstract: Videos may be automatically generated using a set of video clip. Individual moments of interest may be identified within individual video clips of a set of video clips. A moment of interest may correspond to a point in time within a video clip. The point in time may be associated with one or more values of one or more attributes of the video clip. Individual moments of interest may be associated with individual portions of a video. The video may be generated using the set of video clips based on the associations.

Abstract: Multiple videos having individual time durations may be obtained, including a first video with a first time duration. The videos may include visual information defined by one or more electronic media files. An initial portion of the first time duration where the one or more electronic media are to be transcoded may be determined, including determining whether the first time duration is greater than a predefined threshold and if the first time duration is greater than the predefined threshold, determining the initial portion to be an initial time duration that is less than the first time duration. One or more transcoded media files may be generated during the initial portion. A request for the first video may be received from a client computing platform. In response to receipt of the request, the one or more transcoded media files may be transmitted to the client computing platform for display.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: An unmanned aerial vehicle (“UAV”) receives location information describing geographic boundaries of a polygonal no-fly zone (“NFZ”), the NFZ having a plurality of virtual walls each associated with a geographic line segment. The UAV identifies a closest and a second closest virtual wall of the plurality of virtual walls of the NFZ to a geographic location of the UAV. The UAV determines a first distance from the location of the UAV to a portion of the closest virtual wall nearest to the location of the UAV and a second distance from the location of the UAV to a portion of the second closest virtual wall nearest to the location of the UAV. In response to the first and/or second determined distances being less than a threshold distance, the UAV modifies a velocity and/or a trajectory of the UAV such that the UAV does not cross the virtual walls.

Abstract: A playback of a video may be generated to include accompaniment of music. For parts of the video that includes voice, an instrumental version of the music may be used. For parts of the video that does not include voice, a singing version of the music may be used.

Abstract: A camera includes one or more microphone pairs. A first microphone (e.g., a main microphone) is ported to the outside of the camera and captures the desired external audio signal, but may also capture undesired vibrational noise. A second microphone has a similar structure to the first microphone, but is not ported to the outside of the camera. Instead, the second microphone is ported into an enclosed cavity (e.g., 1-2 cubic centimeters in volume). The second microphone may pick up the same vibration excitation and internal acoustic noise as the first microphone but very little of the desired external acoustic sounds around the camera. The unwanted noise can then be removed by subtracting the second audio signal from the second microphone from the main audio signal from the main microphone.

Abstract: A first pattern associated with a performer may be recognized based upon visual information. A sensor carried by an unmanned aerial vehicle may be configured to generate output signals conveying the visual information. A first distance may be determined between the first pattern and the unmanned aerial vehicle. A second pattern associated with a performee may be recognized based upon the visual information. A second distance may be determined between the second pattern and the unmanned aerial vehicle. Flight control may be adjusted based upon the first distance and the second distance. A flight control subsystem may be configured to provide the flight control for the unmanned aerial vehicle.

Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.

Abstract: Positions of an image capture device may be used to estimate a time-lapse video frame rate with which time-lapse video frames are generated. The time-lapse video frame rate may be adjusted based on apparent motion between pairs of generated time-lapse video frames. The adjusted time-lapse video frame rate may be used to generate additional time-lapse video frames.

Abstract: An image captured using an image sensor is processed to determine control statistics and to produce an altered image which can be output for display or further processing at an image capture device, and the image is then processed according to the control statistics to produce a processed image which can be output for display or further processing at the image capture device or at another device. The altered image may have a lower resolution than the processed image. The image may be stored in a buffer. For example, the image may be retrieved from the buffer to produce the altered image, and again retrieved from the buffer to produce the processed image. The altered image may replace the image within the buffer. For example, the processed image may be produced to represent the altered image at a higher resolution.

Abstract: An image capture device may capture visual content through a front-facing optical element. A portion of the visual content may be enlarged for presenting on a front-facing display of the image capture device. Extent of the visual content within the portion may be warped to increases size of depiction within the portion.

Abstract: An image capture device includes an image capture module and a base module. The image capture module is releasably connectable to the base module. The image capture module includes an integrated image sensor and optical component for capturing image data. The base module includes a processor. The processor is configured and the base module is calibrated based on identification data provided by the image capture module when releasably connected to the base module. The image information and identification data may be wirelessly transferred from the image capture module to the base module.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. An extent of the video duration to which the selected playback speed and selected playback direction is applied may be determined based on movement of the timeline representation.

Abstract: An image capture device may switch operation between a spherical capture mode or a non-spherical capture mode. Operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on the visual content generated by multiple image sensors. Operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content based on visual content generated by a single image sensor.