Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.

Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.

Abstract: An image capture device may include a display for presenting controls. The controls may be used by a user to operate the image capture device in capturing visual content. A control customization interface may include interface feature(s) that enables selection of one or more selectable controls for inclusion in a set of controls. Based on user interaction with the control customization interface, the set of controls may be determined and presented on the display.

Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.

Abstract: Systems and method to increase blurriness of visual content may be based on user control, field-of-view, and/or changes in field-of-view. By adding or increasing blurriness at the periphery of the field-of-view, more attention may be drawn to unblurred sections.

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

Abstract: A content visualization system generates visual content for a visualization device based on visual content of an event. The content visualization system collects visual content and source perspective data from visual content sources. The visualization device requests visual content from the content visualization system by providing device perspective data to the content visualization system. The content visualization system generates visual content for the visualization device based on the visual content from the visual content sources, the source perspective data, and the device perspective data. The content visualization system can determine visual content that is relevant to the device perspective by identifying source perspectives that overlap with the device perspective. The content visualization system generates visual content for the visualization device based on the identified visual content.

Abstract: Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV-capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.

Abstract: Image information defining an image may be accessed. The image may include one or more salient objects. A saliency map may be generated based on the image information. The saliency map may include one or more regions corresponding to the one or more salient objects. The one or more regions may be characterized by different levels of intensity than other regions of the saliency map. One or more salient regions around the one or more salient objects may be identified based on the saliency map. A saliency metric for the image may be generated based on one or more of (1) sizes of the one or more salient regions; (2) an amount of the one or more salient regions; and/or (3) histograms within the one or more salient regions.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

Abstract: Physical storage media accessible to a remote device may store video information defining video content. The video content may be characterized by capture information. The remote device may transmit at least a portion of the capture information to a computing device. The computing device may identify one or more portions of the video content based on the transmitted capture information. The remote device may receive the identification of the identified portion(s) of the video content from the computing device. Responsive to the reception of the identification, the remote device may transmit the video information defining at least some of the identified portion(s) of the video content to the computing device.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: An integrated image sensor and lens assembly may include a lens barrel, a collet, and a lens mount. The lens barrel may be coupled to the collet which is coupled to the lens mount. The lens barrel and the collet may each include a fastening structure reciprocal to each other. Alternatively, the collet and the lens mount may each include a fastening structure reciprocal to each other. The optical distance between the set of lenses and the image sensor may be tuned such that the focal plane of the lenses coincides with the image plane. The fastening structures allow the lens barrel to be adjusted relative to the lens mount in order to shift the focal plane in a direction along the optical axis to compensate for focal shifts occurring during assembly/cure and/or temperature cycling.

Abstract: A drainage system includes an inlet defined between a housing of a device and a first edge of a cover coupled to the housing. The cover protects an audio assembly disposed beneath the cover from an environment external to the device. The drainage system includes an outlet defined between the housing and a second edge of the cover and a drainage channel extending from the inlet to the outlet between an interior surface of the cover and an exterior surface of the housing. The drainage channel is configured to drain moisture from the audio assembly, and the inlet is configured to allow ambient audio to pass through the drainage channel to the audio assembly at a predetermined time period after the image capture device emerges from a liquid.

Abstract: Cameras may monitor its operation and automatically switch between operation modes thereby to best capture users' experiences. Auxiliary sensor data collected by the one or more sensors and/or captured image data may be analyzed to determine when a camera should switch to a high-motion operation mode. The auxiliary sensor data include motion information of the camera and the content of the captured images include motion information of the captured objects. When a camera or objects captured by the camera are moving rapidly, the camera is switched to operate at the high-motion operation mode to ensure image quality and minimize artifacts to best capture users' experiences. Motion of the camera may be detected or predicted by analyzing the auxiliary sensor data and motion of the captured objects may be detected by analyzing the captured image data thereby to determine whether or not the camera should switch to the high-motion operation mode.

Abstract: Multiple video segments may be obtained from a repository of video segments. A selection of a video segment from the multiple video segments may be received. The selected video segment may be presented at a first resolution via a display. A selection of a point in time during presentation of the video segment may be received to extract a frame set from the video segment at or near the selected point in time. The frame set may include multiple frames, including one frame corresponding to the selected point in time, and other frames that correspond to points in time adjacent to the selected point in time. A selection of a single frame within the frame set may be received. The single frame may be received having a second resolution. The second resolution may be higher than the first resolution. The single frame may be presented via the display.

Abstract: An unmanned aerial vehicle (“UAV”) receives location information describing geographic boundaries of a polygonal no-fly zone (“NFZ”), the NFZ having a plurality of virtual walls each associated with a geographic line segment. The UAV identifies a closest and a second closest virtual wall of the plurality of virtual walls of the NFZ to a geographic location of the UAV. The UAV determines a first distance from the location of the UAV to a portion of the closest virtual wall nearest to the location of the UAV and a second distance from the location of the UAV to a portion of the second closest virtual wall nearest to the location of the UAV. In response to the first and/or second determined distances being less than a threshold distance, the UAV modifies a velocity and/or a trajectory of the UAV such that the UAV does not cross the virtual walls.

Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Abstract: To compensate for this change in focal length due to a temperature change, an integrated image sensor and lens assembly includes a shift measurement module to measure a shift between optical elements to which the shift measurement module is coupled. The measured shift between optical elements is used to determine a shift of the focal plane in reference to the image plane. Optical aberration resulting from the shift of the focal plane in reference to the image plane may further be compensated.

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract: Motion within first video content and second video content may be assessed. A match between the motions assessed within the first video content and the second video content may be determined. The match may including a first set of video frames within the first video content and a second set of video frames within the second video content within which the matching motion is present. A first video portion (including frame(s) of the first set of video frames) of the first video content and a second video portion (include frame(s) of the second set of video frames) of the second video content may be identified based on the match. The first video portion and the second video portion may be concatenated to provide a transition between the first video portion and the second video portion in which continuity of motion may be achieved.

Abstract: Audio information defining audio content may be accessed. The audio content may have a duration. The audio content may be segmented into audio segments. Individual audio segments may correspond to a portion of the duration. Feature vectors of the audio segments may be determined. The feature vectors may be processed through a classifier. The classifier may output scores on whether the audio segments contain voice. One or more of the audio segments may be identified as containing voice based on the scores and a two-step hysteresis thresholding. Storage of the identification of the one or more of the audio segments as containing voice in one or more storage media may be effectuated.

Abstract: Users desiring to generate videos from video clips may want to locate moments of interest within the video clips. A system and method described herein may be configured to provide recommendations of moments of interest within video clips post capture of the video clips. User accounts associated with users of the system may include preference information that defines user preferences with respect to values of attributes of video clips. Moments of interest may be identified within individual video clips when the individual video clips have at least one value of at least one attribute specified by the user preferences. Recommendations of identified moments of interest may be provide to users.

Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.

Abstract: Video information defining video content may be accessed. Highlight moments within the video content may be identified. Flexible video segments may be determined based on the highlight moments. Individual flexible video segments may include one or more of the highlight moments and a flexible portion of the video content. The flexible portion of the video content may be characterized by a minimum segment duration, a target segment duration, and a maximum segment duration. A duration allocated to the video content may be determined. One or more of the flexible video segments may be selected based on the duration and one or more of the minimum segment duration, the target segment duration, and/or the maximum segment duration of the selected flexible video segments. A video summary including the selected flexible video segments may be generated.

Abstract: Protected microphone systems may include one or more dampeners, one or more cavities, or a combination thereof to minimize the vibration sensitivity of a microphone of the protected microphone systems. The dampeners, when present, may be constructed of a foam material or a thin metal material.

Abstract: A video, such as a spherical video, may include motion due to motion of one or more image capture devices during capture of the video. Motion of the image capture devices during the capture of the video may cause the playback of the video to appear jerky/shaky. The video may be stabilized by using both a horizontal feature and a fixed feature captured within the video.

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Abstract: Feature information characterize features of video clips may be obtained. A given video clip may be selected as a segment of a video edit. Other video clips may be iteratively selected as other segments of the video edit based on the feature information of the video clips and recommended feature information of the segments. Recommended feature information of a particular segment may be obtained by processing feature information of a previously selected video clip through a trained recurrent neural network. Video edit information defining the video edit may be generated. The video edit may include the selected video clips as the segments of the video edit.

Abstract: Convolutional neural network information may define a convolutional neural network including layers. The layers may define operations on an input to the convolutional neural network. The layers in the convolutional neural network information may be formatted as shaders. Input information defining the input to the convolutional neural network may be accessed. The input information may be formatted as an array of textures. The shaders may be applied to the textures to effectuate processing the input to the convolutional neural network through the layers of the convolutional neural network. One or more results may be obtained from applying the shaders to the array of textures.

Abstract: An image capture system includes an image capture device and an integrated sensor-optical component accessory. The integrated sensor-optical component accessory is releasably connectable to the image capture device and includes identification data. A processor in the image capture device configures itself and the image capture device based on the identification data. Image data from the integrated sensor-optical component accessory is processed and image data from the image capture data is either processed or ignored depending on the configuration. In an implementation, attachment information may also be used for configuration. In an implementation, multiple integrated sensor-optical component accessories may be connected to the image capture device. In an implementation, the center axis of the fields of view of the image capture device and the integrated sensor-optical component accessory may be in different directions or the same direction, and the fields of view may be overlapping or non-overlapping.

Abstract: This disclosure relates to systems and methods for vehicle guidance. Stereo images may be obtained at different times using a stereo image sensor. A depth image may be determined based on an earlier obtained pair of stereo images. The depth image may be refined based on predictions of an earlier stereo image and a later obtained stereo image. Depth information for an environment around a vehicle may be obtained. The depth information may characterize distances between the vehicle and the environment around the vehicle. A spherical depth map may be generated from the depth information. Maneuver controls for the vehicle may be provided based on the spherical depth map.

Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.

Abstract: Implementations are directed to providing an edit profile including one or more suggested edits to a digital video, actions including receiving metadata associated with the digital video, the metadata including data representative of one or more of movement and an environment associated with recording of the digital video, processing the metadata to provide a suggested edit profile including at least one set of effects, the at least one set of effects including one or more effects configured to be applied to at least a portion of the digital video, providing a respective graphical representation of individual effect of the one or more effects within an effect interface, and receiving, through the effect interface, a user selection of a set of effects of the suggested edit profile, and in response, storing, in computer-readable memory, an edit profile comprising the set of effects for application to the digital video.

Abstract: Generating a time-lapse is disclosed. A method includes acquiring, using a camera, a first frame of the time-lapse; acquiring, using the camera, one or more preview images, the preview images are not included in the time-lapse; determining an exposure setting for a second frame of the time-lapse using the one or more preview images; and acquiring, using the camera, the second frame of the time-lapse using the exposure setting. A camera includes a memory and a processor. The processor is configured to execute instructions stored in the memory to acquire a first frame of the time-lapse; acquire one or more preview images, the preview images are not included in the time-lapse; determine an exposure setting for a second frame of the time-lapse using the one or more preview images; and acquire the second frame of the time-lapse using the exposure setting.

Abstract: Image signal processing may include desaturation control, which may include adaptive desaturation control. Image signal processing with desaturation control may include obtaining, by an image signal processor, from an image sensor, an input image signal representing an input image, obtaining, by the image signal processor, color correction information for the input image, obtaining a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized, and outputting the color corrected image.

Abstract: A camera detects devices, such as other cameras, smart devices, and access points, with which the camera may communicate. The camera may alternate between operating as a wireless station and a wireless access point. The camera may connect to and receive credentials from a device for another device to which it is not connected. In one embodiment, the camera is configured to operate as a wireless access point, and is configured to receive credentials from a smart device operating as a wireless station. The camera may then transfer the credentials to additional cameras, each configured to operate as wireless stations. The camera and additional cameras may connect to a smart device directly or indirectly (for instance, through an access point), and the smart device may change the camera mode of the cameras. The initial modes of the cameras may be preserved and restored by the smart device upon disconnection.

Abstract: A camera housing includes a main body having four sides that form a cavity to receive a camera, a door detachably coupled to the main body, and an exposed area in the main body allowing a user to manipulate a button on the camera or access an I/O or microphone interface of the camera. The camera housing includes an indicator window substantially aligning with a visible indicator on the camera, a latch detachably securing a first side of the door to a first side of the main body; and a hinge coupling a second side of the door to a second side of the main body. The camera housing includes securing protrusions that interlock with corresponding mounting protrusions extending from a camera mount. A front face and a rear face of the camera are exposed when the camera is secured by the door in the camera housing.

Abstract: Apparatus and methods for encoding panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube, equirectangular or any other projection e.g., icosahedron or octahedron. Projection may be selected adaptively based on evaluation of the panoramic content. Content evaluation may include obtaining rate distortion cost metric for a given projection configuration including projection type, projection arrangement, and projection orientation. Projection configuration with the lowest cost may be selected as target projection for encoding content. As content composition changes (e.g., object motion, texture presence and/or location) projection may be adaptively selected to match changes in the content. Adaptive content selection methodology may provide for a lower encoded bitrate for a given encoded quality and/or higher quality for a given bitrate.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Abstract: A capture settings for one or more image capture devices may be determined. The capture setting may define one or more aspects of operation for the image capture device(s). The aspect(s) of operation for the image capture device(s) may include one or more aspects of operation for a processor of the image capture device(s), an image sensor of the image capture device(s), and/or an optical element of the image capture device(s). A machine-readable optical code may be generated based on the capture setting and/or other information. The machine-readable optical code may convey the capture setting for the image capture device(s) such that a first image capture device capturing a first image including the machine-readable optical code may: (1) identify the machine-readable optical code within the first image; (2) determine the capture setting conveyed by the machine-readable optical code; and (3) operate in accordance with the capture setting.

Abstract: Videos may be automatically generated using a set of video clip. Individual moments of interest may be identified within individual video clips of a set of video clips. A moment of interest may correspond to a point in time within a video clip. The point in time may be associated with one or more values of one or more attributes of the video clip. Individual moments of interest may be associated with individual portions of a video. The video may be generated using the set of video clips based on the associations.

Abstract: An underwater housing includes a mounting plate, a first dome attached to a first surface of the mounting plate, and a second dome attached to a second surface of the mounting plate in a back-to-back configuration. A camera mount for a dual-lens camera is oriented at a tilt angle relative to a plane of a mounting plate. The dual-lens camera has laterally offset back-to-back lenses. The tilt angle is set such that the optical axes of the dual-lens camera intersect the center points of the respective domes.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Abstract: Systems and methods for identifying comment clusters for panoramic content segments. A panoramic content segment of digital content may be hosted to client computing platforms. User comment information may be received. The user comment information may convey user comments, include time indications for a duration of a content segment, and/or include location indications for a panorama of the panoramic content segment. A comment distribution may be determined from the user comment information. A comment cluster may be identified based on the comment distribution. View information may be received from a client computing platform. Whether a view range associated with the comment cluster identified is located within or outside one or more visible ranges of viewing angles selected by the user may be determined. Alert information may be generated and/or transmitted for effectuating presentation of a notification on the client computing platform associated with the user.