Abstract: Electronic information defining visual content within video frames may be accessed. Video frames may be ordered in a source sequence. Positions in the source sequence may be associated with playback directions. Video frames may be ordered in a playback sequence based on the playback directions. The playback sequence may characterize a playback order in which video frames are displayed during playback. Video frames in the playback sequence may be associated with playback speeds. The playback speeds may determine perceived speeds with which visual content is displayed during playback. Speed ramped video frames may be determined based on the playback sequence and the playback speeds. A speed ramped video may be generated based on the speed ramped video frames.

Abstract: Various embodiments of an unmanned aerial vehicle are disclosed. In some embodiments, the UAV includes a motor assembly rotatable about a rotation axis and a propeller hub assembly removably engageable with the motor assembly. The propeller hub assembly includes a retainer configured and dimensioned for engagement with the motor assembly such that rotation of the motor assembly causes corresponding rotation of the propeller hub assembly. The retainer includes a pair of deflectable arms resiliently repositionable between a first position and a second position, for engagement and disengagement with the motor assembly, respectively. The arms are movable inwardly towards the rotation axis from the first position to the second position upon application of an external force and movable outwardly away from the rotation axis from the second position to the first position upon removal of the external force.

Abstract: Image signal processing may include obtaining a first portion of a first input image, the first portion having a defined width, a defined height, and a defined portion size, which is a product of multiplying the defined width by the defined height, the first portion of the first input image including a first set of image elements in raster order and having a cardinality of the defined portion size. Image signal processing may include sequential in-place blocking transposition of the first input image, which may include using a buffer, omit using another buffer, and has linear complexity, and may include buffering the first set of image elements using the buffer, the buffer having a defined buffer size within twice the defined portion size, and outputting the first set of image elements from the buffer in block order.

Abstract: An image may include depictions of different parts of a scene, such as the ground, the sky, and objects between the ground and the sky. The image may be divided into multiple bands, and the image may be scored based on colors of pixels within different bands of the image.

Abstract: Video edit information, video modification information, and/or other information may be obtained. Video edit information may define a video edit of video content. Video edit may include one or more portions of the video content and may have a progress length. Video modification information may define one or more criteria for modifying the video edit. One or more portions of the video edit may be identified based on the video modification information. The portion(s) of the video edit may be modified based on the video modification information. A revised video edit information may be generated. The revised video edit information may define a revised video edit of the video content. The revised video edit may include the portion(s) of the video edit modified based on the video modification information. The revised video edit may have a progress length shorter than the progress length of the video edit.

Abstract: Video information may define video content. The video content may be characterized by capture information. A remote device may transmit at least a portion of the capture information to a computing device. The computing device may identify one or more portions of the video content based on the transmitted capture information. The remote device may receive the identification of the identified portion(s) of the video content from the computing device. The remote device may stream one or more portions of the video information defining at least some of the identified portion(s) of the video content to the computing device. The streamed video information may enable the computing devices to provide a presentation of at least some of the identified portion(s) of the video content using a buffer of the streamed video information, which may allow the computing device to present the video content without permanently storing the video information.

Abstract: Variable image projection for spherical visual content may be provided by obtaining visual information defining an image of the spherical visual content and a field of view for the spherical visual content. A location of a projection point may be determined based on the field of view. A two-dimensional projection of the spherical visual content may be determined by projecting pixels of the image within the field of view to the two-dimensional projection plane. Individuals pixels of the image may be projected along individual projection lines including the projection point and the individual pixel. Presentation of the two-dimensional projection of the spherical visual content may be effectuated.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. A punchout of the video may provide a framing of the captured scene. The punchout may be determined based on the context of the video, such as the type of captured scene within the video, the motion of the image capture device that captured the video, and/or the motion of one or more things within the captured scene.

Abstract: Visual content may be captured by an image capture device during a capture duration. The rotational positions of the image capture device may change during the capture duration. The rotational positions of the image capture device may be smoothed based on a look ahead of a rotation constraint. A punchout of the visual content may be determined based on the smoothed rotational positions. The punchout of the visual content may be used to generate stabilized visual content.

Abstract: A method and system are described. The method includes capturing a set of images from an array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from an additional camera, the additional camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.

Abstract: Image signal processing including generating image signal processing based encoding hints for motion estimation may include an image signal processor obtaining an input image portion of an input image from the input image signal, generating motion information for the input image portion, processing the input image portion based on the motion information, outputting processed image data, and outputting the motion information as encoding hints, such that the motion information is accessible by an encoder for generating an encoded output bitstream by obtaining the processed image data as source image data, obtaining the motion information, generating prediction data for encoding the source image data based on the motion information, generating encoded image data based on the prediction data, and including the encoded image data in an encoded output bitstream.

Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed.

Abstract: Systems and methods are disclosed for generating long exposure images for high dynamic range processing. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving an additional image that was captured using the image sensor; determining a long exposure image based on the short exposure image and the additional image; applying high dynamic range processing to the short exposure image and the long exposure image to obtain an output image with a larger dynamic range than the short exposure image; and transmitting, storing, or displaying an image based on the output image.

Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.

Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

Abstract: An unmanned aerial vehicle comprises a housing, a plurality of first arms, a plurality of second arms, and a landing gear. The housing includes a gimbal attachment to couple a gimbal with a camera. Each of the plurality of first arms and the plurality of second arms rotatably couple with the housing at one end and has a motor coupled with a propeller on the other end. The landing gear includes a plurality of foldable legs and releasably couples with an underside of the housing. The aerial vehicle may be programmed with aerial flight path data that corresponds with a prior traced route.

Abstract: A camera housing includes four walls configured to enclose and secure a camera: a top wall, a bottom wall, a right wall, and a left wall. The bottom wall includes a first segment and a segment coupled by a latching mechanism. The latching mechanism comprises a tongue component coupled to the second segment and a groove component coupled to the first segment. The tongue and groove components are configured such that the tongue component securely couples the second segment to the first segment when the camera frame is in the closed configuration. In the open configuration, the first and second segment can decouple and the left wall and second segment rotates upwards relative to the top wall such that a camera can be inserted or removed from the camera system. The camera housing also includes a button interface, an input/output interface, and a mounting mechanism.

Abstract: Color correction is integrated within global tone mapping operations to modify an image captured using an image capture device. New luminance values are determined for the pixels of the image by performing global tone mapping against those pixels using one or more sets of color correction values, which are applied against respective luminance values and color components of those pixels. The sets of color correction values are identified within 3×3 color correction matrices. A gain curve for modifying contrast values of the image is determined based on at least one of the new luminance values. A modified image is then generated by modifying the contrast values according to the gain curve, for example, by applying a gamma curve against the contrast values using data stored in a three-dimensional lookup table.

Abstract: A gimbal mount system is configured to a couple to a gimbal coupled to and securing a camera. The gimbal mount system includes a handle, a power source, a user interface, a mounting interface, a communication interface, and a communication bus. The mounting interface is located within an end of the gimbal mount system and includes an opening configured to receive a reciprocal mounting protrusion of the gimbal. A locking mechanism removably couples the gimbal to the gimbal mount system. The communication interface is located within the mounting interface and is configured to couple to a reciprocal communication interface of the gimbal. The communication bus is coupled to the power source, user interface, and communication interface and is configured to provide power from the power source to the gimbal. The communication bus may provide instructions to the gimbal based on user input received via the user interface.

Abstract: An integrated image sensor and lens assembly comprises an image sensor substrate comprising an image sensor, a lens mount coupled to the image sensor substrate, a tube adapter extending into a channel of the lens mount, and a lens barrel housing a set of lenses for directing light to the image sensor. The lens barrel has a threaded portion that extends into the tube adapter. An upper subsection of the lens mount and a lower subsection of the lens barrel are unthreaded.

Abstract: An expansion module includes an expansion accessory and expansion fastening structures that removably couple the expansion module to retention features of a housing of an image capture device when an access door of the image capture device is in a removed position. The expansion module also includes an expansion communication interface that couples an imaging communication interface of the image capture device when the access door of the image capture device is in the removed position. The retention features include hinge structures and cavities defined in the housing of the image capture device. The expansion fastening structures comprise hinge structures and latch structures that engage the retention features of the housing of the image capture device.

Abstract: Multiple image capture devices may individually generate time information and capture images. Individual image captures devices may receive time information of other image capture device(s). Individual image capture devices may transmit its time information to other image capture device(s) independent of reception of the time information of other image capture device(s). Individual image capture devices may generate time synchronization information for the captured images based on its time information and the received time information of other image capture device(s). Images captured by different image capture devices may be time-synchronized based on at least one of generated time-synchronization information.

Abstract: Video information and sensor information may be obtained. The video information may define spherical video content having a progress length. The spherical video content may define visual content viewable from a point a view as a function of progress through the progress length of the spherical video content. The spherical video content may be captured by one or more image capture devices. The sensor information may characterize capture of the spherical video content. A viewing direction for the spherical video content may be determined based on the sensor information and/or other information. The viewing direction may define a direction of view for the spherical video content from the point of view as the function of progress through the progress length of the spherical video content. The spherical video content may be presented on a display based on the viewing direction.

Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

Abstract: Spherical video content may have a progress length and include spherical video frames that define visual content viewable from a point of view as a function of progress through the progress length. Edits for the spherical video content may be used to generate an edit tree. The edit tree may include nodes corresponding to the edits and edges connecting different nodes. An edit of the spherical video content may be generated based on the edit tree.

Abstract: A three-dimensional lookup table may map input colors from an electronic file defining the input colors based on input pixel locations to output colors on a display medium based on output pixel locations. A filter may characterize one or more color transformations of an unfiltered image to a filtered image such that applying the filter to the unfiltered image generates the filtered image. The filter may be applied to the three-dimensional lookup table to generate a filtered three-dimensional lookup table. The filtered three-dimensional lookup table may map the input colors to filtered output colors such that a display of the unfiltered image based on the filtered three-dimensional lookup table simulates a display of the filtered image. An image may be displayed based on the filtered three-dimensional lookup table to simulate a display of the image after the filter is applied the image.

Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

Abstract: Media capture apparatus and methods for obtaining metadata. Metadata may be collected and stored in a container independent of audio and/or image (media) content. Some container implementations may be configured to store metadata for a given interval, and media content for a portion of the interval. In action camera implementations, metadata may provide a context related to time, physical conditions of a person, location, surroundings of the video capture. In event recording applications, the metadata container may provide information related to a timeline of the event, environmental conditions, proximity of other capture devices. Metadata may be utilized for processing, viewing, and/or sharing of media content. Individual capture devices may communicate and/or combine metadata to one another in order to expand metadata content. Metadata, video and/or images may be shared between users and/or devices using a container.

Abstract: Video information defining video content may be accessed. Music information defining a music track providing an accompaniment for video content may be accessed. The music track may have pulses and one or more music events. Individual music events may correspond to different moments within the music track. One or more music events may be individually classified into one or more categories based on intensities of one or pulses occurring within the music event. One or more visual effects may be selected for different moments within the music track based on the categories of the music events. One or more visual effects may be applied to the video content. One or more visual effects may be applied to one or more moments within the video content aligned to one or more different moments within the music track.

Abstract: Disclosed is a configuration of an autonomous vehicle for autonomously following a moving subject based on a radius of a virtual sphere surrounding the autonomous vehicle. The autonomous vehicle may be an unmanned ground vehicle or an unmanned aerial vehicle, which autonomously follows the subject (e.g., a device, a live entity, or any object) based on the virtual sphere. The radius of the virtual sphere may be dynamically configured according to a velocity of the autonomous vehicle or configurations of a camera coupled to the autonomous vehicle. Accordingly, the autonomous vehicle can follow the subject along a smooth trajectory, and capture images of abrupt movements of the subject in a cinematically pleasing manner.

Abstract: A camera system with image and audio capture capabilities is configured to protect the internal audio components from the external environment. The camera system includes an internal audio assembly with a microphone and an audio circuit board. The audio circuit board is structured such that a gap exists within the board that allows transmission of sound waves from external the environment to the microphone. The audio assembly also includes a compressible annulus, a support annulus, and a waterproof membrane coupled by a support structure. The waterproof membrane protects the internal components from moisture while still allowing transmission of sound waves. The support structure, compressible annulus, support annulus, and audio circuit board are structured such that a gap exists above the microphone and underneath the waterproof membrane.

Abstract: A camera system with six faces and a front housing is configured to capture images and audio content from external the camera body. The camera system includes an interior audio assembly protected from external environments by a waterproof membrane. The camera system includes drainage ports on the bottom face and the left face of the camera system to encourage moisture to drain from the system. A first drainage channel couples the internal audio assembly to the first drainage port on left face of the camera system and a second drainage channel couples the drainage port on the left face of the camera system to the drainage port on the bottom face of the camera system. A third drainage channel exists between the front face of the camera system and the front housing, the third drainage channel coupling the first and second drainage channels.

Abstract: An aerial vehicle platform includes an aerial vehicle, a gimbal coupled to the aerial vehicle, and a camera mounted to the gimbal. An attitude sensing system includes an inertial measurement unit to sense attitude and an attitude adjustment module to generate an attitude adjustment for adjusting the sensed attitude to compensate for drift error.

Abstract: In one aspect of the present disclosure, a module is disclosed for use with a digital image capturing device (DICD) including an integrated sensor-lens assembly (ISLA). The module includes a cradle configured for connection to a housing of the DICD, and at least one dampener that is configured for positioning between the module and the housing of the DICD to reduce vibrations transmitted to the ISLA.

Abstract: A camera system configuration generates 2D or 3D images capable of being stitched together to create panoramic images. The configuration detects a communication coupling of at least two cameras for capturing a sequence of images. The cameras themselves are configured such that their rolling shutters mitigate field of view artifacts from adjacent cameras (2D panoramas) and adjacent 3D camera pairs (3D panoramas) by allowing for the substantially temporally-aligned capture of light in overlap regions between adjacent cameras.

Abstract: Systems and methods are disclosed for image capture. For example, methods may include accessing a sequence of images from an image sensor; determining a sequence of parameters for respective images in the sequence of images based on the respective images; storing the sequence of images in a buffer; determining a temporally smoothed parameter for a current image in the sequence of images based on the sequence of parameters, wherein the sequence of parameters includes parameters for images in the sequence of images that were captured after the current image; applying image processing to the current image based on the temporally smoothed parameter to obtain a processed image; and storing, displaying, or transmitting an output image based on the processed image.

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: Disclosed is a system and method for calibrating a magnetometer. The method comprises responsive to a determination that a magnetic inclination is less than a threshold, measuring first magnetic field data by detecting a magnetic field with the magnetometer through a first rotation path, measuring second magnetic field data by detecting the magnetic field with the magnetometer through a second rotation path, and determining calibration values for the magnetometer based on the measured first magnetic field data and the measured second magnetic field data.

Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.

Abstract: A system and/or method configured to determine highlight segments. Content files that define content in a content segment set may be obtained. A highlight segment set may be determined from the content segment set. Determining the highlight segment set may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the content segment set may be selected as a selected content segment for inclusion in the highlight segment set. At, (b) diversity scores for content segments that are (i) included in the content segment set and (ii) not yet selected for inclusion in the highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the highlight segment set for future iterations based on the diversity scores.

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.

Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image.

Abstract: Multiple videos having individual time durations may be obtained, including a first video with a first time duration. The videos may include visual information defined by one or more electronic media files. An initial portion of the first time duration where the one or more electronic media are to be transcoded may be determined, including determining whether the first time duration is greater than a predefined threshold and if the first time duration is greater than the predefined threshold, determining the initial portion to be an initial time duration that is less than the first time duration. One or more transcoded media files may be generated during the initial portion. A request for the first video may be received from a client computing platform. In response to receipt of the request, the one or more transcoded media files may be transmitted to the client computing platform for display.