Abstract: Systems and methods are disclosed for non-local means denoising of images. For example, methods may include receiving an image from an image sensor; determining a set of non-local means weights for the image; applying the set of non-local means weights to the image to obtain a first denoised image; applying the set of non-local means weights to the first denoised image to obtain a second denoised image; and storing, displaying, or transmitting an output image based on the second denoised image.

Abstract: A camera mounting system has an upper mount component, a lower mount component, and a base mount component. The upper mount component secures the camera and has a ball protrusion that reciprocally couples with a socket of the lower mount component. The upper mount component can rotate 360 degrees relative to the lower mount, and can pivot 90 degrees or more relative to the lower mount component. The lower mount component couples with the base mount component in a plurality of orientations. This camera mounting system allows for a large range of motion for the camera relative to the mounting system.

Abstract: Video content may be presented on a touchscreen display. A viewing window for the video content may define an extent of the video content presented on the touchscreen display. Reception of an automatic movement input by the touchscreen display during the presentation of the video content may be determined. The automatic movement input may include user engagement with the touchscreen display that moves along the touchscreen display to an edge of the touchscreen display during an input period. The movement along the touchscreen display may cause a movement of the viewing window during the input period. Based on the automatic movement input, the movement of the viewing window may be continued after the input period. The movement of the viewing window after the input period may be continuous with the movement of the viewing window during the input period.

Abstract: Image analysis and processing may include using an image processor to receive image data corresponding to an input image, determine an initial gain value for the image data based on at least one of a two-dimensional gain map or a parameterized radial gain model, determine whether the initial gain value is below a threshold, determine a maximum RGB triplet value for the image data where the initial gain value is below the threshold, determine a pixel intensity as output of a function for saturation management, determine a final gain value for the image data based on the maximum RGB triplet value and the pixel intensity, apply the final gain value against the image data to produce processed image data, and output the processed image data for further processing using the image processor.

Abstract: A video set of one or more videos may include video content having a progress length. The video content may be segmented into a sequence of video content segments. The sequence of video content segments may be provided for presentation on a display as individual video clips. Individual video content segments may be provided as individual video clips.

Abstract: A video edit of first video content and second video content may be generated based on the fields of view of the first video content and the second video content. Based on the fields of view of the first video content and the second video content, a first viewing window for the first video content and a second viewing window for the second video content may be determined. The viewing windows may define one or more extents of the corresponding visual content. The video edit may include a punchout of the first video content based on the first viewing window and a punchout of the second video content based on the second viewing window.

Abstract: An unmanned aerial vehicle manages storage of data and transfer between other connected devices. The unmanned aerial vehicle captures sensor data from sensors on the unmanned aerial vehicle. The unmanned aerial vehicle transfers the captured sensor data from the unmanned aerial vehicle to a remote controller via a wireless interface. The captured data may be transferred via a TCP link, a UDP link, or a combination thereof. If a loss of link is detected, the captured sensor data is stored to a buffer and a battery level of the unmanned aerial vehicle and a flight status of the unmanned aerial vehicle is monitored. The stored sensor data is transferred from the buffer to a non-volatile storage responsive to the battery level dropping below a predefined threshold or detecting that the unmanned aerial vehicle is stationary and a shutdown may be imminent.

Abstract: A frame rate is synchronized to a detected cadence in order to generate an output image sequence that is substantially stabilized. In an in-camera process, a camera receives motion data of the camera while the camera captures the sequence of image frames. A dominant frequency of motion is determined and the capture frame rate is dynamically adjusted to match the frequency of detected motion so that each image frame is captured when the camera is at approximately the same position along the axis of motion. Alternatively, in a post-processing process, frames of a captured image sequence are selectively sampled at a sampling rate corresponding to the dominant frequency of motion so that each sampled frame corresponds to an image capture that occurred when the camera is at approximately the same position along the axis of motion.

Abstract: A method for tracking a subject in successive image frames includes obtaining previous image frames with an imaging device, processing the previous image frames, obtaining motion information of the imaging device and a subject, determining a region of interest, obtaining a subsequent image frame, and processing the region of interest. The processing includes determining previous frame positions of the subject therein. The motion information is obtained with sensors physically associated with one or more of the imaging device and the subject. The region of interest is located in a predetermined spatial relationship relative to a predicted frame position of the subject.

Abstract: Image signal processing may include flare reduction, which may include obtaining a first input frame captured by a first image capture device of an image capture apparatus, the first image capture device having a first field-of-view, and the first input frame including lens flare corresponding to a primary light source; obtaining a second input frame captured by a second image capture device of the image capture apparatus, the second image capture device having a second field-of-view partially overlapping the first field-of-view; obtaining primary light source information corresponding to the primary light source based on the first input frame and the second input frame; obtaining a processed frame by modifying the first input frame based on the primary light source information to minimize the lens flare; and outputting the processed frame.

Abstract: Vehicles such as unmanned air vehicles that are capable of movement from an open, flight configuration to an enclosed configuration in which all major flight components can be protected by an outer shell are disclosed. In the enclosed configuration, the vehicles can take on standard geometric shapes such as a rectangular prism, sphere, cylinder, or another shape, so as to not be recognizable as an unmanned air vehicle. Embodiments of vehicles can also include interchangeable and/or wireless motor arms, motor arms which are electrically connected to the remainder of the vehicle only when in an open configuration, remote controllers removably attached to the remainder of the vehicle, and clip or other attachment mechanisms for attachment to objects such as backpacks.

Abstract: A variable pitch propeller is designed to adjust the pitch of the propeller blade during flight to maximize the propeller efficiency. The propeller blade may comprise airfoil cross-sections. Each cross-section may be composed of different materials at the leading edge and trailing edge. In various embodiments, these materials are selected and oriented to achieve the necessary elastic moduli of the leading and trailing edge for the airfoil cross-section. During liftoff, the airfoil at the blade tip possesses a high blade pitch (e.g. 20 degrees), thereby increasing the generated lift on the propeller blades. During flight or hover conditions when maximal lift is no longer required, the trailing edge of the airfoil displaces upward and reduces the blade pitch to minimize the drag forces on the blade tip.

Abstract: Media items may be obtained. The media items may be characterized by capture information indicating a capture time and a capture location of individual media items. The media items may be clustered into scenes based on proximity of the capture times of the media items. The scenes may be clustered into collections based on proximity of the capture times and/or the capture locations of the media items within the scenes. The collections may be iteratively clustered into higher collections based on proximity of the capture times and/or the capture locations of the media items within the collections. One or more collections may be identified for inclusion in a media compilation based on a size of the identified collection(s). A media compilation, including one or more of the media items included in the identified collection(s), may be generated.

Abstract: Physical storage media accessible to a remote device may store video information defining video content. The video content may be characterized by capture information. The remote device may transmit at least a portion of the capture information to a computing device. The computing device may identify one or more portions of the video content based on the transmitted capture information. The remote device may receive the identification of the identified portion(s) of the video content from the computing device. Responsive to the reception of the identification, the remote device may transmit the video information defining at least some of the identified portion(s) of the video content to the computing device.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; stitching the first image and the second image to obtain a stitched image; identifying an image portion of the stitched image that is positioned on a stitching boundary of the stitched image; and inputting the image portion to a machine learning module to obtain a score, wherein the machine learning module has been trained using training data that included image portions labeled to reflect an absence of stitching and image portions labeled to reflect a presence of stitching, wherein the image portions labeled to reflect a presence of stitching included stitching.

Abstract: A camera system includes a camera with a lens assembly and image processing electronics internal to the camera housing. The lens assembly and image processing electronics are sensitive to thermal gradients within the camera body. The image processing electronics are coupled to a thermal management system that transfers thermal energy away from the electronics towards a heat diffuser. The thermal management system comprises a heat controller with a heat source, an offset arm, and a heat exchange. The thermal energy moves from the heat source to the heat exchange via the offset arm. The thermal management system also manages heat transfer between auxiliary electronic components and the image processing electronics. The thermal management system is constructed of materials that react to the compressive forces created on the system during camera assembly.

Abstract: Video information may define spherical video content having a duration. Spherical video content may define visual content viewable from a point of view as a function of progress through the spherical video content. Path information may define a path selection for the spherical video content. Path selection may include movement of a viewing window within the spherical video content. The viewing window may define extents of the visual content viewable from the point of view as the function of progress through the spherical video content. Time lapse parameter information may define at least two of a time portion of the duration, an image sampling rate, and a time lapse speed effect. A time lapse video may be generated based on the video information, the path information, and the time lapse parameter information.

Abstract: Spherical visual content represented in an image space may be obtained. The spherical visual content may have been captured by image sensor(s) during a time duration. The spherical visual content may include phenomena caused by motion of the image sensor(s) and/or optical components that guide light onto the image sensor(s). A capture path taken by the image sensor(s) during the time duration may be determined. The capture path may reflect positions and orientations of the image sensor(s) during the time duration. A smoothed path may be determined based on the capture path. The smoothed path may have smoother changes in positions and/or orientations than the capture path. The image space may be warped based on a difference between the capture path and the smoothed path. The stabilized visual content may be determined by projecting the spherical visual content represented in the warped image space to a spherical projection space.

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

Abstract: Implementations are directed to providing a digital media editing environment for editing at least a portion of a digital video using a mobile device, establishing communication between the mobile device and a data source, receiving, from the data source, a first portion of the digital video, the first portion including a first set of frames including less than all frames of the digital video, applying an edit to the first portion of the digital video, while less than all frames of the first digital video are stored on the mobile device, subsequent to applying the at least one edit, receiving, from the data source, a second portion of the digital video, the second portion including a second set of frames, and storing an edited digital video including at least one frame of the first set of frames, at least one frame of the second set of frames, and the edit.

Abstract: First video information defining first video content may be accessed. The first video content may have been captured by a first image sensor from a first conveyance position. Second video information defining second video content may be accessed. The second video content may have been captured by a second image sensor from a second conveyance position. A first highlight criterion may be selected for the first video content based on the first conveyance position. A second highlight criterion may be selected for the second video content based on the second conveyance position. A first set of highlight moments within the first video content may be identified based on the first criterion. A second set of highlight moments within the second video content may be identified based on the second criterion. The identification of the first set of highlight moments and the second set of highlight moments may be stored.

Abstract: Consumption information associated with a user consuming video segments may be obtained. The consumption information may define user engagement during a video segment and/or user response to the video segment. Sets of flight control settings associated with capture of the video segments may be obtained. The flight control settings may define aspects of a flight control subsystem for the unmanned aerial vehicle and/or a sensor control subsystem for the unmanned aerial vehicle. The preferences for the flight control settings of the unmanned aerial vehicle may be determined based upon the first set and the second set of flight control settings. Instructions may be transmitted to the unmanned aerial vehicle. The instructions may include the determined preferences for the flight control settings and being configured to cause the unmanned aerial vehicle to adjust the flight control settings to the determined preferences.

Abstract: Images of a scene may be captured by a set of image capture devices. Overlapping areas of the images may be identified based on the topology of the set of image capture devices. Frontiers within the overlapping areas of the images may be identified based on borders of the images. Sample points for the images may be distributed along the frontiers. Warp parameters including an anti-symmetric warping portion and a symmetric warping portion may be determined at the sample points. Displacement values may be determined at the sample points based on the warp parameters. Warp maps for the images may be determined based on diffusion of the displacement values. Displacement maps for the images may be determined based on interpolation of the warp maps. The images may be modified based on the displacement maps.

Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.

Abstract: A first pattern associated with a performer may be recognized based upon visual information. A sensor carried by an unmanned aerial vehicle may be configured to generate output signals conveying the visual information. A first distance may be determined between the first pattern and the unmanned aerial vehicle. A second pattern associated with a performee may be recognized based upon the visual information. A second distance may be determined between the second pattern and the unmanned aerial vehicle. Flight control may be adjusted based upon the first distance and the second distance. A flight control subsystem may be configured to provide the flight control for the unmanned aerial vehicle.

Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

Abstract: A swivel mount locking apparatus is configured to mount a camera system onto a target user, an object, or a surface. The camera system is mounted on a swivel component which can be rotated to a variety of different positions relative to a base component. To fix the camera position, a locking protrusion of a release lever in the base component is compressibly inserted into a detent located on the swivel component. When a new orientation of the camera system is desired, a user may forcibly pivot the release lever away from the swivel component to decouple the locking protrusion from the detent. The user can then rotate the mounted camera system and the swivel component to the new orientation relative to the base component. At the new orientation, the user may recouple the locking protrusion of the release lever into a different detent of the swivel component, thereby fixing the camera system into the desired, new orientation.

Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.

Abstract: An infrared (IR) emitter projects a spherical IR pattern. The IR emitter may include one or more IR lasers to produce two IR laser beams, two beam expanders, two diffraction screens to each produce diffracted radiation, a top wide angle lens, and a bottom wide angle lens. The wide angle lenses may each receive diffracted radiation from a respective one of the diffractions screens and may emit a spherical IR pattern including a plurality of longitudinal lines, each longitudinal line including a first portion of the spherical IR pattern emitted from the top wide angle lens and a second portion of the spherical IR pattern from the bottom wide angle lens. The IR emitter may be part of an object detection system in an aerial vehicle.

Abstract: Images with an optical field of view may be captured by an image capture device. An observed trajectory of the image capture device reflecting the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device may be determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to the one portion of the observed trajectory may be determined based on a subsequent portion of the observed trajectory. Orientations of a capture field of view for the images with respect to the optical field of view of the images may be determined based on the capture trajectory. Video content may be generated based on visual content of the images within the capture field of view.

Abstract: Multiple punchouts of a video may be presented based on multiple viewing windows. The video may include visual content having a field of view. Multiple viewing windows may be determined for the video, with individual viewing window defining a set of extents of the visual content. Different punchouts of the visual content may be presented based on the different viewing windows. Individual punchout of the visual content may include the set of extents of the visual content defined by corresponding viewing window.

Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.

Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.

Abstract: Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.

Abstract: An integrated image sensor and lens assembly comprises a lens barrel holding camera lenses coupled to a lens mount. The lens mount is further coupled to an image sensor substrate that has an image sensor lying on an image plane. The optical distance between lenses and the image sensor is tuned such that the focal plane of the lenses coincides with the image plane. Due to thermal expansion, this optical distance may vary thereby to cause the focal plane of the lenses to shift away from the image plane. The integrated image sensor and lens assembly further comprises spacers that couple one or more lens elements to the lens barrel. The spacers and the lens elements are configured such that the optical distance is maintained to be constant or substantially constant.

Abstract: Disclosed is a system and method for reducing the total latency for transferring a frame from the low latency camera system mounted on an aerial vehicle to the display of the remote controller. The method includes reducing the latency through each of the modules of the system, i.e. through a camera module, an encoder module, a wireless interface transmission, wireless interface receiver module, a decoder module and a display module. To reduce the latency across the modules, methods such as overclocking the image processor, pipelining the frame, squashing the processed frame, using a fast hardware encoder that can perform slice based encoding, tuning the wireless medium using queue sizing, queue flushing, bitrate feedback, physical medium rate feedback, dynamic encoder parameter tuning and wireless radio parameter adjustment, using a fast hardware decoder that can perform slice based decoding and overclocking the display module are used.

Abstract: A condition of an unmanned aerial vehicle (UAV) is detected using one or more sensors of the UAV and signaled according to an alert definition associated with the condition. For example, an alert definition can indicate to signal the condition by using a motor of the UAV to produce an audible tone. A tonal signal having a frequency within an audible spectrum can be generated according to the alert definition. The tonal signal and a drive signal used for supplying current to the motor can be combined to produce a combined signal. The combined signal can then be transmitted to the motor to cause the motor to produce the audible tone. In some cases, an amplitude of the tonal signal can be modulated, such as where the amplitude of the combined signal exceeds a threshold associated with an operating margin of the UAV.

Abstract: Disclosed by way of example embodiments is a wireless communication system transmitting or receiving a wireless signal according to an orientation of the wireless communication system. In one aspect, the wireless communication system includes an antenna operable in different configurations. In each configuration, the antenna has a corresponding antenna gain in a direction with respect to the antenna. The wireless communication system further includes a sensor for determining an orientation of the wireless communication system. According to the determined orientation, the antenna is configured to transmit or receive the wireless signal in a corresponding configuration. Hence, the wireless communication system disposed in different orientations can successfully communicate with another wireless communication system.

Abstract: Apparatus and methods for identification of a coded pattern visible to a computerized imaging apparatus while invisible or inconspicuous to human eyes. A pattern and/or marking may serve to indicate identity of an object, and/or the relative position of the pattern to a viewer. While some solutions exist for identifying patterns (for example, QR codes), they may be visually obtrusive to a human observer due to visual clutter. In exemplary implementations, apparatus and methods are capable of generating patterns with sufficient structure to be used for either discrimination or some aspect of localization, while incorporating spectral properties that are more aesthetically acceptable such as being: a) imperceptible or subtle to the human observer and/or b) aligned to an existing acceptable visual form, such as a logo. In one variant, a viewer comprises an imaging system comprised as a processor and laser scanner, or camera, or moving photodiode.

Abstract: A camera housing can be configured as both a protective housing and a stand for a camera. The camera housing includes a housing body, an arm component, and a lid component. The housing body partially encloses the camera and exposes a lens of the camera. A first end of the arm component is coupled to the housing body via a first hinge, and a second end is coupled to the lid component via a second hinge. The arm component includes over-molded components configured to limit rotation of the arm component relative to the housing body and the lid component. In a folded configuration, the lid component reciprocally mates to the housing body to cover the camera lens. In an unfolded configuration, the arm component and the lid component are rotated away from the housing body, acting as a stand for the housing body.

Abstract: An unmanned aerial vehicle (“UAV”) receives location information describing geographic boundaries of a polygonal no-fly zone (“NFZ”), the NFZ having a plurality of virtual walls each associated with a geographic line segment. The UAV identifies a closest and a second closest virtual wall of the plurality of virtual walls of the NFZ to a geographic location of the UAV. The UAV determines a first distance from the location of the UAV to a portion of the closest virtual wall nearest to the location of the UAV and a second distance from the location of the UAV to a portion of the second closest virtual wall nearest to the location of the UAV. In response to the first and/or second determined distances being less than a threshold distance, the UAV modifies a velocity and/or a trajectory of the UAV such that the UAV does not cross the virtual walls.

Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.

Abstract: This disclosure relates to providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap. The UAV may include a housing, a motor, a first image sensor, a second image sensor, a first optical element having a first field of view greater than 180 degrees, a second optical element having a second field of view greater than 180 degrees, and one or more processors. The first optical element and the second optical element may be carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view, and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap. Flight control for the UAV may be provided based on parallax disparity of an object within the overlapping fields of view.

Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.