Abstract: Vehicles such as unmanned air vehicles that are capable of movement from an open, flight configuration to an enclosed configuration in which all major flight components can be protected by an outer shell are disclosed. In the enclosed configuration, the vehicles can take on standard geometric shapes such as a rectangular prism, sphere, cylinder, or another shape, so as to not be recognizable as an unmanned air vehicle. Embodiments of vehicles can also include interchangeable and/or wireless motor arms, motor arms which are electrically connected to the remainder of the vehicle only when in an open configuration, remote controllers removably attached to the remainder of the vehicle, and clip or other attachment mechanisms for attachment to objects such as backpacks.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. Different field of view punchouts, such as wide field of view punchout and linear field of view punchout, may be used to stabilize the video. Different field of view punchouts may provide different stabilization margins to stabilize the video. The video may be stabilized by switching between different field of view punchouts based on the amount of stabilization margin needed to stabilize the video.

Abstract: An accessory for an image capture device is disclosed that includes: a body; a rotatable first support that is configured for connection to the image capture device; a second support that is pivotably reconfigurable between stowed and deployed configurations; and a third support including first and second legs that are pivotably connected to the body such that the third support is reconfigurable between collapsed and expanded configurations. In the stowed configuration, the second support is concealed within the body, and in the deployed configuration, the second support extends outwardly from the body to facilitate connection of the accessory to an ancillary product. In the collapsed configuration, the third support defines a grip for the image capture device, and in the expanded configuration, the body defines a third leg that cooperates with the first and second legs to provide a freestanding base for the image capture device.

Abstract: Systems and methods are disclosed for image capture. For example, systems may include an image capture module including an image sensor configured to capture images, a connector, and an integrated mechanical stabilization system configured to control an orientation of the image sensor relative to the connector; an aerial vehicle configured to be removably attached to the image capture module by the connector and to fly while carrying the image capture module; and a handheld module configured to be removably attached to the image capture module by the connector, wherein the handheld module includes a battery and an integrated display configured to display images received from the image sensor.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Methods and apparatus for just-in-time streaming media. Existing content delivery networks are optimized for providing mass media to many consumers. This delivery model is poorly suited to user-specific content. Exemplary embodiments of the present disclosure create a program instance that can service a client's media requests from their archival data. In one specific implementation, the archival data is stored segments that are ready for streaming; a content server may provide either a consolidated file or a media “quasi-stream” from the same storage object(s). The quasi-stream supports progressive playback (media playback as it is being downloaded.) The program instance provides the client device the illusion of a static file system, however client requested access to HTTP file downloads are provided in packets that are transmuxed/transcoded from archival data.

Abstract: The present teachings provide an image capture device including an optical system having a bayonet. The bayonet is connected to a body of the image capture device. The bayonet includes a forward surface, a rearward surface opposing the forward surface, and a bayonet axial surface; and. The optical system includes an integrated sensor and lens assembly (ISLA) extending away from the rearward surface of the bayonet; and a lens module extending away from the forward surface of the bayonet and comprising a lens module axial surface, wherein the lens module axial surface contacts the bayonet axial surface so that the lens module is axially aligned with the bayonet.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Abstract: A method for encoding images includes decoding a first encoded image to obtain a first decoded image, where the first decoded image includes a first decoded portion corresponding to a first encoded portion of the first encoded image and a second decoded portion corresponding to a second encoded portion of the first encoded image; decoding a second encoded image to obtain a second decoded image; combining the first decoded image and the second decoded image to obtain a single decoded image; and encoding the single decoded image to obtain a single encoded image that includes a third and a fourth encoded portions. Encoding the single decoded image includes obtaining the third encoded portion of the single encoded image by copying the first encoded portion of the first encoded image; and obtaining the fourth encoded portion of the single encoded image by encoding the second decoded portion using an encoder.

Abstract: Consumption information associated with a user consuming video segments may be obtained. The consumption information may define user engagement during a video segment and/or user response to the video segment. Sets of flight control settings associated with capture of the video segments may be obtained. The flight control settings may define aspects of a flight control subsystem for the unmanned aerial vehicle and/or a sensor control subsystem for the unmanned aerial vehicle. The preferences for the flight control settings of the unmanned aerial vehicle may be determined based upon the first set and the second set of flight control settings. Instructions may be transmitted to the unmanned aerial vehicle. The instructions may include the determined preferences for the flight control settings and being configured to cause the unmanned aerial vehicle to adjust the flight control settings to the determined preferences.

Abstract: An image capture device may detect presence of drop of liquid on its optical element during capture of visual content. The image capture device may effectuate removal of the drop of liquid from the optical element.

Abstract: A motor controller of an unmanned aerial vehicle (UAV) is optimized to improve operation of the UAV. The motor control optimizations include controlling a motor of a UAV to reduce an operating temperature of the UAV, reducing an amount of latency or jitter resulting from motor operation, and applying a smoothing filter for motor operation. For example, controlling a motor of a UAV to reduce an operating temperature of the UAV can include using a temperature model for the unmanned aerial vehicle or an operating temperature measurement to determine a current operating temperature and comparing that current operating temperature to a threshold. If the threshold is exceeded, settings of the motor are adjusted to cause the motor to operate in a manner that reduces the current operating temperature.

Abstract: An image capture device may include an image sensor, a processor, and memory. The image sensor may be configured to obtain an image. The processor may be configured to: generate a grid on the image forming tiles; determine a fringing level of each vertex of the vertices; sort all of the tiles based on the fringing level of each tile so that the tiles are sorted in a descending order from the tile with a highest of the fringing levels to the tile with a lowest of the fringing levels; and apply a fringing compensation to a subset of the sorted tiles to obtain a processed image. The memory may be configured to store the processed image.

Abstract: An image capture device includes a heatsink that absorbs thermal energy and a first component that generates thermal energy. The image capture device includes a second component that generates thermal energy and a first conductor that extends between the first component and the heatsink, and the first conductor moves thermal energy from the first component to the heatsink by conduction. The image capture device includes a second conductor that extends between the second component and the heatsink, and the second conductor has a portion perpendicularly extended relative to the first conductor. The second conductor moves thermal energy from the second component to the heatsink by conduction.

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

Abstract: A face located along a stitch line in a spherical image is detected by rendering views of regions of the spherical image along the stitch line. The spherical image may be produced by combining first and second images. A first view of a projection of the spherical image is rendered. A scaling factor for rendering a second view of the projection is determined based characteristics of the first portion of the face. The second view is then rendered according to the scaling factor. The use of the scaling factor to render the second view causes a change in the depiction of the second portion of the face. For example, the scaling factor can indicate to change the resolution or expected size of the second portion of the face when rendering the second view. A face is then detected within the spherical image based on the rendered first and second views.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: An image capture device is described that includes a body; a mounting structure that is connected to the body; an integrated sensor-lens assembly (ISLA) that defines an optical axis and extends through the body and the mounting structure; and an accessory that is releasably connectable to the mounting structure via rotation through a range of motion less than approximately 90 degrees. The mounting structure and the accessory include corresponding angled bearing surfaces that are configured for engagement such that rotation of the accessory relative to the mounting structure creates a bearing effect that displaces the accessory along the optical axis to thereby reduce any axial force required during connection and disconnection of the accessory.

Abstract: Media items captured by a media capture device may include and/or be associated with values of a clock-change identifier. The values of the clock-change identifier may be set based on when and how many times the time of the media capture device was changed. Based on a capture-time of a media item being incorrect, other media items with the same value of the clock-change identifier may be determined to be incorrect. Capture-times of the other media items may be corrected based on capture-time correction of the media item.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: An image capture device includes a housing that includes a pattern of apertures and a microphone disposed within the housing and proximate to the apertures. The image capture device includes a membrane assembly. The membrane assembly includes a support disposed between the housing and the microphone and a channel defined in the support that directs sound waves from only one of the apertures in the pattern to the microphone. The membrane assembly further includes a membrane that extends across the channel and separates the one of the apertures and the microphone.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. Context of the video may be assessed and used to suggest framing of the video.

Abstract: A remapping space may define correspondence between times within a video and times within a time-remapped video. Responsive to user selection of a moment within the video for initiation of time remapping using a selected playback speed, a start point and an end point may be inserted at the selected moment within the remapping space. Responsive to user selection of a segment within the video to apply the selected playback speed in the time remapping, the start point and/or the end point may be moved to change the correspondence between times within the video and times within the time-remapped video.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.

Abstract: A condition of an unmanned aerial vehicle (UAV) is detected using one or more sensors of the UAV and signaled according to an alert definition associated with the condition. For example, an alert definition can indicate to signal the condition by using a motor of the UAV to produce an audible tone. A tonal signal having a frequency within an audible spectrum can be generated according to the alert definition. The tonal signal and a drive signal used for supplying current to the motor can be combined to produce a combined signal. The combined signal can then be transmitted to the motor to cause the motor to produce the audible tone. In some cases, an amplitude of the tonal signal can be modulated, such as where the amplitude of the combined signal exceeds a threshold associated with an operating margin of the UAV.

Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

Abstract: A method and system for configuring a USB3 input/output port in a camera are disclosed. The method comprises responsive to an indication that a peripheral device is a non-USB3 device, remapping pins of the USB3 input/output port to a first predefined port configuration associated with an I2C protocol by remapping a RX1? pin to communicate a first I2C signal and remapping a RX1+ pin to communicate a second I2C signal, and responsive to successful authentication between the camera and the peripheral device via the I2C protocol, enabling communication with the peripheral device and remapping the pins of the USB3 input/output port to a second predefined port configuration compatible with operation of the authenticated peripheral device by remapping a TX2+ pin to communicate a first general purpose input/output signal and remapping a TX2? pin to communicate a second general purpose input/output signal.

Abstract: An image capture device may include a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Abstract: An image capture device may capture a video while experiencing motion. Motion of the image capture device during video capture may be determined based on optical flow and structure from motion solve of the video. Optical flow derived motion and/or the motion solve derived motion of the image capture device may be selected to perform stabilization of the video.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

Abstract: Disclosed is an electronic motor with two bearings. The motor is structured so that, when loaded, the majority of the load (e.g., a radial load) is borne by one of the bearings. The bearing that bears a greater load may be larger and, thus, better suited for a heavy load. In some embodiments, the larger bearing may include rolling elements that have respective radii larger than respective radii of rolling elements of the other bearing by a ratio of at least 1.5 (150%). In some embodiments, the larger bearing may have an outer race with a radius that is greater than a radius of the outer race of the smaller bearing by a ratio of at least 1.5. In some embodiments, the motors may include a third bearing between the two bearings. The third bearing may reduce vibration in the motor.

Abstract: The present teachings provide an image capture device including a bayonet and an integrated sensor and lens assembly (ISLA). The bayonet is connected to a body of the image capture device. The ISLA is connected to the bayonet. All or a portion of the ISLA extends into the body of the image capture device. The ISLA includes a lens assembly having a forward end and a rearward end and an integrated sensor. The integrated sensor is connected to the rearward end of the lens assembly. Fasteners extend through the bayonet into the forward end of the lens assembly to connect the ISLA to the bayonet.

Abstract: Optical center calibration may include obtaining one or more parameters for optical center calibration, obtaining an input image captured by an image capture device using a lens, and determining a calibration circle using the parameters and the input image. Determining the calibration circle may include extracting rays using the input image, estimating contours using the input image and the rays, and estimating the calibration circle using the input image and the contours. The calibration may be iteratively improved by repeating calibration based on the input image and a previous iteration of optical center calibration.

Abstract: In one aspect of the present disclosure, a digital image capturing device (DICD) is disclosed that includes a device body with a printed circuit board (PCB), and an integrated sensor-lens assembly (ISLA) that is configured for releasable connection to the device body. The PCB defines a plurality of openings that extend therethrough and includes a plurality of connector pins that are fixedly positioned within the openings. The ISLA includes at least one connective surface that is configured for contact with the connector pins to establish electrical communication between the device body and the ISLA.

Abstract: A method for reducing overexposure or underexposure in a time-lapse includes acquiring, using an image capture device, a first frame of the time-lapse using a first exposure setting; and acquiring, using the image capture device, a second frame of the time-lapse. The first frame of the time-lapse is acquired under a first luminance condition. The second frame of the time-lapse is acquired under a second luminance condition that is different from the first luminance condition. The second frame of the time-lapse is acquired using an exposure setting that is determined based on respective exposure settings of one or more preview images obtained between the first frame of the time-lapse and the second frame of the time-lapse. The one or more preview images are not included in the time-lapse.

Abstract: A method is disclosed for improving the quality of photographs taken in low-light conditions by adjustment of shutter speed and digital gain based on a shutter prioritization value. Using a network of sensor, a digital camera processes various parameters, such as light level of the scene and movement of the camera or of subjects within the scene, to compute a shutter prioritization value. The value is then used to select the most appropriate shutter speed and digital gain combination from a constant exposure curve. Higher prioritization values correspond to faster shutter speeds and higher digital gain. Lower prioritization values correspond to lower shutter speeds and lower digital gain. In further embodiments, the shutter prioritization value may be manually customized by a user in order to produce artistic effects.

Abstract: An audio capture device selects between multiple microphones to generate an output audio signal depending on detected conditions. The audio capture device determines whether one or more microphones are wet or dry and selects one or more audio signals from the one or more microphones depending on their respective conditions. The audio capture device generates a mono audio output signal or a stereo output signal depending on the respective conditions of the one or more microphones.

Abstract: A method and device are provided for positioning a mounted camera. The device includes a holding element that secures the mounted camera to the device, a wireless linkage at which remote attitude commands representing attitude changes of a remote driver are received, a local controller that interprets the remote attitude commands and generates local attitude commands that move the camera to mimic an orientation of the remote driver, and an attitude sensing element that senses a local attitude of the device. The attitude sensing element includes a gyro, an accelerometer, or a magnetometer, and jitter present in the remote attitude commands is removed and not passed on to the local attitude commands.

Abstract: A camera includes an image sensor, a heat diffuser, and a heat spreader. The heat spreader includes a heat source coupled to the image sensor, an arm coupled to the heat source and the heat diffuser, and a heat exchange coupled with the heat source and the arm. A system includes a camera and a heat spreader coupled with the camera. The system includes a stabilizer coupled with the heat spreader and an electronics assembly coupled with the stabilizer. A heat controller for an imaging device that includes a flexible arm and a heat source coupled to the flexible arm that absorbs heat from the imaging device. The heat controller includes a heat exchange coupled to the flexible arm that transfers the heat away from the imaging device via the flexible arm.

Abstract: A camera system with six faces and a front housing is configured to capture images and audio content from external the camera body. The camera system includes an interior audio assembly protected from external environments by a waterproof membrane. The camera system includes drainage ports on the bottom face and the left face of the camera system to encourage moisture to drain from the system. A first drainage channel couples the internal audio assembly to the first drainage port on left face of the camera system and a second drainage channel couples the drainage port on the left face of the camera system to the drainage port on the bottom face of the camera system. A third drainage channel exists between the front face of the camera system and the front housing, the third drainage channel coupling the first and second drainage channels.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.