Abstract: An introduced autonomous aerial vehicle can include multiple cameras for capturing images of a surrounding physical environment that are utilized for motion planning by an autonomous navigation system. In some embodiments, the cameras can be integrated into one or more rotor assemblies that house powered rotors to free up space within the body of the aerial vehicle. In an example embodiment, an aerial vehicle includes multiple upward-facing cameras and multiple downward-facing cameras with overlapping fields of view to enable stereoscopic computer vision in a plurality of directions around the aerial vehicle. Similar camera arrangements can also be implemented in fixed-wing aerial vehicles.

Abstract: Technology is disclosed herein to enable data transfer from unmanned aerial vehicles to cloud destinations. In an implementation, a relay resource in communication with a UAV sends a transfer request to a cloud service for managing data transfer for unmanned aerial vehicles. The request includes a unique identifier for the data file. The cloud service determines instructions for transferring the data file to a destination based on the file's unique identifier. The cloud service sends the transfer instructions to the relay resource via an API, the instructions including information for uploading the file to the destination.

Abstract: Technology is disclosed herein for operating a tasking service for UAVs. In an implementation, a tasking service receives task parameters which includes a desired state of the UAVs for performing a task and service information associated with performing the task. The tasking service continuously receives state information from the UAVs which identifies a present state of the UAVs and continuously evaluates the present state of the UAVs with respect to the desired state. When the present state of an UAV matches the desired state, the tasking service assigns the task to the UAV and provides the service information to the UAV. In an implementation, the tasking service receives task parameters via an application programming interface from a client application in communication with the tasking service.

Abstract: Described herein are systems for roof scan using an unmanned aerial vehicle. For example, some methods include capturing, using an unmanned aerial vehicle, an overview image of a roof of a building from above the roof; presenting a suggested bounding polygon overlaid on the overview image to a user; determining a bounding polygon based on the suggested bounding polygon and user edits; based on the bounding polygon, determining a flight path including a sequence of poses of the unmanned aerial vehicle with respective fields of view at a fixed height that collectively cover the bounding polygon; fly the unmanned aerial vehicle to a sequence of scan poses with horizontal positions matching respective poses of the flight path and vertical positions determined to maintain a consistent distance above the roof; and scanning the roof from the sequence of scan poses to generate a three-dimensional map of the roof.

Abstract: An unmanned aerial vehicle (UAV) controller may have control elements configured to receive inputs from a user. A cover may be coupled to the controller. The cover may be movable between a closed position in which the control elements are covered and an open position in which the control elements are exposed. An antenna may be integrated in the cover. The antenna may be electrically connected to circuitry in the controller for communicating with a UAV. In some implementations, a conductive plane and/or an insulating plane may be integrated in the cover. In some implementations, a heatsink, a fan, and/or a support mechanism may be arranged on an under portion of the controller. In some implementations, a circuit board including a cutout may be arranged inside the controller.

Abstract: Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).

Abstract: In some examples, an unmanned aerial vehicle (UAV) may include one or more processors configured to capture, with one or more image sensors, and while the UAV is in flight, a plurality of images of a target. The one or more processors may compare a first image of the plurality of images with a second image of the plurality of images to determine a difference between a current frame of reference position for the UAV and an estimate of an actual frame of reference position for the UAV. In addition, the one or more processors may determine, based at least on the difference, and while the UAV is in flight, an update to a three-dimensional model of the target.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ground control point assignment and determination. One of the methods includes receiving information describing a flight plan for the UAV to implement, the flight plan identifying one or more waypoints associated with geographic locations assigned as ground control points. A first waypoint identified in the flight plan is traveled to, and an action to designate a surface at the associated geographic location is designated as a ground control point. Location information associated with the designated surface is stored. The stored location information is provided to an outside system for storage.

Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.

Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.

Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.

Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for fleet management of unmanned aerial vehicles, including flight authorization. One of the methods includes maintaining one or more rules associated with authorizing UAVs to implement flight plans. A request to generate a flight plan associated with a job is received, the request including information indicating a flight pattern comprising, at least, one or more waypoints associated with geospatial references. The flight plan is generated based on the request, and an initial authorization check is determined based on the maintained rules and the generated flight plan. Upon a positive determination, access to the generated flight plan is provided by a ground control system, and the flight plan is implemented.

Abstract: A technique for user interaction with an autonomous unmanned aerial vehicle (UAV) is described. In an example embodiment, perception inputs from one or more sensor devices are processed to build a shared virtual environment that is representative of a physical environment. The sensor devices used to generate perception inputs can include image capture devices onboard an autonomous aerial vehicle that is in flight through the physical environment. The shared virtual environment can provide a continually updated representation of the physical environment which is accessible to multiple network-connected devices, including multiple UAVs and multiple mobile computing devices. The shared virtual environment can be used, for example, to display visual augmentations at network-connected user devices and guide autonomous navigation by the UAV.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may determine a first acceleration of the UAV based at least on information from an onboard accelerometer received at least one of prior to or during takeoff. The UAV may determine a second acceleration of the UAV based at least on location information received via a satellite positioning system receiver at least one of prior to or during takeoff. The UAV may further determine a relative heading of the UAV based at least in part on the first acceleration and the second acceleration, and may be directed to navigate an environment based at least on the determined relative heading.

Abstract: Sports and fitness applications for an autonomous unmanned aerial vehicle (UAV) are described. In an example embodiment, a UAV can be configured to track a human subject using perception inputs from one or more onboard sensors. The perception inputs can be utilized to generate values for various performance metrics associated with the activity of the human subject. In some embodiments, the perception inputs can be utilized to autonomously maneuver the UAV to lead the human subject to satisfy a performance goal. The UAV can also be configured to autonomously capture images of a sporting event and/or make rule determinations while officiating a sporting event.

Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include an unmanned aerial vehicle including a propulsion mechanism, a battery, and a processing apparatus; and a dock including a landing surface with a funnel geometry shaped to fit a bottom surface of the unmanned aerial vehicle at a base of the funnel, wherein tapered sides of the funnel form corners at the base of the funnel, and a battery charger configured to charge the battery of the unmanned aerial vehicle while the unmanned aerial vehicle is on the landing surface, wherein conducting contacts of the battery charger are on the landing surface, positioned at the bottom of the funnel.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle beyond visual line of sight (BVLOS) flight operations. In an embodiment, a flight planning system of an unmanned aerial vehicle (UAV) can identify handoff zones along a UAV flight corridor for transferring control of the UAV between ground control stations. The start of the handoff zones can be determined prior to a flight or while the UAV is in flight. For handoff zones determined prior to flight, the flight planning system can identify suitable locations to place a ground control station (GCS). The handoff zone can be based on a threshold visual line of sight range between a controlling GCS and the UAV. For determining handoff zones while in flight, the UAV can monitor RF signals from each GCS participating in the handoff to determine the start of a handoff period.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.