Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include an unmanned aerial vehicle including a propulsion mechanism, a battery, and a processing apparatus; and a dock including a landing surface with a funnel geometry shaped to fit a bottom surface of the unmanned aerial vehicle at a base of the funnel, wherein tapered sides of the funnel form corners at the base of the funnel, and a battery charger configured to charge the battery of the unmanned aerial vehicle while the unmanned aerial vehicle is on the landing surface, wherein conducting contacts of the battery charger are on the landing surface, positioned at the bottom of the funnel.

Abstract: Described herein are systems for roof scan using an unmanned aerial vehicle. For example, some methods include capturing, using an unmanned aerial vehicle, an overview image of a roof of a building from above the roof; presenting a suggested bounding polygon overlaid on the overview image to a user; determining a bounding polygon based on the suggested bounding polygon and user edits; based on the bounding polygon, determining a flight path including a sequence of poses of the unmanned aerial vehicle with respective fields of view at a fixed height that collectively cover the bounding polygon; fly the unmanned aerial vehicle to a sequence of scan poses with horizontal positions matching respective poses of the flight path and vertical positions determined to maintain a consistent distance above the roof; and scanning the roof from the sequence of scan poses to generate a three-dimensional map of the roof.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may include one or more processors configured to capture, with one or more image sensors, and while the UAV is in flight, a plurality of images of a target. The one or more processors may compare a first image of the plurality of images with a second image of the plurality of images to determine a difference between a current frame of reference position for the UAV and an estimate of an actual frame of reference position for the UAV. In addition, the one or more processors may determine, based at least on the difference, and while the UAV is in flight, an update to a three-dimensional model of the target.

Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.

Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include an unmanned aerial vehicle including a propulsion mechanism, a battery, and a processing apparatus; and a dock including a landing surface with a funnel geometry shaped to fit a bottom surface of the unmanned aerial vehicle at a base of the funnel, wherein tapered sides of the funnel form corners at the base of the funnel, and a battery charger configured to charge the battery of the unmanned aerial vehicle while the unmanned aerial vehicle is on the landing surface, wherein conducting contacts of the battery charger are on the landing surface, positioned at the bottom of the funnel.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include an unmanned aerial vehicle including a propulsion mechanism, an image sensor, and processing apparatus; and a dock including a landing surface configured to hold the unmanned aerial vehicle and a fiducial on the landing surface, wherein the processing apparatus is configured to: control the propulsion mechanism to cause the unmanned aerial vehicle to fly to a first location in a vicinity of the dock; access one or more images captured using the image sensor; detect the fiducial in at least one of the one or more images; determine a pose of the fiducial based on the one or more images; and control, based on the pose of the fiducial, the propulsion mechanism to cause the unmanned aerial vehicle to land on the landing surface.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may identify a scan target. The UAV may navigate to two or more positions in relation to the scan target. The UAV may capture, using one or more image sensors of the UAV, two or more images of the scan target from different respective positions in relation to the scan target. For instance, the two or more respective positions may be selected by controlling a spacing between the two or more respective positions to enable determination of parallax disparity between a first image captured at a first position and a second image captured at a second position of the two or more positions. The UAV may determine a three-dimensional model corresponding to the scan target based in part on the determined parallax disparity of the two or more images including the first image and the second image.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may access a scan plan that includes a sequence of poses for the UAV to assume to capture images of a scan target using one or more image sensors. The UAV may check a next pose of the scan plan for obstructions. Responsive to detection of an obstruction, the UAV may determine a backup pose based at least on a field of view of the next pose. The UAV may control a propulsion mechanism to cause the UAV to fly to assume the backup pose. The UAV may capture, based on the backup pose and using the one or more image sensors, one or more images of the scan target.

Abstract: In some examples, an image of a scan target is presented in a user interface on a display associated with a computing device. The user interface receives at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target. A graphical representation of the volume in relation to the image of the scan target is generated in the user interface. Information for defining a location of at least a portion of the volume in three-dimensional space is sent to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.

Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may include one or more processors configured to capture, with one or more image sensors, and while the UAV is in flight, a plurality of images of a target. The one or more processors may compare a first image of the plurality of images with a second image of the plurality of images to determine a difference between a current frame of reference position for the UAV and an estimate of an actual frame of reference position for the UAV. In addition, the one or more processors may determine, based at least on the difference, and while the UAV is in flight, an update to a three-dimensional model of the target.

Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.

Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may access a scan plan that includes a sequence of poses for the UAV to assume to capture images of a scan target using one or more image sensors. The UAV may check a next pose of the scan plan for obstructions. Responsive to detection of an obstruction, the UAV may determine a backup pose based at least on a field of view of the next pose. The UAV may control a propulsion mechanism to cause the UAV to fly to assume the backup pose. The UAV may capture, based on the backup pose and using the one or more image sensors, one or more images of the scan target.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may identify a scan target. The UAV may navigate to two or more positions in relation to the scan target. The UAV may capture, using one or more image sensors of the UAV, two or more images of the scan target from different respective positions in relation to the scan target. For instance, the two or more respective positions may be selected by controlling a spacing between the two or more respective positions to enable determination of parallax disparity between a first image captured at a first position and a second image captured at a second position of the two or more positions. The UAV may determine a three-dimensional model corresponding to the scan target based in part on the determined parallax disparity of the two or more images including the first image and the second image.

Abstract: In some examples, an unmanned aerial vehicle (UAV) may determine, based on a three-dimensional (3D) model including a plurality of points corresponding to a scan target, a scan plan for scanning at least a portion of the scan target. For instance, the scan plan may include a plurality of poses for the UAV to assume to capture images of the scan target. The UAV may capture with one or more image sensors, one or more images of the scan target from one or more poses of the plurality of poses. Further, the UAV may determine an update to the 3D model based at least in part on the one or more images. Additionally, the UAV may update the scan plan based at least in part on the update to the 3D model.

Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.