Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.

Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.

Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.

Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.

Abstract: Techniques are described for controlling an autonomous vehicle (AV) using objective-based inputs. The underlying functionality of an autonomous navigation system can be is exposed via an application programming interface (API) or similar methodology allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. Developers can utilize the API to build customized applications for the AV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous AV.

Abstract: Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; capturing one or more images of the structure from the pose.

Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include an unmanned aerial vehicle including a propulsion mechanism, a battery, and a processing apparatus; and a dock including a landing surface with a funnel geometry shaped to fit a bottom surface of the unmanned aerial vehicle at a base of the funnel, wherein tapered sides of the funnel form corners at the base of the funnel, and a battery charger configured to charge the battery of the unmanned aerial vehicle while the unmanned aerial vehicle is on the landing surface, wherein conducting contacts of the battery charger are on the landing surface, positioned at the bottom of the funnel.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.

Abstract: Described herein are systems for roof scan using an unmanned aerial vehicle. For example, some methods include capturing, using an unmanned aerial vehicle, an overview image of a roof of a building from above the roof; presenting a suggested bounding polygon overlaid on the overview image to a user; determining a bounding polygon based on the suggested bounding polygon and user edits; based on the bounding polygon, determining a flight path including a sequence of poses of the unmanned aerial vehicle with respective fields of view at a fixed height that collectively cover the bounding polygon; fly the unmanned aerial vehicle to a sequence of scan poses with horizontal positions matching respective poses of the flight path and vertical positions determined to maintain a consistent distance above the roof; and scanning the roof from the sequence of scan poses to generate a three-dimensional map of the roof.

Abstract: Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.

Abstract: In some examples, one or more processors of an aerial vehicle determine an update to a three-dimensional (3D) model corresponding to a scan target to scan according to a scan plan. Based at least on the update to the 3D model, the one or more processors determine a set of one or more uncovered points of the 3D model that are not covered by the scan plan. Additionally, the one or more processors determine an updated scan plan based at least on determining one or more poses to include in the scan plan for scanning the one or more uncovered points of the 3D model. The one or more processors, control the aerial vehicle to scan the scan target with the one or more image sensors according to the updated scan plan.

Abstract: In some examples, one or more processors of an unmanned aerial vehicle (UAV), control a propulsion mechanism of the UAV to cause the UAV to navigate to a plurality of positions in relation to a scan target. Using one or more image sensors of the UAV, a first image of the scan target is captured from a first position of the plurality of positions, and a second image of the scan target is captured from a second position of the plurality of positions. A disparity is determined between the first image captured at the first position and the second image captured at the second position. A three-dimensional model corresponding to the scan target is determined based in part on the disparity determined between the first image and the second image.

Abstract: In some examples, one or more processors of an aerial vehicle access a scan plan including a sequence of poses for the aerial vehicle to assume to capture, using the one or more image sensors, images of a scan target. A next pose of the scan plan is checked for obstructions, and based at least on detection of an obstruction, the one or more processors determine whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point. Responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, image capture of the targeted point is performed at an oblique angle to the normal of the targeted point.

Abstract: Described herein are systems for automated docking of an unmanned aerial vehicle. For example, some systems include a landing surface configured to hold an unmanned aerial vehicle; a box configured to enclose the landing surface in a first arrangement of the dock and expose the landing surface in a second arrangement of the dock; and a retractable arm, wherein the landing surface is positioned at an end of the retractable arm and the retractable arm is configured to extend to move the landing surface outside of the box and contract to pull the landing surface inside of the box.

Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.

Abstract: Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.

Abstract: In some examples, one or more processors of an aerial vehicle access a scan plan including a sequence of poses for the aerial vehicle to assume to capture, using the one or more image sensors, images of a scan target. A next pose of the scan plan is checked for obstructions, and based at least on detection of an obstruction, the one or more processors determine whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point. Responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, image capture of the targeted point is performed at an oblique angle to the normal of the targeted point.