Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ground control point assignment and determination. One of the methods includes receiving information describing a flight plan for the UAV to implement, the flight plan identifying one or more waypoints associated with geographic locations assigned as ground control points. A first waypoint identified in the flight plan is traveled to, and an action to designate a surface at the associated geographic location is designated as a ground control point. Location information associated with the designated surface is stored. The stored location information is provided to an outside system for storage.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for an unmanned aerial vehicle aerial survey. One of the methods includes receiving information specifying a location to be inspected by an unmanned aerial vehicle (UAV), the inspection including the UAV capturing images of the location. Information describing a boundary of the location to be inspected is obtained. Inspections to be assigned to the location are determined, with the inspection legs being parallel and separated by a particular width. A flight pattern is determined based on a minimum turning radius of the UAV, with the flight pattern specifying an order each inspection leg is to be navigated along, and a direction of the navigation.

Abstract: Systems, methods and apparatus for automated vehicle wheel removal and replacement are provided. One system includes a computer system with applications for scheduling the replacement of tires for the vehicle. An electronically controlled lift device and robotic apparatus is configured for interaction with the computer system. The lift device mechanically adjusts arms for placement on lift points of vehicles. The robotic apparatus detects positioning of lug nut configuration for a wheel, removes lug nuts, and then removes the wheel from the wheel hub with gripping arms. The wheel and tire are then handed off to a separate tire changing machine. When a new tire is replaced the robotic apparatus then mounts the wheel to the original wheel hub, and then secures the lug nuts to the lug nut bolts.

Abstract: A modular vehicle management system is described, comprising a controller module configured to control different types of carrier modules. The controller module includes a computer system and optionally one or more sensors. The computer system is configured to perform operations comprising detecting whether a carrier module is connected to the controller module. If the carrier module is connected to the controller module, the carrier module is authenticated. If the authentication fails, operation of the vehicle is inhibited. The control module is configured to determine carrier module capabilities including information regarding a navigation processing device, and/or a radio modem. The controller adapts to the capabilities of the controller module. Using information from the sensors and the navigation processing device, the vehicle management system navigates the vehicle.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ground control point assignment and determination. One of the methods includes receiving information describing a flight plan for the UAV to implement, the flight plan identifying one or more waypoints associated with geographic locations assigned as ground control points. A first waypoint identified in the flight plan is traveled to, and an action to designate a surface at the associated geographic location is designated as a ground control point. Location information associated with the designated surface is stored. The stored location information is provided to an outside system for storage.

Abstract: Methods, systems, and program products of inspecting solar panels using unmanned aerial vehicles (UAVs) are disclosed. A UAV can obtain a position of the Sun in a reference frame, a location of a solar panel in the reference frame, and an orientation of the solar panel in the reference frame. The UAV can determine a viewing position of the UAV in the reference frame based on at least one of the position of the Sun, the location of the solar panel, and the orientation of the solar panel. The UAV can maneuver to the viewing position and point a thermal sensor onboard the UAV at the solar panel. The UAV can capture, by the thermal sensor, a thermal image of at least a portion of the solar panel. A server onboard the UAV or connected to the UAV can detect panel failures based on the thermal image.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle beyond visual line of sight (BVLOS) flight operations. In an embodiment, a flight planning system of an unmanned aerial vehicle (UAV) can identify handoff zones along a UAV flight corridor for transferring control of the UAV between ground control stations. The start of the handoff zones can be determined prior to a flight or while the UAV is in flight. For handoff zones determined prior to flight, the flight planning system can identify suitable locations to place a ground control station (GCS). The handoff zone can be based on a threshold visual line of sight range between a controlling GCS and the UAV. For determining handoff zones while in flight, the UAV can monitor RF signals from each GCS participating in the handoff to determine the start of a handoff period.

Abstract: In some implementations, a UAV flight system can dynamically adjust UAV flight operations based on thermal sensor data. For example, the flight system can determine an initial flight plan for inspecting a flare stack and configure a UAV to perform an aerial inspection of the flare stack. Once airborne, the UAV can collect thermal sensor data and the flight system can automatically adjust the flight plan to avoid thermal damage to the UAV based on the thermal sensor data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes receiving, by the UAV, flight information describing a job to perform an inspection of a rooftop. A particular altitude is ascended to, and an inspection of the rooftop is performed including obtaining sensor information describing the rooftop. Location information identifying a damaged area of the rooftop is received. The damaged area of the rooftop is traveled to. An inspection of the damaged area of the rooftop is performed including obtaining detailed sensor information describing the damaged area. A safe landing location is traveled to.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle visual line of sight flight operations. A UAV computer system may be configured to ensure the UAV is operating in visual line of sight of one or more ground operators. The UAV may confirm that it has a visual line of sight with the one or more user devices, such as a ground control station, or the UAV may ensure that the UAV does not fly behind or below a structure such that the ground operator would not be able to visually spot the UAV. The UAV computer system may be configured in such a way that UAV operation will maintain the UAV in visual line of sight of a base location.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes obtaining, from a user device, flight operation information describing an inspection of a vertical structure to be performed, the flight operation information including locations of one or more safe locations for vertical inspection. A location of the UAV is determined to correspond to a first safe location for vertical inspection. A first inspection of the structure is performed is performed at the first safe location, the first inspection including activating cameras. A second safe location is traveled to, and a second inspection of the structure is performed. Information associated with the inspection is provided to the user device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial vehicle control point selection system. A first unmanned aerial vehicle can navigate about a geographic area while a second unmanned aerial vehicle can capture images of the first unmanned aerial vehicle. Location information of the first unmanned aerial vehicle can be recorded, and a system can identify the first unmanned aerial vehicle in the captured images. Utilizing the recorded location information, the system can identify landmarks proximate to the first unmanned aerial vehicle identified in the images, and determine location information of the landmarks. The landmarks can be assigned as ground control points for subsequent flight plans.

Abstract: In some implementations, a UAV flight system can dynamically adjust UAV flight operations based on radio frequency (RF) signal data. For example, the flight system can determine an initial flight plan for inspecting a RF transmitter and configure a UAV to perform an aerial inspection of the RF transmitter. Once airborne, the UAV can collect RF signal data and the flight system can automatically adjust the flight plan to avoid RF signal interference and/or damage to the UAV based on the collected RF signal data. In some implementations, the UAV can collect RF signal data and generate a three-dimensional received signal strength map that describes the received signal strength at various locations within a volumetric area around the RF transmitter. In some implementations, the UAV can collect RF signal data and determine whether a RF signal transmitter is properly aligned.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reserving airspace for UAV operations. In some implementations, a flight planning system can reserve and allocate airspace for unmanned aerial vehicle (UAV) operations. For example, a UAV operator device can submit a flight plan to the flight planning system. The flight planning system can submit a flight authorization request to an airspace management system to reserve airspace necessary for the flight plan. The flight planning system can receive approval and/or a reservation of the airspace for the flight plan from the airspace management system, generate a flight data package, and send the flight data package to the operator's device.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle beyond visual line of sight (BVLOS) flight operations. In an embodiment, a flight planning system of an unmanned aerial vehicle (UAV) can identify handoff zones along a UAV flight corridor for transferring control of the UAV between ground control stations. The start of the handoff zones can be determined prior to a flight or while the UAV is in flight. For handoff zones determined prior to flight, the flight planning system can identify suitable locations to place a ground control station (GCS). The handoff zone can be based on a threshold visual line of sight range between a controlling GCS and the UAV. For determining handoff zones while in flight, the UAV can monitor RF signals from each GCS participating in the handoff to determine the start of a handoff period.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for an unmanned aerial vehicle (UAV) wind turbine inspection system. One of the methods includes obtaining first sensor information by an unmanned aerial vehicle (UAV), the first sensor information describing physical aspects of a wind turbine, including one or more blades of the wind turbine. An orientation of the blades of the wind turbine are determined based on the obtained first sensor information. A flight pattern for the UAV to inspect the blades of the wind turbine is determined, the flight pattern being based on the determined orientation of the blades. Each of the blades of the wind turbine is inspected by the UAV according to the determined flight pattern, the inspection including obtaining second sensor information describing the blades of the wind turbine.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes obtaining, from a user device, flight operation information describing an inspection of a vertical structure to be performed, the flight operation information including locations of one or more safe locations for vertical inspection. A location of the UAV is determined to correspond to a first safe location for vertical inspection. A first inspection of the structure is performed is performed at the first safe location, the first inspection including activating cameras. A second safe location is traveled to, and a second inspection of the structure is performed. Information associated with the inspection is provided to the user device.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle visual line of sight flight operations. A UAV computer system may be configured to ensure the UAV is operating in visual line of sight of one or more ground operators. The UAV may confirm that it has a visual line of sight with the one or more user devices, such as a ground control station, or the UAV may ensure that the UAV does not fly behind or below a structure such that the ground operator would not be able to visually spot the UAV. The UAV computer system may be configured in such a way that UAV operation will maintain the UAV in visual line of sight of a base location.

Abstract: In some implementations, a UAV flight system can dynamically adjust UAV flight operations based on thermal sensor data. For example, the flight system can determine an initial flight plan for inspecting a flare stack and configure a UAV to perform an aerial inspection of the flare stack. Once airborne, the UAV can collect thermal sensor data and the flight system can automatically adjust the flight plan to avoid thermal damage to the UAV based on the thermal sensor data.

Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle flight operations near physical structures or objects. In particular, a point cloud of the physical structure is generated using aerial images of the structure. The point cloud is then referenced to determine a flight path for the UAV to follow around the physical structure, determine whether a planned flight path to desired locations around the structure is possible, determine the fastest route to return home and land from a given position around the physical structure, determine possibility of inflight collision to surface represented in point cloud, or determine an orientation of a fixed or gimballed camera given a position of the UAV relative the point cloud.