Navigating UAVs In Formation
Navigating UAVs in formation, including assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern; identifying a waypoint for each UAV in dependence upon the UAV's pattern position; piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm, where the navigation algorithm includes repeatedly comparing the UAV's intended position and the UAV's actual position and calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold. The actual position of the UAV may be taken from a GPS receiver on board the UAV.
Latest IBM Patents:
- INTERACTIVE DATASET EXPLORATION AND PREPROCESSING
- NETWORK SECURITY ASSESSMENT BASED UPON IDENTIFICATION OF AN ADVERSARY
- NON-LINEAR APPROXIMATION ROBUST TO INPUT RANGE OF HOMOMORPHIC ENCRYPTION ANALYTICS
- Back-side memory element with local memory select transistor
- Injection molded solder head with improved sealing performance
This application is a continuation application of and claims priority from U.S. patent application Ser. No. 11/041,919, filed on Jan. 24, 2005.
BACKGROUND OF THE INVENTION1. Field of the Invention
The field of the invention is data processing, or, more specifically, methods, systems, and products for navigating UAVs in formation.
2. Description of Related Art
Many forms of UAV are available in prior art, both domestically and internationally. Their payload weight carrying capability, their accommodations (volume, environment), their mission profiles (altitude, range, duration), and their command, control and data acquisition capabilities vary significantly. Routine civil access to these various UAV assets is in an embryonic state.
Conventional UAVs are typically manually controlled by an operator who may view aspects of a UAV's flight using cameras installed on the UAV with images provided through downlink telemetry. Navigating such UAVs from a starting position to one or more waypoints requires an operator to have specific knowledge of the UAV's flight, including such aspects as starting location, the UAV's current location, waypoint locations, and so on. Operators of prior art UAVs usually are required generally to manually control the UAV from a starting position to a waypoint with little aid from automation. There is therefore an ongoing need for improvement in the area of UAV navigations.
SUMMARY OF THE INVENTIONExemplary methods, systems, and products are described for efficient, automated navigation of UAVs, including navigating UAVs in formation. That is, exemplary methods, systems, and products are described for navigating UAVs in formation, including assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern; identifying a waypoint for each UAV in dependence upon the UAV's pattern position; piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm, where the navigation algorithm includes repeatedly comparing the UAV's intended position and the UAV's actual position and calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold. The actual position of the UAV may be taken from a GPS receiver on board the UAV.
Assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern may include designating an anchor position for the pattern and assigning pattern positions to the other UAVs relative to the anchor position, and identifying a waypoint for each UAV in dependence upon its pattern position may be carried out by designating a waypoint for the anchor position and calculating each UAV's waypoint in dependence upon the waypoint for the anchor and in dependence upon the UAV's position in the pattern. Each UAV's intended position may be specified by the UAV's position in the pattern, a cross track to the UAV's waypoint, and a flight schedule.
Piloting the UAVs in dependence upon a navigation algorithm may include identifying a cross track to a waypoint for each UAV, the cross track having a cross track direction; piloting the UAV to a starting point on the cross track; calculating an airspeed for flying from the starting point to the waypoint on schedule; calculating a heading in dependence upon wind speed, wind direction, airspeed, and the cross track direction; and flying the UAV on the heading at the airspeed.
Calculating a corrective flight vector may be carried out by selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint; calculating a corrective airspeed for arriving at the corrective waypoint on schedule; and calculating a corrective heading in dependence upon the calculated airspeed. Selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint may include selecting a corrective waypoint at a predetermined portion of the distance between a UAV's intended position and its waypoint. Calculating a corrective airspeed for arriving at the corrective waypoint on schedule may be carried out by calculating a groundspeed needed to bring the UAV to the remedial waypoint on schedule, including dividing the distance from the actual position to the corrective waypoint by the difference between the current time and the schedule time for the corrective waypoint.
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular descriptions of exemplary embodiments of the invention as illustrated in the accompanying drawings wherein like reference numbers generally represent like parts of exemplary embodiments of the invention.
The present invention is described to a large extent in this specification in terms of methods for navigating UAVs in formation. Persons skilled in the art, however, will recognize that any computer system that includes suitable programming means for operating in accordance with the disclosed methods also falls well within the scope of the present invention. Suitable programming means include any means for directing a computer system to execute the steps of the method of the invention, including for example, systems included of processing units and arithmetic-logic circuits coupled to computer memory, which systems have the capability of storing in computer memory, which computer memory includes electronic circuits configured to store data and program instructions, programmed steps of the method of the invention for execution by a processing unit.
The invention also may be embodied in a computer program product, such as a diskette or other recording medium, for use with any suitable data processing system. Embodiments of a computer program product may be implemented by use of any recording medium for machine-readable information, including magnetic media, optical media, or other suitable media. Persons skilled in the art will immediately recognize that any computer system having suitable programming means will be capable of executing the steps of the method of the invention as embodied in a program product. Persons skilled in the art will recognize immediately that, although most of the exemplary embodiments described in this specification are oriented to software installed and executing on computer hardware, nevertheless, alternative embodiments implemented as firmware or as hardware are well within the scope of the present invention.
Definitions“Airspeed” means UAV airspeed, the speed of the UAV through the air.
A “cross track” is a fixed course from a starting point directly to a waypoint. A cross track has a direction, a ‘cross track direction,’ that is the direction straight from a starting point to a waypoint. That is, a cross track direction is the heading that a UAV would fly directly from a starting point to a waypoint in the absence of wind.
“GUI” means graphical user interface, a display means for a computer screen.
“Heading” means the compass heading of the UAV. “Course” means the direction of travel of the UAV over the ground. In the absence of wind, or in the presence of a straight tailwind or straight headwind, the course and the heading are the same direction. In the presence of crosswind, the course and the heading are different directions.
“Position” refers to a location in the air or over the ground. ‘Position’ is typically specified as Earth coordinates, latitude and longitude. A specification of position may also include altitude.
A “waypoint” is a position chosen as a destination for navigation of a route. A route has one or more waypoints. That is, a route is composed of waypoints, including at least one final waypoint, and one or more intermediate waypoints.
“TDMA” stands for Time Division Multiple Access, a technology for delivering digital wireless service using time-division multiplexing. TDMA works by dividing a radio frequency into time slots and then allocating slots to multiple calls. In this way, a single frequency can support multiple, simultaneous data channels. TDMA is used by GSM.
“GSM” stands for Global System for Mobile Communications, a digital cellular standard. GSM at this time is the de facto standard for wireless digital communications in Europe and Asia.
“CDPD” stands for Cellular Digital Packet Data, a data transmission technology developed for use on cellular phone frequencies. CDPD uses unused cellular channels to transmit data in packets. CDPD supports data transfer rates of up to 19.2 Kbps.
“GPRS” stands for General Packet Radio Service, a standard for wireless data communications which runs at speeds up to 150 Kbps, compared with current GSM systems which cannot support more than about 9.6 Kbps. GPRS, which supports a wide range of speeds, is an efficient use of limited bandwidth and is particularly suited for sending and receiving small bursts of data, such as e-mail and Web browsing, as well as large volumes of data.
“EDGE” stands for Enhanced Data Rates for GSM Evolution, a standard for wireless data communications supporting data transfer rates of more than 300 Kbps. GPRS and EDGE are considered interim steps on the road to UMTS.
“UMTS” stands for Universal Mobile Telecommunication System, a standard for wireless data communications supporting data transfer rates of up to 2 Mpbs. UMTS is also referred to W-CDMA for Wideband Code Division Multiple Access.
Navigating a UAV with Telemetry through a SocketMethods, systems, and products for navigating a UAV are explained with reference to the accompanying drawings, beginning with
The system of
Each remote control device also supports at least one user input device through which a user may enter the user's selection of a pixel. Examples of user input devices in the system of
The system of
Wireless network (102) is implemented using any wireless data transmission technology as will occur to those of skill in the art including, for example, TDMA, GSM, CDPD, GPRS, EDGE, and UMTS. In a one embodiment, a data communications link layer is implemented using one of these technologies, a data communications network layer is implemented with the Internet Protocol (“IP”), and a data communications transmission layer is implemented using the Transmission Control Protocol (“TCP”). In such systems, telemetry between the UAV and remote control devices, including starting positions, UAV instructions, and flight control instructions, are transmitted using an application-level protocol such as, for example, the HyperText Transmission Protocol (“HTTP”), the Wireless Application Protocol (“WAP”), the Handheld Device Transmission Protocol (“HDTP”), or any other data communications protocol as will occur to those of skill in the art.
The system of
UAVs according to embodiments of the present invention typically include, not only an aircraft, but also automated computing machinery capable of receiving GPS data, operating telemetry between the UAV and one or more remote control devices, and navigating a UAV among waypoints.
UAV (100) includes random access memory or ‘RAM’ (166). Stored in RAM (166) is an application program (152) that implements inventive methods according to embodiments of the present invention. Among other things, application program (158) includes computer program instructions capable of navigating UAVs in formation according to embodiments of the present invention, including computer program steps that execute generally by assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern; identifying a waypoint for each UAV in dependence upon the UAV's pattern position; piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm, where the navigation algorithm includes repeatedly comparing the UAV's intended position and the UAV's actual position, the actual position taken from a GPS receiver, and calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold. This capability of navigating UAVs in formation is described in more detail below in this specification.
In some embodiments, the application programming runs on an OSGi service framework (156). OSGi Stands for ‘Open Services Gateway Initiative.’ The OSGi specification is a Java-based application layer framework that provides vendor neutral application layer APIs and functions. An OSGi service framework (156) is written in Java and therefore typically runs on a Java Virtual Machine (JVM) (154) which in turn runs on an operating system (150). Examples of operating systems useful in UAVs according to the present invention include Unix, AIX™, and Microsoft Windows™.
In OSGi, the framework is a hosting platform for running ‘services’. Services are the main building blocks for creating applications according to the OSGi. A service is a group of Java classes and interfaces that implement a certain feature. The OSGi specification provides a number of standard services. For example, OSGi provides a standard HTTP service that can respond to requests from HTTP clients, such as, for example, remote control devices according to embodiments of the present invention. That is, such remote control devices are enabled to communicate with a UAV having an HTTP service by use of data communications messages in the HTTP protocol.
Services in OSGi are packaged in ‘bundles’ with other files, images, and resources that the services need for execution. A bundle is a Java archive or ‘JAR’ file including one or more service implementations, an activator class, and a manifest file. An activator class is a Java class that the service framework uses to start and stop a bundle. A manifest file is a standard text file that describes the contents of the bundle.
The service framework in OSGi also includes a service registry. The service registry includes a service registration including the service's name and an instance of a class that implements the service for each bundle installed on the framework and registered with the service registry. A bundle may request services that are not included in the bundle, but are registered on the framework service registry. To find a service, a bundle performs a query on the framework's service registry.
In the UAV (100) of
UAV (100) includes communications adapter (170) implementing data communications connections (184) to other computers (162), which may be wireless networks, satellites, remote control devices, servers, or others as will occur to those of skill in the art. Communications adapter (170) advantageously facilitates receiving flight control instructions from a remote control device. Communications adapters implement the hardware level of data communications connections through which UAVs transmit wireless data communications. Examples of communications adapters include wireless modems for dial-up connections through wireless telephone networks.
UAV (100) includes servos (178). Servos (178) are proportional control servos that convert digital control signals from system bus (160) into actual proportional displacement of flight control surfaces, ailerons, elevators, and the rudder. The displacement of flight control surfaces is ‘proportional’ to values of digital control signals, as opposed to the ‘all or nothing’ motion produced by some servos. In this way, ailerons, for example, may be set to thirty degrees, sixty degrees, or any other supported angle rather than always being only neutral or fully rotated. Several proportional control servos useful in various UAVs according to embodiments of the present invention are available from Futaba®.
UAV (100) includes a servo control adapter (172). A servo control adapter (172) is multi-function input/output servo motion controller capable of controlling several servos. An example of such a servo control adapter is the “IOSERVO” model from National Control Devices of Osceola, Mo. The IOSERVO is described on National Control Devices website at www.controlanything.com.
UAV (100) includes a flight stabilizer system (174). A flight stabilizer system is a control module that operates servos (178) to automatically return a UAV to straight and level flight, thereby simplifying the work that must be done by navigation algorithms. An example of a flight stabilizer system useful in various embodiments of UAVs according to the present invention is model Co-Pilot™ from FMA, Inc., of Frederick, Md. The Co-Pilot flight stabilizer system identifies a horizon with heat sensors, identifies changes in aircraft attitude relative to the horizon, and sends corrective signals to the servos (178) to keep the UAV flying straight and level.
UAV (100) includes an AVCS gyro (176). An AVCS gryo is an angular vector control system gyroscope that provides control signal to the servos to counter undesired changes in attitude such as those caused by sudden gusts of wind. An example of an AVCS gyro useful in various UAVs according to the present invention is model GYA350 from Futaba®.
Remote control devices according to embodiments of the present invention typically include automated computing machinery capable of receiving user selections of pixel on GUI maps, mapping the pixel to a waypoint location, receiving downlink telemetry including for example a starting position from a GPS receiver on the UAV, calculating a heading in dependence upon the starting position, the coordinates of the waypoint, and a navigation algorithm, identifying flight control instructions for flying the UAV on the heading, and transmitting the flight control instructions as uplink telemetry from the remote control device to the UAV.
Remote control device (161) includes random access memory or ‘RAM’ (166). Stored in RAM (166) an application program 152 that implements inventive methods of the present invention. Among other things, application program (158) includes computer program instructions capable of navigating UAVs in formation according to embodiments of the present invention, including computer program steps that execute generally by assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern; identifying a waypoint for each UAV in dependence upon the UAV's pattern position; piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm, where the navigation algorithm includes repeatedly comparing the UAV's intended position and the UAV's actual position, the actual position taken from a GPS receiver, and calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold. This capability of navigating UAVs in formation is described in more detail below in this specification.
In some embodiments, the application program (152) is OSGi compliant an therefore runs on an OSGi service framework installed (not shown) on a JVM (not shown). In addition, software programs and further information for use in implementing methods of navigating a UAV according to embodiments of the present invention may be stored in RAM or in non-volatile memory (168). Non-volatile memory (168) may be implemented as a magnetic disk drive such as a micro-drive, an optical disk drive, static read only memory (‘ROM’), electrically erasable programmable read-only memory space (‘EEPROM’ or ‘flash’ memory), or otherwise as will occur to those of skill in the art.
Remote control device (161) includes communications adapter (170) implementing data communications connections (184) to other computers (162), including particularly computers on UAVs. Communications adapters implement the hardware level of data communications connections through which remote control devices communicate with UAVs directly or through networks. Examples of communications adapters include modems for wired dial-up connections, Ethernet (IEEE 802.3) adapters for wired LAN connections, 802.11b adapters for wireless LAN connections, and Bluetooth adapters for wireless microLAN connections.
The example remote control device (161) of
The method of
The method of
A socket is one end-point of a two-way communication link between two application programs running on a network. In Java, socket classes are used to represent a connection between a client program and a server program. The java.net package provides two Java classes—Socket and ServerSocket—that implement the client side of the connection and the server side of the connection, respectively. In some embodiments of the present invention, a Java web server, is included in an OSGi framework on a remote control device. Often then, a socket on the remote control device would be considered a server-side socket, and a socket on the UAV would be considered a client socket. In other embodiments of the present invention, a Java web server, is included in an OSGi framework on the UAV. In such embodiments, a socket on the UAV would be considered a server-side socket, and a socket on a remote control device would be considered a client socket.
Use of a socket requires creating a socket and creating data streams for writing to and reading from the socket. One way of creating a socket and two data streams for use with the socket is shown in the following exemplary pseudocode segment:
The first statement in this segment creates a new socket object and names it “uavSocket.” The socket constructor used here requires a fully qualified IP address of the machine the socket is to connect to, in this case the Java server on a remote control device or a UAV, and the port number to connect to. In this example, “computerAddress” is taken as a domain name that resolves to a fully qualified dotted decimal IP address. Alternatively, a dotted decimal IP address may be employed directly, as, for example, “195.123.001.001.” The second argument in the call to the socket constructor is the port number. Port number 7 is the port on which the server listens in this example, whether the server is on a remote control device or on a UAV.
The second statement in this segment gets the socket's output stream and opens a Java PrintWriter object on it. Similarly, the third statement gets the socket's input stream and opens a Java BufferedReader object on it. To send data through the socket, an application writes to the PrintWriter, as, for example:
-
- outStream.println(someWaypoint, macro, or Flight Control Instruction);
To receive data through the socket, an application reads from the BufferedReader, as show here for example:
-
- a Waypoint, GPS data, macro, or flight control instruction=in Stream.readLine( );
The method of
The method of
-
- receive new calculated heading from navigation algorithms
- read current heading from downlink telemetry
- if current heading is left of the calculated heading, identify flight control instruction: AILERONS LEFT 30 DEGREES
- if current heading is right of the calculated heading, identify flight control instruction: AILERONS RIGHT 30 DEGREES
- monitor current heading during turn
- when current heading matches calculated heading, identify flight control instruction: FLY STRAIGHT AND LEVEL
The method of
This segment opens a socket object named “uavSocket” with an input stream named “inStream.” Listening for downlink data on the socket is accomplished with a blocking call to in Stream.readLine( ) which returns a String object name “downLinkData.”
The method of
In the method of
This segment opens a socket object named “uavSocket” with an output stream named “outStream.” Sending uplink data through the socket is accomplished with a call to outStream.println( ) which takes as a call parameter a String object named “someUplinkData.”
MacrosAlthough the flow chart of
Such methods for navigating a UAV can also include assigning one or more UAV instructions to each waypoint and storing the coordinates of the waypoints and the UAV instructions in computer memory on the remote control device. A UAV instruction typically includes one or more instructions for a UAV to perform a task in connection with a waypoint. Exemplary tasks include turning on or off a camera installed on the UAV, turning on or off a light installed on the UAV, orbiting a waypoint, or any other task that will occur to those of skill in the art.
UAV instructions to perform tasks in connection with a waypoint may be encoded in, for example, XML (the eXtensible Markup Language) as shown in the following exemplary XML segment:
This XML example has a root element named ‘UAV-instructions.’ The example contains several subelements named ‘macro.’ One ‘macro’ subelement contains a waypoint location representing an instruction to fly to 33° 44′ 10″ N 30° 15′ 50″ W. That macro subelement also contains several instructions for tasks to be performed when the UAV arrives at the waypoint coordinates, including orbiting around the waypoint coordinates, turning on an on-board video camera, continuing to orbit for thirty minutes with the camera on, turning off the video camera, and continuing to a next waypoint. Only one macro set of UAV instructions is shown in this example, but that is not a limitation of the invention. In fact, such sets of UAV instructions may be of any useful size as will occur to those of skill in the art.
Exemplary methods of navigating a UAV also include flying the UAV to each waypoint in accordance with one or more navigation algorithms and operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint. Operating the UAV at the waypoint in accordance with the UAV instructions for each waypoint typically includes identifying flight control instructions in dependence upon the UAV instructions for each waypoint and transmitting the flight control instructions as uplink telemetry through a socket. Flight control instructions identified in dependence upon the UAV instructions for each waypoint typically include specific flight controls to move the flight control surfaces of the UAV causing the UAV to fly in accordance with the UAV instructions. For example, in the case of a simple orbit, a flight control instruction to move the ailerons and hold them at a certain position causing the UAV to bank at an angle can effect an orbit around a waypoint.
Operating the UAV at the waypoint in accordance with the UAV instructions for each waypoint typically includes transmitting the flight control instructions as uplink data from the remote control device to the UAV. Transmitting the flight control instructions as uplink data from the remote control device to the UAV may be carried out by use of any data communications protocol, including, for example, transmitting the flight control instructions as form data, URI encoded data, in an HTTP message, a WAP message, an HDML message, or any other data communications protocol message as will occur to those of skill in the art.
Pixel MappingFor further explanation of the process of mapping pixels' locations to Earth coordinates,
The illustrated area of the surface of the Earth has corresponding boundary points identified as Lat1, Lon1; Lat1, Lon2; Lat2, Lon2; and Lat2, Lon1. This example assumes that the distance along one side of surface area (504) is 100 nautical miles, so that the distance expressed in terms of latitude or longitude between boundary points of surface area (504) is 100 minutes or 1° 40′.
In typical embodiments, mapping a pixel's location on the GUI to Earth coordinates of a waypoint includes mapping pixel boundaries of the GUI map to Earth coordinates. In this example, the GUI map boundary at Row1, Col1 maps to the surface boundary point at Lat1, Lon1; the GUI map boundary at Row1, Col2 maps to the surface boundary point at Lat1, Lon2; the GUI map boundary at Row2, Col2 maps to the surface boundary point at Lat2, Lon2; the GUI map boundary at Row2, Col1 maps to the surface boundary point at Lat2, Lon1.
Mapping a pixel's location on the GUI to Earth coordinates of a waypoint typically also includes identifying a range of latitude and a range of longitude represented by each pixel. The range of latitude represented by each pixel may be described as (Lat2−Lat1)/Nrows, where (Lat2−Lat1) is the length in degrees of the vertical side of the corresponding surface (504), and Nrows is the number of rows of pixels. In this example, (Lat2−Lat1) is 1° 40′ or 100 nautical miles, and Nrows is 100 rows of pixels. The range of latitude represented by each pixel in this example therefore is one minute of arc or one nautical mile.
Similarly, the range of longitude represented by each pixel may be described as (Lon2−Lon1)/Ncols, where (Lon2−Lon1) is the length in degrees of the horizontal side of the corresponding surface (504), and Ncols is the number of columns of pixels. In this example, (Lon2−Lon1) is 1° 40′ or 100 nautical miles, and Ncols is 100 columns of pixels. The range of longitude represented by each pixel in this example therefore is one minute of arc or one nautical mile.
Mapping a pixel's location on the GUI to Earth coordinates of a waypoint typically also includes locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map. The region is the portion of the surface corresponding to the pixel itself. That region is located generally by multiplying in both dimensions, latitude and longitude, the range of latitude and longitude by column or row numbers of the pixel location on the GUI map. That is, a latitude for the surface region of interest is given by Expression 1.
Lat1+Prow((Lat2−Lat1)/Nrows) (Exp. 1)
In Expression 1:
-
- Lat1 is the latitude of an origin point for the surface area (504) corresponding generally to the GUI map,
- Prow is the row number of the pixel location on the GUI map, and
- ((Lat2−Lat1)/Nrows) is the range of latitude represented by the pixel.
Similarly, a longitude for the surface region of interest is given by Expression 2.
Lon1+Pcol((Lon2−Lon1)/Ncols) (Exp. 2)
In Expression 2:
-
- Lon1 is the longitude of an origin point for the surface area (504) corresponding generally to the GUI map,
- Pcol is the column number of the pixel location on the GUI map, and
- ((Lon2−Lon1)/Ncols) is the range of longitude represented by the pixel.
Referring to
More particularly, locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map, as illustrated by Expression 3, may include multiplying the range of longitude represented by each pixel by a column number of the selected pixel, yielding a first multiplicand; and multiplying the range of longitude represented by each pixel by 0.5, yielding a second multiplicand; adding the first and second multiplicands to an origin longitude of the GUI map.
Lon1+Pcol((Lon2−Lon1)/Ncol)+0.5((Lon2−Lon1)/Ncols) (Exp. 3)
In Expression 3, the range of longitude represented by each pixel is given by ((Lon2−Lon1)/Ncols), and the first multiplicand is Pcol((Lon2−Lon1)/Ncols). The second multiplicand is given by 0.5((Lon2−Lon1)/Ncols).
Similarly, locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map, as illustrated by Expression 4, typically also includes multiplying the range of latitude represented by each pixel by a row number of the selected pixel, yielding a third multiplicand; multiplying the range of latitude represented by each pixel by 0.5, yielding a fourth multiplicand; and adding the third and fourth multiplicands to an origin latitude of the GUI map.
Lat1+Prow((Lat2−Lat1)/Nrows)+0.5((Lat2−Lat1)/Nrows) (Exp. 4)
In Expression 4, the range of latitude represented by each pixel is given by ((Lat2−Lat1)/Nrows), and the third multiplicand is Prow((Lat2−Lat1)/Nrows). The fourth multiplicand is given by 0.5((Lat2−Lat1)/Nrows). Expressions 3 and 4 taken together map the location of pixel (412) to the center (510) of the located region (508).
Navigation on a Heading to a WaypointAn exemplary method of navigating in accordance with a navigation algorithm is explained with reference to
The method of
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to
The method of
In this example, calculating a shortest distance between the current position and a cross track also includes calculating the angle (910) between a direction from the current position (912) to the waypoint (704) and a cross track direction. In the example of
In the current example, calculating a shortest distance between the current position and a cross track also includes calculating the tangent of the angle between a direction from the current position to the waypoint and a cross track direction and multiplying the tangent of the angle by the distance from the current position to the waypoint.
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to
In the method of
In the method of
Transmitting (1012) flight control instructions that pilot the UAV toward the cross track is carried out by transmitting flight control instructions to turn to a heading no more than ninety degrees from the cross track direction, turning to the left if the current position is right of the cross track and to the right if the current position is left of the cross track. Transmitting (1014) flight control instructions that pilot the UAV in the cross track direction toward the waypoint transmitting flight control instructions to turn the UAV to the cross track direction and then flying straight and level on the cross track direction.
In many embodiments of the method of
The method of
The method of
This segment opens a socket object named “uavSocket” with an output stream named “outStream.” Transmitting uplink telemetry through the socket is accomplished with a call to outStream.println( ) which takes as a call parameter a String object named “someUplinkData.”
The method of
Receiving downlink telemetry through a socket may be implemented by opening a socket, creating an input stream for the socket, and reading data from the input stream, as illustrated, for example, in the following segment of pseudocode:
This segment opens a socket object named “uavSocket” with an input stream named “in Stream.” Receiving downlink telemetry through the socket is accomplished with a blocking call to in Stream.readLine( ) which returns a String object name “downLinkTelemetry.”
In the method of
As mentioned above, embodiments of the present invention often support navigating a UAV along a route having many waypoints, including a final waypoint and one or more intermediate waypoints. That is, methods of the kind illustrated in
Such methods of navigating a UAV can also include assigning one or more UAV instructions to each waypoint and transmitting the coordinates of the waypoints and the UAV instructions in the uplink telemetry through the socket to the UAV. A UAV instruction typically includes one or more instructions for a UAV to perform a task in connection with a waypoint. Exemplary tasks include turning on or off a camera installed on the UAV, turning on or off a light installed on the UAV, orbiting a waypoint, or any other task that will occur to those of skill in the art. Such exemplary methods of navigating a UAV also include storing the coordinates of the waypoints and the UAV instructions in computer memory on the UAV, piloting the UAV to each waypoint in accordance with one or more navigation algorithms, and operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint.
Navigation on a Course to a WaypointA further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to
In the method of
In
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to
The method of
It is also advantageous to have an ability to navigate UAVs together in a flight formation or pattern. Exemplary methods, systems, and products for navigating UAVs together in a flight formation or pattern are described with reference to the accompanying drawings, beginning with
The method of
-
- UAV (100) may be assigned to a pattern position one mile to the right of the position of UAV (226),
- UAV (234) may be assigned to a pattern position one mile behind the position of UAV (226), and
- UAV (142) may be assigned to a pattern position one mile to the right and one mile behind the position of UAV (226).
The method of
Similarly, if in the pattern of
-
- the position of the pattern position occupied by UAV (226) is designated an anchor position and assigned the waypoint (230),
- UAV (100) is assigned to a pattern position one mile to the right of the position of UAV (226),
- UAV (234) is assigned to a pattern position one mile behind the position of UAV (226), and
- UAV (142) is assigned to a pattern position one mile to the right and one mile behind the position of UAV (226),
then: - waypoint (210) is calculated for UAV (100) as one mile to the right of the waypoint (230) assigned to the anchor position,
- waypoint (238) is calculated for UAV (234) as one mile behind the waypoint (230) assigned to the anchor position, and
- waypoint (248) is calculated for UAV (142) as one mile to the right and one mile behind the waypoint (230) assigned to the anchor position.
The method of
Each UAV's intended position may be specified by the UAV's position in the pattern, a cross track to the UAV's waypoint, and a flight schedule. The intended position is a conceptual position, an ideal used to navigate UAVs in formation. The intended position is the position on the cross track where the UAV would be if it flew precisely on schedule directly along the cross track.
A flight schedule is a time limitation upon travel from a starting point to a waypoint. A flight schedule may be established by assigning an arrival time at the waypoints of the pattern, from which a groundspeed may be inferred. Or a flight schedule may be established by assigning a groundspeed for the formation, from which an arrival time can be inferred. Either way, the schedule established an intended position for the formation for every moment of the flight. If the groundspeed is taken as the governing parameter, then the arrival time is the groundspeed multiplied by the distance between the starting point and the waypoint. If the arrival time is taken as the governing parameter, then the groundspeed is the distance between the starting point and the waypoint divided by the difference between the arrival time and the start time. Either way, the groundspeed is known and the intended position of the pattern at any point in time is the groundspeed multiplied by the time elapsed after the start time. Similarly, for each UAV in a pattern, the UAV's intended position at any point of time elapsed after the start time is a position on a cross track where the UAV would be if the UAV's course were directly over the cross track at that point in time.
The exemplary UAVs of
Piloting UAVs in dependence upon a navigation algorithm, together in a flight formation or pattern, usefully includes startup and continuation of normal flight to UAV waypoints, that is, flight when a UAV is within its error threshold. An exemplary algorithm for such flight is described with reference to
The method of
a=√{square root over (b2+c2−2ab cos A)},
where:
-
- a is the airspeed needed for flying from the starting point to the waypoint on schedule, indicated on
FIG. 21 as the length (280) of the flight vector (250), - b is the wind speed, indicated on
FIG. 21 as the length (282) of the wind vector (208), - c is the course groundspeed for flying from the starting point to the waypoint on schedule, indicated on
FIG. 21 as the length (284) of the course vector (212), and - A is the angular difference between the wind direction and the ground course direction along the cross track, indicated on
FIG. 21 as the angle ‘A.’
- a is the airspeed needed for flying from the starting point to the waypoint on schedule, indicated on
The wind direction is indicated on
The method of
B=sin−1(b(sin A)/a),
where:
-
- B is the wind correction angle, which in combination with a direction to a waypoint yields a heading, indicated on
FIG. 21 as angle ‘F,’ - b is the wind speed, indicated on
FIG. 21 as the length (282) of the wind vector (208), - A is the angular difference between the wind direction and the ground course direction along the cross track, indicated on
FIG. 21 as the angle ‘A,’ and - a is the airspeed needed for flying from the starting point to the waypoint on schedule, calculated by use of the law of cosines as described above, and indicated on
FIG. 21 as the length (280) of the flight vector (250).
- B is the wind correction angle, which in combination with a direction to a waypoint yields a heading, indicated on
Having the wind correction angle B, calculating the heading, angle F on
The method of
Calculating a corrective flight vector is further explained with reference to
As mentioned above, an actual flight course is rarely directly over a cross track. For flying in formation, a course for each UAV that approximates a cross track is adequate if a UAV's actual position in its actual course does not vary too much from its intended position. What is ‘too much’ is defined by an error threshold. The navigation algorithm of
The method of
The method of
a=√{square root over (b2+c2−2ab cos A)},
where:
-
- a is the corrective airspeed for arriving at the corrective waypoint on schedule, indicated on
FIG. 24 as the length (292) of the corrective flight vector (204), - b is the wind speed, indicated on
FIG. 24 as the length (294) of the wind vector (208), - c is the groundspeed to the remedial waypoint, indicated on
FIG. 24 as the length (296) of the ground course to the corrective waypoint (216), and - A is the angular difference between the wind direction and the ground course direction to the corrective waypoint, indicated on
FIG. 24 as the angle ‘A.’
- a is the corrective airspeed for arriving at the corrective waypoint on schedule, indicated on
The wind direction is indicated on
The method of
B=sin−1(b(sin A)/a),
where:
-
- B is the wind correction angle, which in combination with a direction to a corrective waypoint yields a heading, indicated on
FIG. 24 as angle ‘B,’ - b is the wind speed, indicated on
FIG. 24 as the length (294) of the wind vector (208), - A is the angular difference between the wind direction and the ground course to the corrective waypoint, indicated on
FIG. 24 as the angle ‘A,’ and - a is the airspeed needed to fly from the actual position (218) to the corrective waypoint so as to arrive at the corrective waypoint on schedule, calculated by use of the law of cosines as described above, and indicated on
FIG. 24 as the length (292) of the corrective flight vector (204).
- B is the wind correction angle, which in combination with a direction to a corrective waypoint yields a heading, indicated on
Having the wind correction angle B, calculating the corrective heading, angle F on
All the navigational calculations for navigating UAVs in formation according to embodiments of the present invention may be carried in computers located either in the UAVs or in one or more ground stations. In systems that carry out navigational calculations in a UAV, uplink telemetry may provide starting points, waypoints, and other flight parameters to the UAV, and downlink telemetry may provide GPS locations for the UAV to the ground station. In systems that carry out navigational calculations in ground stations, downlink telemetry may provide GPS locations, and uplink telemetry may provide flight control instructions.
It will be understood from the foregoing description that modifications and changes may be made in various embodiments of the present invention without departing from its true spirit. The descriptions in this specification are for purposes of illustration only and are not to be construed in a limiting sense. The scope of the present invention is limited only by the language of the following claims.
Claims
1. A method for navigating UAVs in formation, the method comprising:
- assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern;
- identifying a waypoint for each UAV in dependence upon the UAV's pattern position;
- piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm, the navigation algorithm including:
- repeatedly comparing the UAV's intended position and the UAV's actual position, the actual position taken from a GPS receiver; and
- calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold.
2. The method of claim 1 wherein:
- assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern further comprises designating an anchor position for the pattern and assigning pattern positions to the other UAVs relative to the anchor position; and
- identifying a waypoint for each UAV in dependence upon its pattern position further comprises designating a waypoint for the anchor position and calculating each UAV's waypoint in dependence upon the waypoint for the anchor and in dependence upon the UAV's position in the pattern.
3. The method of claim 1 wherein each UAV's intended position is specified by the UAV's position in the pattern, a cross track to the UAV's waypoint, and a flight schedule.
4. The method of claim 1 wherein piloting the UAVs in dependence upon a navigation algorithm further comprises:
- identifying a cross track to a waypoint for each UAV, the cross track having a cross track direction;
- piloting the UAV to a starting point on the cross track;
- calculating an airspeed for flying from the starting point to the waypoint on schedule;
- calculating a heading in dependence upon wind speed, wind direction, airspeed, and the cross track direction; and
- flying the UAV on the heading at the airspeed.
5. The method of claim 1 wherein calculating a corrective flight vector further comprises:
- selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint;
- calculating a corrective airspeed for arriving at the corrective waypoint on schedule; and
- calculating a corrective heading in dependence upon the calculated airspeed.
6. The method of claim 5 wherein selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint further comprises selecting a corrective waypoint at a predetermined portion of the distance between a UAV's intended position and its waypoint.
7. The method of claim 5 wherein calculating a corrective airspeed for arriving at the corrective waypoint on schedule further comprises calculating a groundspeed needed to bring the UAV to the remedial waypoint on schedule, including dividing the distance from the actual position to the corrective waypoint by the difference between the current time and the schedule time for the corrective waypoint
8. A system for navigating UAVs in formation, the system comprising:
- means for assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern;
- means for identifying a waypoint for each UAV in dependence upon the UAV's pattern position;
- means for piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm;
- means for repeatedly comparing the UAV's intended position and the UAV's actual position, the actual position taken from a GPS receiver; and
- means for calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold.
9. The system of claim 8 wherein:
- means for assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern further comprises means for designating an anchor position for the pattern and assigning pattern positions to the other UAVs relative to the anchor position; and
- means for identifying a waypoint for each UAV in dependence upon its pattern position further comprises means for designating a waypoint for the anchor position and calculating each UAV's waypoint in dependence upon the waypoint for the anchor and in dependence upon the UAV's position in the pattern.
10. The system of claim 8 wherein means for piloting the UAVs in dependence upon a navigation algorithm further comprises:
- means for identifying a cross track to a waypoint for each UAV, the cross track having a cross track direction;
- means for piloting the UAV to a starting point on the cross track;
- means for calculating an airspeed for flying from the starting point to the waypoint on schedule;
- means for calculating a heading in dependence upon wind speed, wind direction, airspeed, and the cross track direction; and
- means for flying the UAV on the heading at the airspeed.
11. The system of claim 8 wherein means for calculating a corrective flight vector further comprises:
- means for selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint;
- means for calculating a corrective airspeed for arriving at the corrective waypoint on schedule; and
- means for calculating a corrective heading in dependence upon the calculated airspeed.
12. The system of claim 11 wherein means for selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint further comprises means for selecting a corrective waypoint at a predetermined portion of the distance between a UAV's intended position and its waypoint.
13. The system of claim 11 wherein means for calculating a corrective airspeed for arriving at the corrective waypoint on schedule further comprises means for calculating a groundspeed needed to bring the UAV to the remedial waypoint on schedule, including means for dividing the distance from the actual position to the corrective waypoint by the difference between the current time and the schedule time for the corrective waypoint.
14. A computer program product for navigating UAVs in formation, the computer program product comprising:
- a recording medium;
- means, recorded on the recording medium, for assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern;
- means, recorded on the recording medium, for identifying a waypoint for each UAV in dependence upon the UAV's pattern position;
- means, recorded on the recording medium, for piloting the UAVs in the pattern toward their waypoints in dependence upon a navigation algorithm;
- means, recorded on the recording medium, for repeatedly comparing the UAV's intended position and the UAV's actual position, the actual position taken from a GPS receiver; and
- means, recorded on the recording medium, for calculating a corrective flight vector when the distance between the UAV's actual and intended positions exceeds an error threshold.
15. The computer program product of claim 14 wherein:
- means, recorded on the recording medium, for assigning pattern positions to each of a multiplicity of UAVs flying together in a pattern further comprises means, recorded on the recording medium, for designating an anchor position for the pattern and assigning pattern positions to the other UAVs relative to the anchor position; and
- means, recorded on the recording medium, for identifying a waypoint for each UAV in dependence upon its pattern position further comprises means, recorded on the recording medium, for designating a waypoint for the anchor position and calculating each UAV's waypoint in dependence upon the waypoint for the anchor and in dependence upon the UAV's position in the pattern.
16. The computer program product of claim 14 wherein each UAV's intended position is specified by the UAV's position in the pattern, a cross track to the UAV's waypoint, and a flight schedule.
17. The computer program product of claim 14 wherein means, recorded on the recording medium, for piloting the UAVs in dependence upon a navigation algorithm further comprises:
- means, recorded on the recording medium, for identifying a cross track to a waypoint for each UAV, the cross track having a cross track direction;
- means, recorded on the recording medium, for piloting the UAV to a starting point on the cross track;
- means, recorded on the recording medium, for calculating an airspeed for flying from the starting point to the waypoint on schedule;
- means, recorded on the recording medium, for calculating a heading in dependence upon wind speed, wind direction, airspeed, and the cross track direction; and
- means, recorded on the recording medium, for flying the UAV on the heading at the airspeed.
18. The computer program product of claim 14 wherein means, recorded on the recording medium, for calculating a corrective flight vector further comprises:
- means, recorded on the recording medium, for selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint;
- means, recorded on the recording medium, for calculating a corrective airspeed for arriving at the corrective waypoint on schedule; and
- means, recorded on the recording medium, for calculating a corrective heading in dependence upon the calculated airspeed.
19. The computer program product of claim 18 wherein means, recorded on the recording medium, for selecting a corrective waypoint on a cross track between a UAV's intended position and its waypoint further comprises means, recorded on the recording medium, for selecting a corrective waypoint at a predetermined portion of the distance between a UAV's intended position and its waypoint.
20. The computer program product of claim 18 wherein means, recorded on the recording medium, for calculating a corrective airspeed for arriving at the corrective waypoint on schedule further comprises means, recorded on the recording medium, for calculating a groundspeed needed to bring the UAV to the remedial waypoint on schedule, including means, recorded on the recording medium, for dividing the distance from the actual position to the corrective waypoint by the difference between the current time and the schedule time for the corrective waypoint.
Type: Application
Filed: Oct 1, 2008
Publication Date: Jan 29, 2009
Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION (Armonk, NY)
Inventors: William Kress Bodin (Austin, TX), Jesse Redman (Cedar Park, TX), Derral Charles Thorson (Austin, TX)
Application Number: 12/242,995
International Classification: G05D 1/10 (20060101);