NAVIGATING A UAV WITH ON-BOARD NAVIGATION ALGORITHMS WITH FLIGHT DEPICTION
Navigating a UAV including receiving in a remote control device a user's selection of a GUI map pixel that represents a waypoint for UAV navigation, mapping the pixel's location on the GUI to Earth coordinates of the waypoint, transmitting the coordinates of the waypoint to the UAV, reading a starting position from a GPS receiver on the UAV, and piloting the UAV, under control of a navigation computer on the UAV, from the starting position to the waypoint in accordance with a navigation algorithm. While piloting the UAV from the starting position to the waypoint, such embodiments include reading from the GPS receiver a sequence of GPS data representing a flight path of the UAV, and depicting the flight of the UAV with 3D computer graphics, including a computer graphic display of a satellite image of the Earth, in dependence upon the GPS data.
Latest Patents:
- METHODS AND THREAPEUTIC COMBINATIONS FOR TREATING IDIOPATHIC INTRACRANIAL HYPERTENSION AND CLUSTER HEADACHES
- OXIDATION RESISTANT POLYMERS FOR USE AS ANION EXCHANGE MEMBRANES AND IONOMERS
- ANALOG PROGRAMMABLE RESISTIVE MEMORY
- Echinacea Plant Named 'BullEchipur 115'
- RESISTIVE MEMORY CELL WITH SWITCHING LAYER COMPRISING ONE OR MORE DOPANTS
1. Field of the Invention
The field of the invention is data processing, or, more specifically, methods, systems, and products for navigating an unmanned aerial vehicle (“UAV”).
2. Description Of Related Art
Many forms of UAV are available in prior art, both domestically and internationally. Their payload weight carrying capability, their accommodations (volume, environment), their mission profiles (altitude, range, duration), and their command, control and data acquisition capabilities vary significantly. Routine civil access to these various UAV assets is in an embryonic state.
Conventional UAVs are typically manually controlled by an operator who may view aspects of a UAV's flight using cameras installed on the UAV with images provided through downlink telemetry. Navigating such UAVs from a starting position to one or more waypoints requires an operator to have specific knowledge of the UAV's flight, including such aspects as starting location, the UAV's current location, waypoint locations, and so on. Operators of prior art UAVs usually are required generally to manually control the UAV from a starting position to a waypoint with little aid from automation. There is therefore an ongoing need for improvement in the area of UAV navigations.
SUMMARY OF THE INVENTIONMethods, systems, and products are described for UAV navigation that enable an operator to input a single interface operation, a mouseclick or joystick button click, thereby selecting GUI pixel from a displayed map of the surface of the Earth. The selected pixel maps to a waypoint. The waypoint is uploaded through uplink telemetry to a UAV which calculates a heading and flies, according to a navigation algorithm, a course to the waypoint. The heading is not necessarily the course if wind is present, depending on the navigation algorithm chosen for the flight. All this occurs with a single keystroke or mouseclick from the operator.
The operator's remote control device from which the pixel is selected is enabled according to embodiments of the present invention to be very thin. Often the remote control device can be a browser in a laptop or personal computer or a microbrowser in a PDA enhanced only with client-side scripting sufficient to map a pixel to a waypoint and transmit the waypoint to the UAV. The UAV itself generally comprises the intelligence, the navigation algorithms, a web server to download map images to a client browser in a remote control device, a repository of Landsat maps from which HTML screens are formulated for download to the remote control device, and so on.
In addition to uplinking a single waypoint, operators of remote control devices according to embodiments of the present invention are enabled to enter through a user interface and upload to the UAV many waypoints which taken in sequence form an entire mission for a UAV that flies from waypoint to waypoint, eventually returning to a starting point. In addition to providing for a mission route comprising many waypoints, typical embodiments also support ‘macros,’ sets of UAV instructions associated with waypoints. Such UAV instructions can include, for example, instructions to orbit, take photographs or stream video, and continue flying a route or mission to a next waypoint. Because waypoints are entered with selected pixels and macros may be created by selecting UAV instructions from a pull down menu in a GUI, complex missions may be established with a few keystrokes of mouseclicks on an interface of a remote control device. Because the waypoints and UAV instructions are uploaded and stored on the UAV along with the navigation algorithms needed to travel from waypoint to waypoint, the remote control device may lose communications with the UAV or even be destroyed completely, and the UAV will simply continue its mission.
More particularly, methods, systems, and products are disclosed in this specification for navigating a UAV. Typical embodiments include receiving in a remote control device a user's selection of a GUI map pixel that represents a waypoint for UAV navigation, the pixel having a location on the GUI, mapping the pixel's location on the GUI to Earth coordinates of the waypoint, transmitting the coordinates of the waypoint to the UAV, reading a starting position from a GPS receiver on the UAV, and piloting the UAV, under control of a navigation computer on the UAV, from the starting position to the waypoint in accordance with a navigation algorithm. While piloting the UAV from the starting position to the waypoint, such embodiments include reading from the GPS receiver a sequence of GPS data representing a flight path of the UAV, and depicting the flight of the UAV with 3D computer graphics, including a computer graphic display of a satellite image of the Earth, in dependence upon the GPS data.
In many embodiments, depicting the flight of the UAV includes determining, on the UAV, a display attitude of the UAV in dependence upon the sequence of GPS data, calculating, on the UAV, from the sequence of GPS data, the UAV's course, creating, on the UAV, images for display in dependence upon the display attitude, the course, and a satellite image stored on the UAV, and downloading the images for display from the UAV to the remote control device. In some embodiments, depicting the flight of the UAV includes downloading the GPS sequence from the UAV to the remote control device, determining, in the remote control device, a display attitude of the UAV in dependence upon the sequence of GPS data, calculating, in the remote control device, from the sequence of GPS data, the UAV's course, and creating, in the remote control device, images for display in dependence upon the display attitude, the course, and a satellite image stored on the remote control device.
In many embodiments, depicting the flight of the UAV includes determining a display attitude of the UAV in dependence upon the sequence of GPS data, including detecting changes in the UAV's course from the sequence of GPS data, and determining a display roll angle in dependence upon the detected course changes. In some embodiments, depicting the flight of the UAV includes determining a display attitude of the UAV in dependence upon the sequence of GPS data, including detecting changes in the UAV's course from the sequence of GPS data, and determining a display yaw angle in dependence upon the detected course changes. In many embodiments, depicting the flight of the UAV includes determining a display attitude of the UAV in dependence upon the sequence of GPS data, including detecting changes in the UAV's altitude from the sequence of GPS data, determining a display pitch angle in dependence upon the detected altitude changes.
Many embodiments include receiving user selections of a multiplicity of GUI map pixels representing waypoints, each pixel having a location on the GUI, mapping each pixel location to Earth coordinates of a waypoint, assigning one or more UAV instructions to each waypoint, transmitting the coordinates of the waypoints and the UAV instructions to the UAV, storing the coordinates of the waypoints and the UAV instructions in computer memory on the UAV, piloting the UAV to each waypoint in accordance with one or more navigation algorithms, and operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint. In some embodiments, mapping the pixel's location on the GUI to Earth coordinates of the waypoint includes mapping pixel boundaries of the GUI map to Earth coordinates, identifying a range of latitude and a range of longitude represented by each pixel, and locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map.
In many embodiments, wherein locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map includes multiplying the range of longitude represented by each pixel by a column number of the selected pixel, yielding a first multiplicand, multiplying the range of longitude represented by each pixel by 0.5, yielding a second multiplicand, adding the first and second multiplicands to an origin longitude of the GUI map, multiplying the range of latitude represented by each pixel by a row number of the selected pixel, yielding a third multiplicand, multiplying the range of latitude represented by each pixel by 0.5, yielding a fourth multiplicand, and adding the third and fourth multiplicands to an origin latitude of the GUI map.
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular descriptions of exemplary embodiments of the invention as illustrated in the accompanying drawings wherein like reference numbers generally represent like parts of exemplary embodiments of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is described to a large extent in this specification in terms of methods for navigating a UAV. Persons skilled in the art, however, will recognize that any computer system that includes suitable programming means for operating in accordance with the disclosed methods also falls well within the scope of the present invention. Suitable programming means include any means for directing a computer system to execute the steps of the method of the invention, including for example, systems comprised of processing units and arithmetic-logic circuits coupled to computer memory, which systems have the capability of storing in computer memory, which computer memory includes electronic circuits configured to store data and program instructions, programmed steps of the method of the invention for execution by a processing unit.
The invention also may be embodied in a computer program product, such as a diskette or other recording medium, for use with any suitable data processing system. Embodiments of a computer program product may be implemented by use of any recording medium for machine-readable information, including magnetic media, optical media, or other suitable media. Persons skilled in the art will immediately recognize that any computer system having suitable programming means will be capable of executing the steps of the method of the invention as embodied in a program product. Persons skilled in the art will recognize immediately that, although most of the exemplary embodiments described in this specification are oriented to software installed and executing on computer hardware, nevertheless, alternative embodiments implemented as firmware or as hardware are well within the scope of the present invention.
Definitions“Air speed” means UAV air speed, the speed of the UAV through the air.
A “cross track” is a fixed course from a starting point directly to a waypoint. A cross track has a direction, a ‘cross track direction,’ that is the direction straight from a starting point to a waypoint. That is, a cross track direction is the heading that a UAV would fly directly from a starting point to a waypoint in the absence of wind.
“GUI” means graphical user interface, a display means for a computer screen.
“Heading” means the compass heading of the UAV. “Course” means the direction of travel of the UAV over the ground. That is, a “course” in this specification is what is called, in some lexicons of air navigation, a ‘track.’ In the absence of wind, or in the presence of a straight tailwind or straight headwind, the course and the heading are the same direction. In the presence of crosswind, the course and the heading are different directions.
“Position” refers to a location in the air or over the ground. ‘Position’ is typically specified as Earth coordinates, latitude and longitude. A specification of position may also include altitude.
A “waypoint” is a position chosen as a destination for navigation of a route. A route has one or more waypoints. That is, a route is composed of waypoints, including at least one final waypoint, and one or more intermediate waypoints.
“TDMA” stands for Time Division Multiple Access, a technology for delivering digital wireless service using time-division multiplexing. TDMA works by dividing a radio frequency into time slots and then allocating slots to multiple calls. In this way, a single frequency can support multiple, simultaneous data channels. TDMA is used by GSM.
“GSM” stands for Global System for Mobile Communications, a digital cellular standard. GSM at this time is the de facto standard for wireless digital communications in Europe and Asia.
“CDPD” stands for Cellular Digital Packet Data, a data transmission technology developed for use on cellular phone frequencies. CDPD uses unused cellular channels to transmit data in packets. CDPD supports data transfer rates of up to 19.2 Kbps.
“GPRS” stands for General Packet Radio Service, a standard for wireless data communications which runs at speeds up to 150 Kbps, compared with current GSM systems which cannot support more than about 9.6 Kbps. GPRS, which supports a wide range of speeds, is an efficient use of limited bandwidth and is particularly suited for sending and receiving small bursts of data, such as e-mail and Web browsing, as well as large volumes of data.
“EDGE” stands for Enhanced Data Rates for GSM Evolution, a standard for wireless data communications supporting data transfer rates of more than 300 Kbps. GPRS and EDGE are considered interim steps on the road to UMTS.
“UMTS” stands for Universal Mobile Telecommunication System, a standard for wireless data communications supporting data transfer rates of up to 2 Mpbs. UMTS is also referred to W-CDMA for Wideband Code Division Multiple Access.
Navigating a UAV with On-board Navigation Algorithms With Flight Depiction Methods, systems, and products for navigating a UAV are explained with reference to the accompanying drawings, beginning with
The system of
Each remote control device also supports at least one user input device through which a user may enter the user's selection of a pixel. Examples of user input devices in the system of
The system of
The system of
UAVs according to embodiments of the present invention typically include, not only an aircraft, but also automated computing machinery capable of receiving GPS data, operating telemetry between the UAV and one or more remote control devices, and navigating a UAV among waypoints.
UAV (100) includes random access memory or ‘RAM’ (166). Stored in RAM (166) is an application program (158) that implements inventive methods according to embodiments of the present invention. In some embodiments, the application programming runs on an OSGi services framework (156). OSGi Stands for ‘Open Services Gateway Initiative.’ The OSGi specification is a Java-based application layer framework that provides vendor neutral application layer APIs and functions. An OSGi service framework (126) is written in Java and therefore typically runs on a Java Virtual Machine (JVM) (154) which in turn runs on an operating system (150). Examples of operating systems useful in UAVs according to the present invention include Unix, AIX™, and Microsoft Windows™.
In OSGi, the framework is a hosting platform for running ‘services’. Services are the main building blocks for creating applications according to the OSGi. A service is a group of Java classes and interfaces that implement a certain feature. The OSGi specification provides a number of standard services. For example, OSGi provides a standard HTTP service that can respond to requests from HTTP clients, such as, for example, remote control devices according to embodiments of the present invention. That is, such remote control devices are enabled to communicate with a UAV having an HTTP service by use of data communications messages in the HTTP protocol.
Services in OSGi are packaged in ‘bundles’ with other files, images, and resources that the services need for execution. A bundle is a Java archive or ‘JAR’ file including one or more service implementations, an activator class, and a manifest file. An activator class is a Java class that the service framework uses to start and stop a bundle. A manifest file is a standard text file that describes the contents of the bundle.
The services framework in OSGi also includes a service registry. The service registry includes a service registration including the service's name and an instance of a class that implements the service for each bundle installed on the framework and registered with the service registry. A bundle may request services that are not included in the bundle, but are registered on the framework service registry. To find a service, a bundle performs a query on the framework's service registry.
In the UAV (100) of
UAV (100) includes communications adapter (170) implementing data communications connections (184) to other computers (162), which may be wireless networks, satellites, remote control devices, servers, or others as will occur to those of skill in the art. Communications adapters implement the hardware level of data communications connections through which UAVs transmit wireless data communications. Examples of communications adapters include wireless modems for dial-up connections through wireless telephone networks.
UAV (100) includes servos (178). Servos (178) are proportional control servos that convert digital control signals from system bus (160) into actual proportional displacement of flight control surfaces, ailerons, elevators, and the rudder. The displacement of flight control surfaces is ‘proportional’ to values of digital control signals, as opposed to the ‘all or nothing’ motion produces by some servos. In this way, ailerons, for example, may be set to thirty degrees, sixty degrees, or any other supported angle rather than always being only neutral or fully rotated. Several proportional control servos useful in various UAVs according to embodiments of the present invention are available from Futaba®.
UAV (100) includes a servo control adapter (172). A servo control adapter (172) is multi-function input/output servo motion controller capable of controlling several servos. An example of such a servo control adapter is the “IOSERVO” model from National Control Devices of Osceola, Mo. The IOSERVO is described on National Control Devices website at www.controlanything.com.
UAV (100) includes a flight stabilizer system (174). A flight stabilizer system is a control module that operates servos (178) to automatically return a UAV to straight and level flight, thereby simplifying the work that must be done by navigation algorithms. An example of a flight stabilizer system useful in various embodiments of UAVs according to the present invention is model Co-Pilot™ from FMA, Inc., of Frederick, Md. The Co-Pilot flight stabilizer system identifies a horizon with heat sensors, identifies changes in aircraft attitude relative to the horizon, and sends corrective signals to the servos (178) to keep the UAV flying straight and level.
UAV (100) includes an AVCS gyro (176). An AVCS gryo is an angular vector control system gyroscope that provides control signal to the servos to counter undesired changes in attitude such as those caused by sudden gusts of wind. An example of an AVCS gyro useful in various UAVs according to the present invention is model GYA350 from Futaba®.
Remote control devices according to embodiments of the present invention typically comprise automated computing machinery capable of receiving user selections of pixel on GUI maps, mapping the pixel to a waypoint location, and transmitting the waypoint location to a UAV.
Remote control device (161) includes random access memory or ‘RAM’ (166). Stored in RAM (166) an application program 152 that implements inventive methods of the present invention. In some embodiments, the application program (152) is OSGi compliant an therefore runs on an OSGi services framework installed (not shown) on a JVM (not shown). In addition, software programs and further information for use in implementing methods of navigating a UAV according to embodiments of the present invention may be stored in RAM or in non-volatile memory (168). Non-volatile memory (168) may be implemented as a magnetic disk drive such as a micro-drive, an optical disk drive, static read only memory (‘ROM’), electrically erasable programmable read-only memory space (‘EEPROM’ or ‘flash’ memory), or otherwise as will occur to those of skill in the art.
Remote control device (161) includes communications adapter (170) implementing data communications connections (184) to other computers (162), including particularly computes on UAVs. Communications adapters implement the hardware level of data communications connections through which remote control devices communicate with UAVs directly or through networks. Examples of communications adapters include modems for wired dial-up connections, Ethernet (IEEE 802.3) adapters for wired LAN connections, 802.11b adapters for wireless LAN connections, and Bluetooth adapters for wireless microLAN connections.
The example remote control device (161) of
The method of
The method of
The method of
While piloting the UAV from the starting position to the waypoint, the method of
In the method of
It is useful to note, however, that there is no required relationship between course change rate and display attitude. Embodiments of UAV navigation systems according to embodiments of the present invention may utilize no data whatsoever describing or representing the actual physical flight attitude of a UAV. The determinations of ‘display attitude’ are determination of values for data structures affecting a GUI display on a computer, not depictions of actual UAV attitude. To the extent that display attitudes are determined in calculated linear relations to actual position changes or course change rates, such display attitudes may result in displays that model fairly closely the actual flight attitude of a UAV. This is not a limitation of the invention, however. In fact, in some embodiments there is no attempt at all to determine display attitudes that closely model actual flight attitudes. Some embodiments consider it sufficient, for example, upon detecting a clockwise turn, always to simply assign a display roll angle of thirty degrees without more. Such embodiments do give a visual indication of roll, thereby indicating a turn, but they do not attempt to indicate an actual rate of change by varying the roll angle.
In the method of
Whether the images for display are created on the UAV or on the remote control device, UAV navigation systems according to embodiments of the present invention typically create images for display by use of 3D graphics rendering engines. One example of such an engine is DarkBasic™, from Enteractive Software, Inc., of Hartford, Conn. This example is discussed in terms of DarkBasic, but the use of DarkBasic is not a limitation of the present invention. Many other 3D graphics engines may be used, including APIs for OpenGL, DirectX, Direct3D, and others as will occur to those of skill in the art.
DarkBasic provides its API as an extended version of the Basic programming language for orienting a view of a JPEG map of the Earth's surface in accordance with data describing the location of a UAV over the Earth and the UAV's attitude in terms of roll, pitch, yaw, and course. Satellite images of the Earth's surface in the form of JPEG maps suitable for use in DarkBasic rendering engines are available, for example, from Satellite Imaging Corporation of Houston, Tex. The DarkBasic API commands “GET IMAGE” and “LOAD IMAGE” import JPEG images into a DarkBasic rendering engine.
DarkBasic “CAMERA” commands are used to orient a view of a JPEG map. The DarkBasic command “POSITION CAMERA” may be used to set an initial view position to a starting point and to move the view position to new locations in dependence upon a sequence GPS data. The DarkBasic command “POINT CAMERA” may be used to orient the view to a UAV's course. When display attitudes are determined according to methods of the current invention, the DarkBasic commands “TURN CAMERA LEFT” and “TURN CAMERA RIGHT” may be used to orient the view according to display yaw angle; the DarkBasic commands “PITCH CAMERA UP” and “PITCH CAMERA DOWN” may be used to orient the view according to display pitch angle; and the DarkBasic commands “ROLL CAMERA LEFT” and “ROLL CAMERA RIGHT” may be used to orient the view according to display roll angle.
Macros Although the flow chart of
Such methods of navigating a UAV can also include assigning one or more UAV instructions to each waypoint and transmitting the coordinates of the waypoints and the UAV instructions to the UAV. A UAV instruction typically includes one or more instructions for a UAV to perform a task in connection with a waypoint. Exemplary tasks include turning on or off a camera installed on the UAV, turning on or off a light installed on the UAV, orbiting a waypoint, or any other task that will occur to those of skill in the art.
Such exemplary methods of navigating a UAV also include storing the coordinates of the waypoints and the UAV instructions in computer memory on the UAV, piloting the UAV to each waypoint in accordance with one or more navigation algorithms, and operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint. UAV instructions to perform tasks in connection with a waypoint may be encoded in, for example, XML (the extensible Markup Language) as shown in the following exemplary XML segment:
This XML example has a root element named ‘UAV-instructions.’ The example contains several subelements named ‘macro.’ One ‘macro’ subelement contains a waypoint location representing an instruction to fly to 33° 44′ 10″ N 30° 15′ 50″ W. That macro subelement also contains several instructions for tasks to be performed when the UAV arrives at the waypoint coordinates, including orbiting around the waypoint coordinates, turning on an on-board video camera, continuing to orbit for thirty minutes with the camera on, turning off the video camera, and continuing to a next waypoint. Only one macro set of UAV instructions is shown in this example, but that is not a limitation of the invention. In fact, such sets of UAV instructions may be of any useful size as will occur to those of skill in the art.
Pixel Mapping For further explanation of the process of mapping pixels' locations to Earth coordinates,
The illustrated area of the surface of the Earth has corresponding boundary points identified as Lat1, Lon1; Lat1, Lon2; Lat2, Lon2; and Lat2, Lon1. This example assumes that the distance along one side of surface area (504) is 100 nautical miles, so that the distance expressed in terms of latitude or longitude between boundary points of surface area (504) is 100 minutes or 1° 40′.
In typical embodiments, mapping a pixel's location on the GUI to Earth coordinates of a waypoint includes mapping pixel boundaries of the GUI map to Earth coordinates. In this example, the GUI map boundary at Row1, Col1 maps to the surface boundary point at Lat1, Lon1; the GUI map boundary at Row1, Col2 maps to the surface boundary point at Lat1, Lon2; the GUI map boundary at Row2, Col2 maps to the surface boundary point at Lat2, Lon2; the GUI map boundary at Row2, Col1 maps to the surface boundary point at Lat2, Lon1.
Mapping a pixel's location on the GUI to Earth coordinates of a waypoint typically also includes identifying a range of latitude and a range of longitude represented by each pixel. The range of latitude represented by each pixel may be described as (Lat2−Lat1)/Nrows, where (Lat2−Lat1) is the length in degrees of the vertical side of the corresponding surface (504), and Nrows is the number of rows of pixels. In this example, (Lat2−Lat1) is 1° 40′ or 100 nautical miles, and Nrows is 100 rows of pixels. The range of latitude represented by each pixel in this example therefore is one minute of arc or one nautical mile.
Similarly, the range of longitude represented by each pixel may be described as (Lon2−Lon1)/Ncols, where (Lon2−Lon1) is the length in degrees of the horizontal side of the corresponding surface (504), and Ncols is the number of columns of pixels. In this example, (Lon2−Lon1) is 1° 40′ or 100 nautical miles, and Ncola is 100 columns of pixels. The range of longitude represented by each pixel in this example therefore is one minute of arc or one nautical mile.
Mapping a pixel's location on the GUI to Earth coordinates of a waypoint typically also includes locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map. The region is the portion of the surface corresponding the pixel itself. That region is located generally by multiplying in both dimension, latitude and longitude, the range of latitude and longitude by column or row numbers of the pixel location on the GUI map. That is, a latitude for the surface region of interest is given by Expression 1.
Lat1+Prow((Lat2−Lat1)/Nrows) (Exp. 1)
In Expression 1:
-
- Lat1 is the latitude of an origin point for the surface area (504) corresponding generally to the GUI map,
- Prow is the row number of the pixel location on the GUI map, and
- ((Lat2−Lat1)/Nrows) is the range of latitude represented by the pixel.
Similarly, a longitude for the surface region of interest is given by Expression 2.
Lon1+Pcol((Lon2−Lon1)/Ncols) (Exp. 2)
In Expression 2:
-
- Lon1 is the longitude of an origin point for the surface area (504) corresponding generally to the GUI map,
- Pcol is the column number of the pixel location on the GUI map, and
- ((Lon2−Lor1)/Ncols) is the range of longitude represented by the pixel.
Referring to
Lon1+Pcol((Lon2−Lon1)/Ncols)+0.5((Lon2−Lon1)/Ncols)
In Expression 3, the range of longitude represented by each pixel is given by ((Lon2−Lon1)/Ncols), and the first multiplicand is Pcol((Lon2−Lon1)/Ncols). The second multiplicand is given by 0.5((Lon2−Lon1)/Ncols).
Similarly, locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map, as illustrated by Expression 4, typically also includes multiplying the range of latitude represented by each pixel by a row number of the selected pixel, yielding a third multiplicand; multiplying the range of latitude represented by each pixel by 0.5, yielding a fourth multiplicand; and adding the third and fourth multiplicands to an origin latitude of the GUI map.
Lat1+Pro((Lat2−Lat1)/Nrows)+0.5((Lat2−Lat1)/Nrows) (Exp. 4)
In Expression 4, the range of latitude represented by each pixel is given by ((Lat2−Lat1)/Nrows), and the third multiplicand is Prow((Lat2−Lat1)/Nrows). The fourth multiplicand is given by 0.5((Lat2−Lat1)/Nrows). Expressions 3 and 4 taken together map the location of pixel (412) to the center (510) of the located region (508).
Navigation on a Heading to a Waypoint An exemplary method of navigating in accordance with a navigation algorithm is explained with reference to FIGS. 6 and 7.
-
- reading (602) from the GPS receiver a current position of the UAV;
- calculating (604) a heading from the current position to the waypoint;
- turning (606) the UAV to the heading; and
- flying (608) the UAV on the heading.
In this method, if Lon1, Lat1 is taken as the current position, and Lon2, Lat2 is taken as the waypoint position, then the heading may be calculated generally as the inverse tangent of ((Lat2−Lat1)/(Lon2−Lon1)).
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to FIGS. 8 and 9.
The method of
The method of
In this example, calculating a shortest distance between the current position and a cross track also includes calculating the angle (910) between a direction from the current position to the waypoint and a cross track direction. In the example of
In the current example, calculating a shortest distance between the current position and a cross track also includes calculating the tangent of the angle between a direction from the current position to the waypoint and a cross track direction and multiplying the tangent of the angle by the distance from the current position to the waypoint.
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to FIGS. 10 and 11.
In the method of
In the method of
In many embodiments of the method of
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to
In the method of
In
A further exemplary method of navigating in accordance with a navigation algorithm is explained with reference to FIGS. 14 and 15.
The method of
It will be understood from the foregoing description that modifications and changes may be made in various embodiments of the present invention without departing from its true spirit. The descriptions in this specification are for purposes of illustration only and are not to be construed in a limiting sense. The scope of the present invention is limited only by the language of the following claims.
Claims
1. A method for navigating a UAV, the method comprising:
- receiving in a remote control device a user's selection of a GUI map pixel that represents a waypoint for UAV navigation, the pixel having a location on the GUI;
- mapping the pixel's location on the GUI to Earth coordinates of the waypoint;
- transmitting the coordinates of the waypoint to the UAV;
- reading a starting position from a GPS receiver on the UAV;
- piloting the UAV, under control of a navigation computer on the UAV, from the starting position to the waypoint in accordance with a navigation algorithm; and
- while piloting the UAV from the starting position to the waypoint:
- reading from the GPS receiver a sequence of GPS data representing a flight path of the UAV; and
- depicting the flight of the UAV with 3D computer graphics, including a computer graphic display of a satellite image of the Earth, in dependence upon the GPS data.
2. The method of claim 1 wherein depicting the flight of the UAV further comprises:
- determining, on the UAV, a display attitude of the UAV in dependence upon the sequence of GPS data;
- calculating, on the UAV, from the sequence of GPS data, the UAV's course;
- creating, on the UAV, images for display in dependence upon the display attitude, the course, and a satellite image stored on the UAV; and
- downloading the images for display from the UAV to the remote control device.
3. The method of claim 1 wherein depicting the flight of the UAV further comprises:
- downloading the GPS sequence from the UAV to the remote control device;
- determining, in the remote control device, a display attitude of the UAV in dependence upon the sequence of GPS data;
- calculating, in the remote control device, from the sequence of GPS data, the UAV's course; and
- creating, in the remote control device, images for display in dependence upon the display attitude, the course, and a satellite image stored on the remote control device.
4. The method of claim 1 wherein depicting the flight of the UAV further comprises determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- detecting changes in the UAV's course from the sequence of GPS data;
- determining a display roll angle in dependence upon the detected course changes.
5. The method of claim 1 wherein depicting the flight of the UAV further comprises determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- detecting changes in the UAV's course from the sequence of GPS data;
- determining a display yaw angle in dependence upon the detected course changes.
6. The method of claim 1 wherein depicting the flight of the UAV further comprises determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- detecting changes in the UAV's altitude from the sequence of GPS data;
- determining a display pitch angle in dependence upon the detected altitude changes.
7. The method of claim 1 further comprising:
- receiving user selections of a multiplicity of GUI map pixels representing waypoints, each pixel having a location on the GUI
- mapping each pixel location to Earth coordinates of a waypoint;
- assigning one or more UAV instructions to each waypoint;
- transmitting the coordinates of the waypoints and the UAV instructions to the UAV;
- storing the coordinates of the waypoints and the UAV instructions in computer memory on the UAV;
- piloting the UAV to each waypoint in accordance with one or more navigation algorithms; and
- operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint.
8. The method of claim 1 wherein mapping the pixel's location on the GUI to Earth coordinates of the waypoint further comprises:
- mapping pixel boundaries of the GUI map to Earth coordinates;
- identifying a range of latitude and a range of longitude represented by each pixel; and
- locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map.
9. The method of claim 8 wherein locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map further comprises:
- multiplying the range of longitude represented by each pixel by a column number of the selected pixel, yielding a first multiplicand;
- multiplying the range of longitude represented by each pixel by 0.5, yielding a second multiplicand;
- adding the first and second multiplicands to an origin longitude of the GUI map;
- multiplying the range of latitude represented by each pixel by a row number of the selected pixel, yielding a third multiplicand;
- multiplying the range of latitude represented by each pixel by 0.5, yielding a fourth multiplicand; and
- adding the third and fourth multiplicands to an origin latitude of the GUI map.
10. A system for navigating a UAV, the system comprising:
- means for receiving in a remote control device a user's selection of a GUI map pixel that represents a waypoint for UAV navigation, the pixel having a location on the GUI;
- means for mapping the pixel's location on the GUI to Earth coordinates of the waypoint;
- means for transmitting the coordinates of the waypoint to the UAV;
- means for reading a starting position from a GPS receiver on the UAV;
- means for piloting the UAV, under control of a navigation computer on the UAV, from the starting position to the waypoint in accordance with a navigation algorithm; and
- while piloting the UAV from the starting position to the waypoint:
- means for reading from the GPS receiver a sequence of GPS data representing a flight path of the UAV; and
- means for depicting the flight of the UAV with 3D computer graphics, including a computer graphic display of a satellite image of the Earth, in dependence upon the GPS data.
11. The system of claim 10 wherein means for depicting the flight of the UAV further comprises:
- means for determining, on the UAV, a display attitude of the UAV in dependence upon the sequence of GPS data;
- means for calculating, on the UAV, from the sequence of GPS data, the UAV's course;
- means for creating, on the UAV, images for display in dependence upon the display attitude, the course, and a satellite image stored on the UAV; and
- means for downloading the images for display from the UAV to the remote control device.
12. The system of claim 10 wherein means for depicting the flight of the UAV further comprises:
- means for downloading the GPS sequence from the UAV to the remote control device;
- means for determining, in the remote control device, a display attitude of the UAV in dependence upon the sequence of GPS data;
- means for calculating, in the remote control device, from the sequence of GPS data, the UAV's course; and
- means for creating, in the remote control device, images for display in dependence upon the display attitude, the course, and a satellite image stored on the remote control device.
13. The system of claim 10 wherein means for depicting the flight of the UAV further comprises means for determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- means for detecting changes in the UAV's course from the sequence of GPS data;
- means for determining a display roll angle in dependence upon the detected course changes.
14. The system of claim 10 wherein means for depicting the flight of the UAV further comprises means for determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- means for detecting changes in the UAV's course from the sequence of GPS data;
- means for determining a display yaw angle in dependence upon the detected course changes.
15. The system of claim 10 wherein means for depicting the flight of the UAV further comprises means for determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- means for detecting changes in the UAV's altitude from the sequence of GPS data;
- means for determining a display pitch angle in dependence upon the detected altitude changes.
16. The system of claim 10 further comprising:
- means for receiving user selections of a multiplicity of GUI map pixels representing waypoints, each pixel having a location on the GUI
- means for mapping each pixel location to Earth coordinates of a waypoint;
- means for assigning one or more UAV instructions to each waypoint;
- means for transmitting the coordinates of the waypoints and the UAV instructions to the UAV;
- means for storing the coordinates of the waypoints and the UAV instructions in computer memory on the UAV;
- means for piloting the UAV to each waypoint in accordance with one or more navigation algorithms; and
- means for operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint.
17. The system of claim 10 wherein means for mapping the pixel's location on the GUI to Earth coordinates of the waypoint further comprises:
- means for mapping pixel boundaries of the GUI map to Earth coordinates;
- means for identifying a range of latitude and a range of longitude represented by each pixel; and
- means for locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map.
18. The system of claim 17 wherein means for locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map further comprises:
- means for multiplying the range of longitude represented by each pixel by a column number of the selected pixel, yielding a first multiplicand;
- means for multiplying the range of longitude represented by each pixel by 0.5, yielding a second multiplicand;
- means for adding the first and second multiplicands to an origin longitude of the GUI map;
- means for multiplying the range of latitude represented by each pixel by a row number of the selected pixel, yielding a third multiplicand;
- means for multiplying the range of latitude represented by each pixel by 0.5, yielding a fourth multiplicand; and
- means for adding the third and fourth multiplicands to an origin latitude of the GUI map.
19. A computer program product for navigating a UAV, the computer program product comprising:
- a recording medium;
- means, recorded on the recording medium, for receiving in a remote control device a user's selection of a GUI map pixel that represents a waypoint for UAV navigation, the pixel having a location on the GUI;
- means, recorded on the recording medium, for mapping the pixel's location on the GUI to Earth coordinates of the waypoint;
- means, recorded on the recording medium, for transmitting the coordinates of the waypoint to the UAV;
- means, recorded on the recording medium, for reading a starting position from a GPS receiver on the UAV;
- means, recorded on the recording medium, for piloting the UAV, under control of a navigation computer on the UAV, from the starting position to the waypoint in accordance with a navigation algorithm; and
- while piloting the UAV from the starting position to the waypoint:
- means, recorded on the recording medium, for reading from the GPS receiver a sequence of GPS data representing a flight path of the UAV; and
- means, recorded on the recording medium, for depicting the flight of the UAV with 3D computer graphics, including a computer graphic display of a satellite image of the Earth, in dependence upon the GPS data.
20. The computer program product of claim 19 wherein means, recorded on the recording medium, for depicting the flight of the UAV further comprises:
- means, recorded on the recording medium, for determining, on the UAV, a display attitude of the UAV in dependence upon the sequence of GPS data;
- means, recorded on the recording medium, for calculating, on the UAV, from the sequence of GPS data, the UAV's course;
- means, recorded on the recording medium, for creating, on the UAV, images for display in dependence upon the display attitude, the course, and a satellite image stored on the UAV; and
- means, recorded on the recording medium, for downloading the images for display from the UAV to the remote control device.
21. The computer program product of claim 19 wherein means, recorded on the recording medium, for depicting the flight of the UAV further comprises:
- means, recorded on the recording medium, for downloading the GPS sequence from the UAV to the remote control device;
- means, recorded on the recording medium, for determining, in the remote control device, a display attitude of the UAV in dependence upon the sequence of GPS data;
- means, recorded on the recording medium, for calculating, in the remote control device, from the sequence of GPS data, the UAV's course; and
- means, recorded on the recording medium, for creating, in the remote control device, images for display in dependence upon the display attitude, the course, and a satellite image stored on the remote control device.
22. The computer program product of claim 19 wherein means, recorded on the recording medium, for depicting the flight of the UAV further comprises means, recorded on the recording medium, for determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- means, recorded on the recording medium, for detecting changes in the UAV's course from the sequence of GPS data;
- means, recorded on the recording medium, for determining a display roll angle in dependence upon the detected course changes.
23. The computer program product of claim 19 wherein means, recorded on the recording medium, for depicting the flight of the UAV further comprises means, recorded on the recording medium, for determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- means, recorded on the recording medium, for detecting changes in the UAV's course from the sequence of GPS data;
- means, recorded on the recording medium, for determining a display yaw angle in dependence upon the detected course changes.
24. The computer program product of claim 19 wherein means, recorded on the recording medium, for depicting the flight of the UAV further comprises means, recorded on the recording medium, for determining a display attitude of the UAV in dependence upon the sequence of GPS data, including:
- means, recorded on the recording medium, for detecting changes in the UAV's altitude from the sequence of GPS data;
- means, recorded on the recording medium, for determining a display pitch angle in dependence upon the detected altitude changes.
25. The computer program product of claim 19 further comprising:
- means, recorded on the recording medium, for receiving user selections of a multiplicity of GUI map pixels representing waypoints, each pixel having a location on the GUI
- means, recorded on the recording medium, for mapping each pixel location to Earth coordinates of a waypoint;
- means, recorded on the recording medium, for assigning one or more UAV instructions to each waypoint;
- means, recorded on the recording medium, for transmitting the coordinates of the waypoints and the UAV instructions to the UAV;
- means, recorded on the recording medium, for storing the coordinates of the waypoints and the UAV instructions in computer memory on the UAV;
- means, recorded on the recording medium, for piloting the UAV to each waypoint in accordance with one or more navigation algorithms; and
- means, recorded on the recording medium, for operating the UAV at each waypoint in accordance with the UAV instructions for each waypoint.
26. The computer program product of claim 19 wherein means, recorded on the recording medium, for mapping the pixel's location on the GUI to Earth coordinates of the waypoint further comprises:
- means, recorded on the recording medium, for mapping pixel boundaries of the GUI map to Earth coordinates;
- means, recorded on the recording medium, for identifying a range of latitude and a range of longitude represented by each pixel; and
- means, recorded on the recording medium, for locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map.
27. The computer program product of claim 26 wherein means, recorded on the recording medium, for locating a region on the surface of the Earth in dependence upon the boundaries, the ranges, and the location of the pixel on the GUI map further comprises:
- means, recorded on the recording medium, for multiplying the range of longitude represented by each pixel by a column number of the selected pixel, yielding a first multiplicand;
- means, recorded on the recording medium, for multiplying the range of longitude represented by each pixel by 0.5, yielding a second multiplicand;
- means, recorded on the recording medium, for adding the first and second multiplicands to an origin longitude of the GUI map;
- means, recorded on the recording medium, for multiplying the range of latitude represented by each pixel by a row number of the selected pixel, yielding a third multiplicand;
- means, recorded on the recording medium, for multiplying the range of latitude represented by each pixel by 0.5, yielding a fourth multiplicand; and
- means, recorded on the recording medium, for adding the third and fourth multiplicands to an origin latitude of the GUI map.
Type: Application
Filed: Oct 23, 2003
Publication Date: Sep 28, 2006
Applicant:
Inventors: William Bodin (Austin, TX), Jesse Redman (Cedar Park, TX), Derral Thorson (Austin, TX)
Application Number: 10/692,128
International Classification: G01C 21/00 (20060101);