System and Method of Vehicle-Tracking and Localization with a Distributed Sensor Network
A system and method for vehicle-tracking and localization with a distributed sensor network is provided that includes a plurality of cellular station. A pilot signal is received from the vehicle with an arbitrary station. The pilot signal is compared to each vehicle profile with the arbitrary station in order to identify a matching profile. Spatial positioning data is received for the vehicle with the arbitrary station. The vehicle profile and the spatial positioning data is relayed from the arbitrary station to the at least one proximal station from the plurality of cellular stations. A plurality of iterations is executed. The spatial positioning data is compiled from each iteration into a predicted path for the vehicle with the cellular stations. A warning notification is sent from the arbitrary station of the current iteration to the vehicle, if the predicted path is intersected by at least one hazard.
The current application claims a priority to the U.S. Provisional Patent application Ser. No. 62/754,448 filed on Nov. 1, 2018.
The current application also claims a priority to a U.S. non-provisional application Ser. No. 16/276,288 filed on Feb. 14, 2019. The U.S. non-provisional application Ser. No. 16/276,288 claims a priority to the U.S. Provisional Patent application Ser. No. 62/630,416 filed on Feb. 14, 2018.
The current application also claims a priority to a U.S. non-provisional application Ser. No. 16/271,567 filed on Feb. 8, 2019. The U.S. non-provisional application Ser. No. 16/271,567 claims a priority to the U.S. Provisional Patent application Ser. No. 62/628,436 filed on Feb. 9, 2018.
The current application also claims a priority to a U.S. non-provisional application Ser. No. 16/252,377 filed on Jan. 18, 2019. The U.S. non-provisional application Ser. No. 16/252,377 claims a priority to the U.S. Provisional Patent application Ser. No. 62/619,204 filed on Jan. 19, 2018.
The current application also claims a priority to a U.S. non-provisional application Ser. No. 16/252,257 filed on Jan. 18, 2019. The U.S. non-provisional application Ser. No. 16/252,257 claims a priority to the U.S. Provisional Patent application Ser. No. 62/618,735 filed on Jan. 18, 2018.
The current application also claims a priority to a U.S. non-provisional application Ser. No. 16/249,351 filed on Jan. 16, 2019. The U.S. non-provisional application Ser. No. 16/249,351 claims a priority to a U.S. provisional application Ser. No. 62/617,723 filed on Jan. 16, 2018.
The current application also claims a priority to a U.S. non-provisional application Ser. No. 16/248,761 filed on Jan. 15, 2019. The U.S. non-provisional application Ser. No. 16/248,761 claims a priority to a U.S. provisional application Ser. No. 62/617,962 filed on Jan. 16, 2018.
FIELD OF THE INVENTIONThe present invention relates generally to a target location approximation system based upon time domain subspace signals and spatial domain subspace signals. More specifically, the present invention relates generally to a distributed sensor network for autonomous driving vehicles. By utilizing high-resolution subspace signals the overall accuracy of location approximation is improved.
BACKGROUND OF THE INVENTIONVehicle wireless communication network and auto radar for automatic diving vehicle has been a fast-growing area of interest for many automobile and wireless enterprises. These markets are among fast growing markets in the world. Recently, the development of auto mobile radar provides a sensing tool for advanced driver-assistance systems (ADAS) and automatic driving that is the focus of automobile manufacture and Artificial Intelligent (AI) research and development industry. Vehicular communication network V2X is a driving force for 5G, 4G-LTE and Wi-Fi Wi-Gig mobile communication standards, product developments and applications. MIMO Antenna Array is very powerful technology for V2X communication system, and vehicular radar system for automatically driving and ADAS. Mobile communication system technology has made a great progress. MIMO antenna array, OFDM modulation become new standards, and Wi-Fi LAN has been on the same track. Passive radar has been a research focus since the 1980's for multiple target localization and tacking. Distributed sensor network technology has been research focus for several decades. With the advent of communication theory, MIMO antenna technology, passive radar and wireless network, it can be a new era of distributed sensor network. For some road geographic location, there would be no direct path for radar and communication signals, therefor the radar echo detection presents a great challenge to estimate the surrounding vehicles location and speed. This is a challenge problem for Lidar as well.
Therefore, this invented new vehicles location detection, speed estimation and tracking would play a key role in making automatic driving a reality. The present invention relates to automatic driving vehicular system. A great concern has arisen with automatically driving vehicles are at the horizon. ADAS system greatly improved the traffic safety, has been widely equipped in vehicles. Radar sensor has been becoming a safety device for automobile, for ADAS sand becomes necessity for automatic driving vehicles. A reliable for all weather, all geographic conditions, vehicular location detection, tracking and speed detection is a key requirement for traffic safety and realization of fully automatic driving vehicles.
All illustrations of the drawings are for the purpose of describing selected versions of the present invention and are not intended to limit the scope of the present invention.
The present invention is a method of vehicle-tracking and localization with a distributed sensor network. The present invention is preferably for reliable automatic driving. In order to implement the system and method of the present invention, the system utilizes communication systems such as third generation (3G) wireless network, fourth generation (4G) wireless network, fifth generation (5G) wireless network, local-area network (LAN), and Wi-Fi to provide vehicle tracking and both location and speed estimation for each vehicle within a given range. More specifically, a cellular station is a node within a cellular communication network while utilizing communication systems such as 3G wireless network, 4G wireless network, and 5G wireless network. Similarly, each cellular station is a node within a local communication network while utilizing communication systems such as LAN and Wi-fi. Furthermore, the present invention utilizes communication systems in order to monitor central traffic control, vehicle condition monitoring, and instantaneous road traffic conditions. The present invention provides a solution for all geometrical road conditions that present a great challenge for auto radar and Lidar detection. As seen in
The physical system used to implement the method for the present invention includes a plurality of cellular stations. The plurality of cellular stations is an access point that receives and delivers signals. The plurality of cellular stations is distributed along at least one road and is communicably coupled to each other. In the preferred embodiment of the present invention, each cellular station is a picocell station. In order to ensure vehicle safety with accurate vehicle detection a detection range of each cellular station ranges from 100 meters to 500 meters. Each of the plurality of cellular stations utilizes a multiple-input and multiple-output (MIMO) antenna to determine road path from a viewing angle. The plurality of cellular stations therefore overcome all road obstacles as a result of winding roads, congested urban environments, and so on where radar waves and signals propagate into no-line-of-sight mode, as seen in
The overall process for the present invention, includes the following steps that are implemented with the plurality of cellular stations. As seen in
Seen in
Each cellular station is able to detect the plurality of road hazards as operational data is tracked with the MIMO antenna of the arbitrary station for each iteration, which can be seen in
In the process of deriving the DoA, an algorithm is executed with each of the plurality of cellular stations. When the MIMO antenna is an antenna array consisting of M points, and pilot signal in a vector of length M, the algorithm is used to derive the following equation:
Where rj is the pilot signal of the M element antenna array, mj is the EM wave vector impinging on the antenna array, n is the white noise of the channel.
Next, the representative eigenvector is used to estimate a maximum eigenvector, wherein the maximum eigenvector is also derived through the algorithm to determine the array direction vector. The maximum eigenvector is defined by:
AT(θ)=[s(t1−θ),s(t2−θ) . . . s(tM−θ)]T
when a signal selected from the plurality of pilot signals is represented in a vector format as:
r(t)=A[θi|i=1,2, . . . k]s(t)+n(t)
When the maximum eigenvector is estimated, the present invention proceeds to derive the DoA of the pilot signal by searching a corresponding subspace spanned by the maximum eigenvector. The covariance matrix of a selected signal from the plurality of received signals can be shown as:
R=A[θi|i=1,2, . . . k]S A[θi|i=1,2, . . . k]*+N
and the vector used for the DoA of the pilot signal is determined by the zero points in the following equation:
wherein θ represents the search range of the MIMO antenna and Ej represents the jth eigenvector of the covariance matrix.
If the pilot signal consisted of a K-number of signals, the covariance matrix can be represented as:
(1/K)Σi=1kr(ti)r*(ti)
If a spectral decomposition was performed on the covariance matrix, the following equation can be derived:
As a final step of the calculations, the DoA estimate can be determined by plotting the data points according to the following equation which is used to estimate the maximum eigenvector from the representative eigenvector.
In this instance, θ represents the time delay for the ith target that resulted in the selected signal represented above.
Similar to calculating the time delay and the DoA for the pilot signal, the algorithm can also be used to identify the pilot signal of a vehicle among other vehicles. In order to do so, the present invention utilizes the algorithm to derive a likelihood ratio for a set of selected eigenvalues from the representative eigenvector. Next, the quantity for the plurality of vehicles is assessed by performing a sequence of hypotheses tests on the set of selected eigenvalues selected from the representative eigenvector. To do so, the algorithm compares a likelihood ratio for each of the set of selected eigenvalues. By doing so, a quantity of the plurality of vehicles is derived, wherein a specific pilot signal corresponds to a specific vehicle. The likelihood ratio used in the calculation can be represented as:
A spectral decomposition was performed on the covariance matrix, the following equation can be derived:
Wherein, λ1≤λ2≤ . . . ≤λM.
In the process of calculating the time delay, the plurality of pilot signals is initially represented as a representative eigenvector by executing the each of the cellular stations. Next, the algorithm is applied to estimate a minimum eigenvector from the representative eigenvector so that the time delay between the pilot uplink signal and each of the plurality of pilot signals can be calculated by searching a corresponding subspace derived from the minimum eigenvector. The minimum eigenvector will be orthogonal to a signature vector of each of the plurality of pilot signals. A selected signal from the plurality of pilot signals can be represented through the following equation.
To accommodate multiple angles, transmit omnidirectionally, and receive the plurality of overlapping echo signals from varying angles, the MIMO antenna is preferably an antenna array. Each antenna of the antenna array is provided with at least one tapped delay line that allows a signal to be delayed by several samples. When in use, the DoA for each of the plurality of overlapping echo signals is derived through the spatial subspace processor. The maximum of the likelihood ratio can be used to determine the number of vehicles, and with the estimation of the time delay for each pilot signal, the distance of the vehicle, in conjunction with the DoA estimation, the vehicle location, speed, and identification are determined. Therefore, the system includes a radar function in addition to the wireless V2X communication function.
The Rayleigh quotient can also be used in time delay calculations. When used, the Rayleigh quotient can be defined by the following equation.
Utilizing the Rayleigh quotient, the Rayleigh principle can be stated as:
When calculating the time delay using the Rayleigh principle for observations {r(i), i=1, . . . , n}, the Rayleigh quotient for the observations can be defined as:
This algorithm is able to update vector X from vehicle to vehicle, X asymptotically converges to eigenvector V1.
To accommodate the time delay that is not constant due to the varying speeds of each of the plurality of vehicles, a forget factor of λ is introduced, and the overall Rayleigh function would change to the following equation:
Thus, the recursive algorithm derived from the Rayleigh principle would change to the following equation:
After further calculations, the minimum eigenvector can be determined as follows:
This recursive algorithm provides a powerful and effective target tracking method for the vehicle.
In order to protect one driver from another driver, the at least one vehicle is provided as a first vehicle and a second vehicle, seen in
In order for multiple samples to be provided for the plurality of stations to accurately determine the predicted path of the vehicle, the spatial positioning data for a vehicle is taken not only near the plurality of road hazards but throughout the entire current path taken by the vehicle. As seen in
A driver of the vehicle may view the spatial positioning data in real-time as the vehicle is provided with a global positioning system (GPS) device, and a geospatial location is tracked with the GPS device of the vehicle, seen in
Although the invention has been explained in relation to its preferred embodiment, it is to be understood that many other possible modifications and variations can be made without departing from the spirit and scope of the invention as hereinafter claimed.
Claims
1. A method of vehicle-tracking and localization with a distributed sensor network, the method comprises the steps of:
- (A) providing a plurality of cellular stations, wherein the plurality of cellular stations is distributed along at least one road and is communicably coupled to each other, and wherein a plurality of vehicle profiles and a plurality of road hazards are stored on each cellular station, and wherein at least one vehicle is driving along the road;
- (B) receiving a pilot signal from the vehicle with an arbitrary station, wherein the arbitrary station is any station from the plurality of cellular stations;
- (C) comparing the pilot signal to each vehicle profile with the arbitrary station in order to identify a matching profile from the plurality of vehicle profiles;
- (D) receiving spatial positioning data for the vehicle with the arbitrary station;
- (E) relaying the vehicle profile and the spatial positioning data from the arbitrary station to at least one proximal station from the plurality of cellular stations, wherein the proximal station is geospatially closer to the arbitrary station than remaining stations from the plurality of cellular stations;
- (F) executing a plurality of iterations for step (B) through (E), wherein the proximal station for a previous iteration from the plurality of iterations is the arbitrary station for a current iteration from the plurality of iterations;
- (G) compiling the spatial positioning data from each iteration into a predicted path for the vehicle with the cellular stations; and,
- (H) sending a warning notification from the arbitrary station of the current iteration to the vehicle, if the predicted path is intersected by at least one hazard from the plurality of road hazards.
2. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1, wherein each cellular station is a picocell station.
3. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1, wherein each cellular station is a node within a cellular communication network.
4. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1, wherein each cellular station is a node within a local communication network.
5. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1 comprises the step of:
- terminating each iteration after the vehicle moves from a detection range of the arbitrary station into a detection range of the proximal station during step (F).
6. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1, wherein a detection range of each cellular station ranges from 100 meters to 500 meters.
7. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1 comprises the steps of:
- providing a multiple-input and multiple-output (MIMO) antenna for each cellular station;
- outputting and receiving a signature beam with the MIMO antenna of the arbitrary station;
- extracting a direction of arrival (DoA) estimation and a time-delay estimation from the signature beam with the arbitrary station; and,
- deriving the spatial positioning data from a combination of the DoA estimation and the time-delay estimation with the arbitrary station during step (D).
8. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 7 comprises the step of:
- tracking operational data with the MIMO antenna of the arbitrary station for each iteration;
- comparing the operational data for each iteration among each other with the arbitrary station in order to identify at least one shared identifier amongst the operational data for each iteration; and,
- configuring the signature beam of the arbitrary station in accordance to the shared identifier.
9. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1 comprises the steps of:
- providing the at least one vehicle as a first vehicle and a second vehicle;
- executing the plurality of iterations with the first vehicle in order to compile the predicted path of the first vehicle;
- executing the plurality of iterations with the second vehicle in order to compile the predicted path of the second vehicle; and,
- sending a collision notification to the first vehicle and the second vehicle, if the predicted path of the first vehicle and the predicted path of the second vehicle intersect each other.
10. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1 comprises the steps of:
- providing the road with a plurality of lane locations stored on each cellular station;
- comparing the spatial positioning data to each lane location with the arbitrary station in order to identify a matching lane location for the vehicle, wherein the matching lane location is from the plurality of lane locations; and,
- further relaying the matching lane location from the arbitrary station to the proximal station during step (E).
11. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1 comprises the steps of:
- deriving a speed of the vehicle from the spatial positioning data with the arbitrary station; and,
- further relaying the speed of the vehicle from the arbitrary station to the proximal station during step (E).
12. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1, wherein at least one specific station from the plurality of cellular stations is located adjacent to at least one specific hazard from the plurality of road hazards.
13. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 1 comprises the steps of:
- providing the vehicle with a global positioning system (GPS) device;
- tracking a geospatial location with the GPS device of the vehicle;
- appending the geospatial location into the pilot signal of the vehicle; and,
- comparing the geospatial location to the spatial positioning data with the arbitrary station in order to verify the spatial positioning data with the geospatial location.
14. The method of vehicle-tracking and localization with a distributed sensor network, the method as claimed in claim 13 comprises the steps of:
- providing the at least one vehicle as a plurality of vehicles, wherein each vehicle includes a display;
- broadcasting the geospatial location of each vehicle to the plurality of vehicles with the plurality of cellular stations; and,
- graphically outputting a map with the geospatial location of each vehicle with the display of each vehicle.
Type: Application
Filed: Nov 1, 2019
Publication Date: Feb 27, 2020
Patent Grant number: 10871571
Inventor: Tiejun Shan (Plano, TX)
Application Number: 16/672,417