VEHICLE DETECTION APPARATUS, METHOD AND PROGRAM
An apparatus includes a signal acquisition part acquires oscillation signals from sensors provided under lanes of a bridge and close to an expansion joint, a signal separation part applies BSS to the oscillation signals to estimate source oscillation signals respectively separated in the plurality of lanes, and adjusts amplitude of the source oscillation signals to output amplitude adjusted oscillation signals, and a vehicle estimation part estimates, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count vehicles passing on the lane.
Latest NEC Corporation Patents:
- EDGE CONFIGURATION SERVER, MULTI-ACCESS SYSTEM, METHOD, AND COMPUTER-READABLE MEDIUM
- COMMUNICATION SYSTEM, TRANSMISSION APPARATUS, RECEPTION APPARATUS, AND METHOD AND PROGRAM THEREOF
- IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND NON-TRANSITORY STORAGE MEDIUM
- LIGHT MODULE, LIGHT SYSTEM, AND LIGHT OUTPUT METHOD
- OPTICAL TRANSMISSION LINE MONITORING DEVICE, OPTICAL TRANSMISSION LINE MONITORING METHOD, AND RECORDING MEDIUM STORING OPTICAL TRANSMISSION LINE MONITORING PROGRAM
This application is a National Stage Entry of PCT/JP2020/010715 filed on Mar. 12, 2020, the contents of all of which are incorporated herein by reference, in their entirety.
FIELDThe present invention relates to a vehicle detection apparatus, method and program.
BACKGROUNDRegarding detection using a response measured on a passing vehicle over a bridge, Non-Patent Literature (NPL) 1 discloses an automatic Vehicle Detection (AVD) algorithm that takes acceleration response data (time histories) of the bridge under traffic load and gives the automatic vehicle count. The AVD algorithm of NPL 1 gives information about traffic, such as total number of vehicles (vehicle count) that have passed during an interval of time. Time headway is difference in time between a leading vehicle and a following vehicle in a highway traffic situation. Time headway (THW) and distance headway (DHW) are interrelated through vehicle speed (V) by THW=DHW/V as illustrated in
Patent Literature (PTL) 1 discloses a finger-joint based detection system wherein a strain gauge is attached to a bottom side of a finger tip of the finger joint and deflection of the finger of the finger joint generated when a vehicle passes through the joint is converted to an electric signal. The strain gauges provided at appropriate intervals in a width direction of a bridge enables traffic amount survey for each lane.
PTL 2 discloses a measurement apparatus which detects a vehicle passing on a floor slab of a bridge, based on an acceleration signal (oscillation signal) transmitted from an accelerometer which is attached on a side of the floor slab. Vehicle detection is performed using an envelope of the oscillation signal in the following way. The measurement apparatus calculates an absolute value of a vertical acceleration and calculate the envelope (signal) of the calculated absolute value. When the vehicle enters a region close to the accelerometer, a magnitude of the envelop goes high at a start time during the vehicle passes while when the vehicle enters from an opposite direction, a magnitude of the envelop goes high at an end time when the vehicle leaves the bridge.
PTL 3 discloses a system wherein multiple sensors are arranged in each lane of a bridge to detect an axle interval(s) of a vehicle passing through a bridge. In an axle passing time group, a point where the passing time difference between axles is larger than a preset value is defined as a vehicle-to-vehicle separation and an axle interval(s) for each vehicle is detected. An active load strain, a time at which the k-th axle in the lane P has passed a reference position, a speed of the k-th vehicle on the lane P, and the lane P in which the vehicle is passing is acquired. By collating the axle intervals of a vehicle passing the lane of the bridge with reference to a database in which relationship between an axle interval(s) and a vehicle type is stored in advance, the type of the vehicle passing through the bridge is automatically detected substantially in real time.
- [PTL 1] Japanese Unexamined Utility Model Application Publication No. H04-112903
- [PTL 2] Japanese Unexamined Patent Application Publication No. 2017-068781
- [PTL 3] Japanese Unexamined Patent Application Publication No. 2006-084404
- [NPL 1] Kanwardeep Singh Bhachu, J. David Baldwin, Kyran D. Mish, “Method for Vehicle Identification and Classification for Bridge Response Monitoring”, Proceedings of the IMAC-XXVIII Feb. 1-4, 2010, Jacksonville, Fla. USA
- [NPL 2] 2.1. Gaussian mixture models, retrieved on 2020/01/08, Internet URL https://scikit-learn.org/stable/modules/mixture.html
- [NPL 3] David M. Blei, Michael I. Jordan, “Variational inference for Dirichlet process mixtures”, 2006 International Society for Bayesian Analysis, 1, Number 1, pp. 121-144, retrieved on 2020/01/08, Internet URL http://www.cs.columbia.edu/˜blei/papers/BleiJordan2004.pdf
The following analysis is made by the inventors of the present invention.
The AVD algorithm disclosed in NPL1 can identify or discriminate an individual vehicle where there is a vehicle (truck) travelling on a lane with a time headway THW between the vehicle (truck) and the other one(s) preceding/succeeding thereto being more than or equal to the time headway minimum. However, the AVD algorithm cannot well identify/discriminate vehicles in following traffic situations, as illustrated in
(1) A plurality of vehicles passing on parallel lanes of a bridge (parallel traffic model).
(2) A plurality of vehicles passing one after other with combination of vehicle types, e.g., a truck and a car (serial traffic model).
(3) A plurality of vehicles passing with combination of parallel traffic model (1) and serial traffic model (2) (mixture traffic model).
When vehicles are passing on parallel lanes of a bridge, presence of a vehicle on each lane generates individual vehicle specific vibration. The AVD algorithm cannot identify/discriminate vehicles passing on parallel lanes of the bridge. Combined mixture of acceleration signals (oscillation signals) is measured as shown in
The AVD algorithm disclosed in NPL 1 cannot identify/discriminate individual vehicles passing on two lanes of the bridge during multiple vehicles present on the bridge as illustrated in
The AVD algorithm disclosed in NPL 1 uses a threshold-based dictionary. Creating a dictionary for combinations of vehicle types is time consuming and very complex.
Accordingly, it is one of objects of the present invention to provide a detection apparatus, a method, a non-transitory medium storing a program, each enabling to detect and identify vehicles passing on parallel lanes on a bridge.
According to one aspect of the disclosure, there is provided a detection apparatus comprising:
a signal acquisition part that acquires a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation of the bridge induced by an individual axle of a vehicle passing on the lane;
a signal separation part that receives, from the signal acquisition part, the plurality of the oscillation signals, applies blind source separation (BSS) to the plurality of the oscillation signals to estimate and separate a plurality of source oscillation signals, each source oscillation signal specific to each lane, and adjusts amplitude of an individual one of the plurality of the source oscillation signals to output a plurality of amplitude adjusted oscillation signals; and
a vehicle estimation part that receives the amplitude adjusted oscillation signal corresponding to the lane of interest from the signal separation part, and estimates, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count individual vehicles passing on the lane of interest.
According to a second aspect of the disclosure, there is provided a computer-based vehicle detection method comprising:
acquiring a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation of the bridge induced in the lane by an individual axle of a vehicle passing on the lane;
performing signal separation processing comprising:
-
- applying blind source separation (BSS) to the plurality of the oscillation signals to estimate and separate a plurality of source oscillation signals, each source oscillation signal specific to each lane; and
- adjusting amplitude of an individual one of the plurality of the source oscillation signals to output a plurality of amplitude adjusted oscillation signals; and
performing estimation processing comprising:
-
- receiving the amplitude adjusted oscillation signal corresponding to the lane of interest output from the signal separation processing; and
- estimating, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count individual vehicles passing on the lane of interest.
According to a third aspect of the disclosure, there is provided a recording medium storing therein a program for causing a computer to execute processing comprising:
acquiring a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation of the bridge induced in the lane by an individual axle of a vehicle passing on the lane;
performing signal separation processing comprising:
-
- applying blind source separation (BSS) to the plurality of the oscillation signals to estimate and separate a plurality of source oscillation signals, each source oscillation signal specific to each lane; and
- adjusting amplitude of an individual one of the plurality of the source oscillation signals to output a plurality of amplitude adjusted oscillation signals; and
performing estimation processing comprising:
-
- receiving the amplitude adjusted oscillation signal corresponding to the lane of interest output from the signal separation processing; and
- estimating, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count individual vehicles passing on the lane of interest.
According to the disclosure, there is provided a computer-readable recording medium in which the program according to the above described third aspect of the disclosure is stored. The recording medium may be such as a semiconductor storage (such as read only memory (ROM), random access memory (RAM), electrically and erasable programmable read only memory (EEPROM)), Hard Disk Drive (HDD), Solid State Drive (SSD), Compact Disc (CD) or Digital Versatile Disc (DVD) etc.
According to a further aspect of the disclosure, there is provided a vehicle detection apparatus comprising:
a signal acquisition part that acquires a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation induced by a vehicle passing on the lane;
a vehicle estimation part that obtains a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to the each frame extracted from the oscillation signal by a sliding window and calculates a sum of a normalized frequency vector, from the frequency spectrum of the each frame, for each lane, to generate a maximum vector with each element thereof being a max value of the sum of a normalized frequency vectors calculated for the plurality of lane,
generates a binary vector with columns, number of which is equal to number of the sums of normalized frequency vectors and with rows, an element of which corresponds to a time index and has a value 1 at an element position with a maximum value and 0 otherwise,
obtains time repeated vectors of the sum of a normalized frequency vectors and maximum vectors by multiplying a time value by a magnitude value of each of the vectors,
performs Gaussian mixture model-clustering on the time repeated vector to count number of clusters and finds start time and end time of presence of a vehicle in each lane, and
calculates a column-wise mean value of elements corresponding to the start time and the end time, in a row of the binary matrix to decide that the vehicle is present in a lane corresponding to a column of the binary matrix for which the column-wise mean value is calculated if the column-wise mean value is not less than a predetermined threshold value,
while if the column-wise mean value is less than a predetermined threshold value for all columns of the binary matrix, deciding that the vehicle is present in the plurality of lanes. There are provided a method, program, a non-transitory medium that correspond to the further aspect of the disclosure.
According to the present invention, it is made possible to detect and identify vehicles passing on parallel lanes on a bridge. Still other features and advantages of the present invention will become readily apparent to those skilled in this art from the following detailed description in conjunction with the accompanying drawings wherein only example embodiment of the invention are shown and described, simply by way of illustration of the best mode contemplated of carrying out this invention. As will be realized, the invention is capable of other and different embodiments, and its several details are capable of modifications in various obvious respects, all without departing from the invention. Accordingly, the drawing and description are to be regarded as illustrative in nature, and not as restrictive.
The following describes an example embodiment with reference to drawings.
BSS is used with an assumption that measured vibration responses can be separated to estimate individual vibration response of each lane. In
yj(n)=Σi=12Σp=1pHji(p)xi(n−p+1) (1)
where xi is a signal from actual source, yj is a signal captured by the sensor (accelerometer) sj (j=1,2), and Hji is a mixing matrix from actual source to the sensor (accelerometer) sj.
Outputs of BSS are given as follows.
{circumflex over (x)}i(n)=Σj=12Σq=1QWij(q)yij(n−q+1) (2)
where {circumflex over (x)}i (i=1,2) is a separated signal, and Wij is a separation filter with Q taps.
In a case of p=1 and q=1, as illustrated in
y1(n)=H11x1(n)+H21x2(n)
y2(n)=H12x1(n)+H22x2(n)
{circumflex over (x)}1(n)+W11y1(n)+W21y2(n)
{circumflex over (x)}2(n)+W12y1(n)+W22y2(n) (3)
The signal separation part 104 calculates a sum of a normalized frequency spectrum (S102). More specifically, the signal separation part 104 extracts waveform data (frame) using a sliding window of a time interval T (length of one frame) and perform FFT (fast Fourier transform) to the extracted waveform data to obtain a frequency spectrum, which is normalized by dividing each frequency component (amplitude) by a total sum value of frequency components (amplitudes) of the frequency spectrum. The signal separation part 104 calculates a sum of a normalized frequency spectrum for each frame of the waveform data acquired by the sensors s1 and s2.
The frequency component is normalized by a combined sum of the frequency spectrums of the oscillation signals (each frame). In case of
where spectrum (s1) is a vector having, as each element, an amplitude spectrum of each frequency bin in the frequency spectrum of the frame of the oscillation signal acquired by the sensor s1,
spectrum (s2) is a vector having, as each element, an amplitude spectrum of each frequency bin in the frequency spectrum of the frame of the oscillation signal acquired by the sensor s2,
sum of (spectrum (s1), spectrum (s2)) is a combined sum operation which adds each amplitude spectrum at each element of the vector spectrum (s1) and the vector spectrum (s2) to generate a scaler value (sum) by summing the added amplitude spectrums,
spectrum (s1)/sum of (spectrum (s1), spectrum (s2)) is an operation of dividing an amplitude spectrum of each element (frequency bin) in the vector spectrum (s1) by the sum of (spectrum (s1), spectrum (s2)) to obtain a normalized amplitude spectrum of each element (frequency bin) in the spectrum (s1), and sum ( ) is an operation of summing each normalized amplitude spectrum of each element (frequency bin) in the spectrum (s1).
In case of
The signal separation part 104 detects a first peak in the sum of the normalized frequency spectrum of each of lane 1 and lane 2 (S103).
The signal separation part 104 applies BSS to time domain signals (
The signal separation part 104 calculates an amplitude ratio α by dividing a sum of power spectrum of the first vehicle region of measured time domain signal by a sum of power spectrum of the first vehicle region of time domain signal estimated by BSS.
The signal separation part 104 multiplies the amplitude ratio α to the estimated signals {circumflex over (x)}1 and {circumflex over (x)}2 to obtain amplified estimated signals α·{circumflex over (x)}1 and α·{circumflex over (x)}2.
The following describes an example of the operation of the vehicle estimation part 106 which can detect and count vehicles passing one after other with combination of vehicle types, e.g., a truck and a car (serial model), in a single lane of interest (one of lane 1 and lane 2) individually, based on one of amplified estimated signals α·{umlaut over (x)}1 and α·{circumflex over (x)}2.
It is assumed that the vehicle estimation part 106 receives from the signal acquisition part 102, the oscillation signal, i.e., the amplified estimated signal of a lane of interest, as shown in
The vehicle estimation part 106 is configured to detect a vehicle (s) passing serially on a single lane (e.g., lane 1) from the oscillation signal of lane 1 captured by the sensor s1.
The vehicle estimation part 106 calculates a normalized frequency spectrum (S201).
Let's Xt=[x0, x1 . . . xN−1, xN . . . ] be time series of sampled values xk (where k is non-negative integer) of the oscillation signal with a shift of the sliding window=m, frames Xj (j=1,2,3 . . . ) with length N (N>m) are extracted by the sliding window from the oscillation signal and FFT is applied to each frame to obtain a frequency spectrum Y(ω)j of the j-th frame Xj (j=1,2,3 . . . ),
X1=[x0, . . . ,xN−1]→Y(ω)1=FFT(X1)
X2=[xm−1, . . . ,xN+m−2]→Y(ω)2=FFT(X2)
X3=[x2m−1, . . . ,xN+2m−3]→Y(ω)3=FFT(X3)
The vehicle estimation part 106 calculates a normalized frequency spectrum by dividing each frequency component (amplitude) by a total sum of amplitudes of the frequency components of the frequency spectrum. The total sum of amplitude spectrum qj for j-th frame Xj is given by
where qj(i) is an amplitude of i-th frequency bin of the frequency spectrum Y(ω)j of the j-th frame Xj.
qj(i)=√{square root over (Re(yj(i))2+Im(yj(i))2)} (8)
where yj(i) (i=1, . . . , N/2−1) is an i-th frequency component (bin) of the frequency spectrum Y(ω)j. Re( ) and Im ( ) are real part and imaginary part of complex yj(i) where yj(0) (i=0) is a DC component, an imaginary part of which is zero and a real part of which is assumed to be zero, and an index i=N/2 corresponds to the Nyquist frequency bin.
The normalized frequency spectrum Q for the j-th frame X is given as
The vehicle estimation part 106 calculates a frame-wise sum of a normalized frequency spectrum (S202).
The frame-wise sum f(j) of a normalized frequency spectrum for j-th frame Xj (j=1, 2, . . . ) is given as
F=(f(1),f(2),f(3), . . . ) (11)
The vehicle estimation part 106 performs amplitude transformation of the vector F to scale in pre-defined range (S203).
scaled_min=0,
scaled_max=100,
F_min=min(F),
F_max=max(F).
The amplitude transformation is calculated as:
F_scaled=scale*F+scaled_min−F_min*scale (12)
where
scale=(scaled_max−scaled_min)/(V_max−V_min) (13)
The vehicle estimation part 106 creates a new vector (time-repeated vector) from the vector F_scaled by repeating time value by its magnitude value (S204).
Assuming that each vehicle is estimated based on a Gaussian Mixture model, transforming the signal to time-repeated feature makes it easy to perform clustering and vehicle detection by Gaussian Mixture Modelling. A vehicle occurrence time in the oscillation signal is not known. To detect the vehicle occurrence time, repeating time value by a scaled amplitude times is adopted, which generates more density at a peak location of the amplitude. This operation results in an expected distribution (such as Gaussian probability distribution) at each vehicle occurrence, as shown in
The vehicle estimation part 106 performs clustering based on learning (unsupervised model training) of a mixture of Gaussian probability distributions (S205). The Gaussian mixture model is a probabilistic model that assumes all the data points are generated from a mixture of a finite number of Gaussian probability distributions with unknown parameters. The Gaussian Mixture Model may be learned from train data. Though not limited thereto, in the embodiment, Variational Bayesian Gaussian Mixture model, a variant of the Gaussian mixture model with variational inference algorithms, such as Variational Bayesian DPGMM (Dirichlet Process Gaussian Mixture Model) is used, which is an infinite mixture model with the Dirichlet Process, as a prior distribution on the number of clusters. Regarding Variational Bayesian DPGMM, reference may be made to NPL2 or NPL3.
The vehicle estimation part 106 counts the number of clusters, each of which has a value of a probability density function greater than a predetermined threshold value (S206), as shown in
The vehicle detection apparatus 100 may be implemented on a computer system as illustrated in
In the above embodiments, detection of the number of vehicles passing on a single lane of a bridge is described, but the present invention is not limited to the number of vehicles. The present invention can be applied to detection of weight of a vehicle passing on a single lane of a bridge, a load weight of a vehicle, a deterioration/fatigue diagnostic of a bridge, etc.
In the above embodiments, accelerometers are used as sensors to detect impulse response (oscillation) of the bridge. However, in the present invention, a sensor is not limited to detection of impulse response (oscillation) of the bridge. That is, the present invention is applicable to an oscillation signal detected by an acoustic sensor such as a piezoelectric transducer, microphone, etc.
The following describes a further example embodiment. In this embodiment, the vehicle estimation part 106 is configured to realize vehicle detection in parallel traffic model (
The vehicle estimation part 106 calculates a sum of a normalized frequency spectrum (S302). More specifically, the vehicle estimation part 106 extracts waveform data (frame) using a sliding window of a time interval T (length of one frame) and perform FFT (fast Fourier transform) to the extracted waveform data to obtain a frequency spectrum, which is normalized by dividing each frequency component (amplitude) by a total sum value of frequency components (amplitudes) of the frequency spectrum.
The vehicle estimation part 106 obtains sum of normalized frequency vectors from sensors s1 and s2, by using respectively the equation (4) and (5) which define the sum of normalized frequency for each frame (S303). The sum of normalized frequency vector (s1) is constituted by a time series vector including, as elements thereof (where total N elements are assumed), the sums of normalized frequency (each given by the equation (4)) e.g., for frames 1, 2, . . . , N (or time instant 1 to N). The sum of normalized frequency vector from the sensor s2 is constituted by a time series vector including, as elements thereof (where total N elements are assumed), the sums of normalized frequency (each given by the equation (5)), e.g., for frames 1, 2, . . . , N (or time instant 1 to N).
Then, the vehicle estimation part 106 obtains s1s2_maximum vector by selecting a maximum amplitude value at each time-instant (each element) from the sum of normalized frequency vector (s1) and the sum of normalized frequency vector (s2). The s1s2_maximum vector has N elements (S304).
s1s2_maximum vector=max(sum of normalized frequency vector(s1),sum of normalized frequency vector(s2)) (14)
For instance, let's assume sum of normalized frequency vector (s1)=[sa1, sa2, . . . , saN] where sa1, sa2, . . . , saN are sums of normalized frequency vector (s1) at time-instant 1, 2, . . . N and sum of normalized frequency vector (s2)=[sb1, sb2, . . . , sbN] where sb1, sb2, . . . , sbN are sums of normalized frequency vector (s2) at time-instant 1, 2, . . . N and sa1sb2>sb1, sa2<sa2, . . . and saN<sbN, then
s1s2_maximum vector=[sa1,sb2, . . . ,sbN] (15)
The vehicle estimation part 106 generates a new binary matrix B with the number of rows equal to the number of elements in s1s2_maximum vector (N elements) and the number of columns equal to 2 (corresponding to sums of normalized frequency vectors (s1) and (s2)), where, at each time-instant, i.e., in each row, a value 1 represents element position with the maximum value and 0 otherwise (S305). In the case of the equation (15), the N*2 binary matrix is given as
where a superscript T indicates a transpose of the matrix B.
The vehicle estimation part 106 creates a time-repetition vector by repeating a time value by a corresponding magnitude value of the s1s2_maximum vector (S306). Similarly, the vehicle estimation part 106 also repeats the rows in the matrix B by repeating each row corresponding to a magnitude value of the s1s2_maximum vector.
Then, the vehicle estimation part 106 applies Gaussian Mixture model-based clustering (S307) and counts the number of clusters (S308), as explained in steps 205 and 206 in
Assuming, for example, ±3σ value (where σ is a standard deviation) from a mean value of the Gaussian distribution, as start time and end time of a vehicle impulse, the vehicle estimation part 106 obtains start time and end time of each vehicle present in each lane (S309). In order to detect in which lane the vehicle is present, the vehicle estimation part 106 calculates a column-wise mean of sliced number of rows from the binary matrix B, that corresponds to the start and end time of each vehicle. Assuming bij is a value (1 or 0) of i-th row and j-th column of the binary matrix B (where j=1 or 2) (S310).
When the column-wise mean value of the sliced number of rows of the binary matrix B is greater than or equal to a pre-defined threshold (S311: “Yes” branch), the vehicle estimation part 106 estimates that the vehicle is detected in that a lane corresponding to the column of the matrix B for which the column-wise mean value is calculated (corresponding to the sensors s1 or s2) of the matrix B (S312). When the column-wise mean value in both the columns of the matrix B is less than the pre-defined threshold (S311: “No” branch), the vehicle estimation part 106 estimates that presence of a vehicle is detected in both of the lanes under which the sensors s1 and s2 are arranged (S313). It is noted that the above described embodiments are not limited to two lanes running in parallel on the bridge but can be applied to detection of vehicles passing on three or more lanes on the bridge.
Each disclosure of the above-listed PTLs 1-3 and NPLs 1-3 is incorporated herein by reference. Modification and adjustment of each example embodiment and each example are possible within the scope of the overall disclosure (including the claims) of the present invention and based on the basic technical concept of the present invention. Various combinations and selections of various disclosed elements (including each element in each Supplementary Note, each element in each example, each element in each drawing, and the like) are possible within the scope of the claims of the present invention. That is, the present invention naturally includes various variations and modifications that could be made by those skilled in the art according to the overall disclosure including the claims and the technical concept.
Claims
1. A vehicle detection apparatus comprising:
- at least a processor; and
- a memory storing program instructions executable by the processor, wherein the processor is configured to execute the program instructions to implement:
- a signal acquisition part that acquires a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation induced by a vehicle passing on the lane;
- a signal separation part that receives, from the signal acquisition part, the plurality of the oscillation signals, applies blind source separation (BSS) to the plurality of the oscillation signals to estimate and separate a plurality of source oscillation signals, each source oscillation signal specific to each lane, and adjusts amplitude of an individual one of the plurality of the source oscillation signals to output a plurality of amplitude adjusted oscillation signals; and
- a vehicle estimation part that receives the amplitude adjusted oscillation signal corresponding to the lane of interest from the signal separation part, and estimates, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count individual vehicles passing on the lane of interest.
2. The vehicle detection apparatus according to claim 1, wherein the signal separation part calculates a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to the each frame extracted from the oscillation signal by a sliding window,
- calculates a sum of a normalized frequency spectrum, from the frequency spectrum of the each frame, for each lane,
- detects a first peak in at least one of a plurality of the sums of normalized frequency spectrum, each of the sums corresponding to each lane, to find a first vehicle region that is a time interval during which a vehicle is travelling on a lane and there is no vehicle travelling on other lane(s),
- performs the BSS to the oscillation signals of a time interval including the first vehicle region to estimate and separate the source oscillation signals,
- calculates an amplitude ratio based on the oscillation signal measured by the sensor for each lane and a corresponding source oscillation signal specific to each lane estimated by the BSS, and
- adjusts an amplitude of the source oscillation signal specific to each lane, by amplifying the amplitude of the source oscillation signal with the amplitude ratio to output the amplitude adjusted oscillation signals.
3. The vehicle detection apparatus according to claim 1, wherein the vehicle estimation part obtains a feature value for each frame of the amplitude adjusted oscillation signal by applying Fourier transform to the each frame extracted by a window of a predetermined length, and calculating a feature value for the each frame in a frequency domain,
- performs Gaussian mixture model-clustering on a time series of the feature values for respective frames to estimate one or more clusters, each of which is modeled with a Gaussian probability distribution best fit to the time series, and
- detects and counts individual vehicles passing on the lane by counting number of clusters, each of which has a probability density value greater than a predetermined threshold value for detection of a response oscillation due to a vehicle passing on the lane.
4. The vehicle detection apparatus according to claim 1, where the estimation part applies Fourier transform to each frame extracted by a window of a predetermined length to obtain a frequency spectrum of the each frame,
- calculates a normalized frequency spectrum of the each frame by normalizing the frequency spectrum of the each frame,
- calculates a frame-wise sum of an amplitude spectrum of the normalized frequency spectrum, for the each frame,
- performs scaling of the frame-wise sum to a pre-defined range,
- obtains a time repeated vector of the scaled frame-wise sum by multiplying a time value of each scaled frame-wise sum by a magnitude of the each frame-wise sum,
- performs the Gaussian mixture model-clustering on the time repeated vector, and
- detect and counts individual vehicles passing on the lane by counting the number of clusters, each of which has a probability density value greater than a predetermined threshold value for detection of a response oscillation due to a vehicle passing on the lane.
5. A computer-based vehicle detection method comprising:
- acquiring a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation induced by a vehicle passing on the lane;
- performing signal separation processing comprising: applying blind source separation (BSS) to the plurality of the oscillation signals to estimate and separate a plurality of source oscillation signals, each source oscillation signal specific to each lane; and adjusting amplitude of an individual one of the plurality of the source oscillation signals to output a plurality of amplitude adjusted oscillation signals; and
- performing estimation processing comprising: receiving the amplitude adjusted oscillation signal corresponding to the lane of interest output from the signal separation processing; and estimating, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count individual vehicles passing on the lane of interest.
6. The computer-based vehicle detection method according to claim 5, wherein the signal separation processing comprises:
- calculating a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to each frame extracted by a window of a predetermined length;
- calculating a sum of a normalized frequency spectrum, from the frequency spectrum of each frame, for each lane,
- detecting a first peak in at least one of a plurality of the sums of normalized frequency spectrum, each of the sums corresponding to each lane, to find a first vehicle region that is a time interval during which a vehicle is travelling on a lane and there is no vehicle travelling on other lane(s),
- performing the BSS to the oscillation signals of a time interval including the first vehicle region to estimate and separate the source oscillation signals,
- calculating an amplitude ratio based on the oscillation signal measured by the sensor for each lane and a corresponding source oscillation signal specific to each lane estimated by the BSS, and
- adjusting an amplitude of the source oscillation signal specific to each lane, by amplifying the amplitude of the source oscillation signal with the amplitude ratio to output the amplitude adjusted oscillation signals.
7. The computer-based vehicle detection method according to claim 5, wherein the estimation processing comprises:
- obtaining a feature value for each frame of the amplitude adjusted oscillation signal by applying Fourier transform to each frame extracted by a window of a predetermined length, and calculating a feature value for the each frame in a frequency domain,
- performing Gaussian mixture model-clustering on a time series of the feature values for respective frames to estimate one or more clusters, each of which is modeled with a Gaussian probability distribution best fit to the time series, and
- detecting and counting individual vehicles passing on the lane by counting number of clusters, each of which has a probability density value greater than a predetermined threshold value for detection of a response oscillation due to a vehicle passing on the lane.
8. The computer-based vehicle detection method according to claim 5, wherein the estimation processing comprises:
- applying Fourier transform to each frame extracted by a window of a predetermined length to obtain a frequency spectrum of the each frame,
- calculating a normalized frequency spectrum of the each frame by normalizing the frequency spectrum of the each frame,
- calculating a frame-wise sum of an amplitude spectrum of the normalized frequency spectrum, for the each frame,
- performing scaling of the frame-wise sum to a pre-defined range, obtaining a time repeated vector of the scaled frame-wise sum by multiplying a time value of each scaled frame-wise sum by a magnitude of the each frame-wise sum,
- performing the Gaussian mixture model-clustering on the time repeated vector, and
- detecting and counting individual vehicles passing on the lane by counting the number of clusters, each of which has a probability density value greater than a predetermined threshold value for detection of a response oscillation due to a vehicle passing on the lane.
9. A non-transitory computer readable medium storing thereon a program causing a computer to execute processing comprising:
- acquiring a plurality of oscillation signals from a plurality of sensors, respectively, each sensor provided for each lane of a bridge that includes a plurality of lanes running in parallel and capable of sensing oscillation induced by a vehicle passing on the lane;
- performing signal separation processing comprising: applying blind source separation (BSS) to the plurality of the oscillation signals to estimate and separate a plurality of source oscillation signals, each source oscillation signal specific to each lane; and adjusting amplitude of an individual one of the plurality of the source oscillation signals to output a plurality of amplitude adjusted oscillation signals; and
- performing estimation processing comprising: receiving the amplitude adjusted oscillation signal corresponding to the lane of interest output from the signal separation processing; and estimating, from the amplitude adjusted oscillation signal, a response oscillation due to a vehicle passing on the lane of interest to detect and count individual vehicles passing on the lane of interest.
10. The non-transitory computer readable medium according to claim 9, wherein the signal separation processing comprises:
- calculating a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to each frame extracted by a window of a predetermined length;
- calculating a sum of a normalized frequency spectrum, from the frequency spectrum of each frame, for each lane,
- detecting a first peak in at least one of a plurality of the sums of normalized frequency spectrum, each of the sums corresponding to each lane, to find a first vehicle region that is a time interval during which a vehicle is travelling on a lane and there is no vehicle travelling on other lane(s),
- performing the BSS to the oscillation signals of a time interval including the first vehicle region to estimate and separate the source oscillation signals,
- calculating an amplitude ratio based on the oscillation signal measured by the sensor for each lane and a corresponding source oscillation signal specific to each lane estimated by the BSS, and
- adjusting an amplitude of the source oscillation signal specific to each lane, by amplifying the amplitude of the source oscillation signal with the amplitude ratio to output the amplitude adjusted oscillation signals.
11. The non-transitory computer readable medium according to or claim 9, wherein the estimation processing comprises:
- obtaining a feature value for each frame of the amplitude adjusted oscillation signal by applying Fourier transform to each frame extracted by a window of a predetermined length, and calculating a feature value for the each frame in a frequency domain,
- performing Gaussian mixture model-clustering on a time series of the feature values for respective frames to estimate one or more clusters, each of which is modeled with a Gaussian probability distribution best fit to the time series, and
- detecting and counting individual vehicles passing on the lane by counting number of clusters, each of which has a probability density value greater than a predetermined threshold value for detection of a response oscillation due to a vehicle passing on the lane.
12. The non-transitory computer readable medium according to claim 9, wherein the estimation processing comprises:
- applying Fourier transform to each frame extracted by a window of a predetermined length to obtain a frequency spectrum of the each frame,
- calculating a normalized frequency spectrum of the each frame by normalizing the frequency spectrum of the each frame,
- calculating a frame-wise sum of an amplitude spectrum of the normalized frequency spectrum, for the each frame,
- performing scaling of the frame-wise sum to a pre-defined range,
- obtaining a time repeated vector of the scaled frame-wise sum by multiplying a time value of each scaled frame-wise sum by a magnitude of the each frame-wise sum,
- performing the Gaussian mixture model-clustering on the time repeated vector, and
- detecting and counting individual vehicles passing on the lane by counting the number of clusters, each of which has a probability density value greater than a predetermined threshold value for detection of a response oscillation due to a vehicle passing on the lane.
13. The vehicle detection apparatus according to claim 1, wherein
- the vehicle estimation part that obtains a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to the each frame extracted from the oscillation signal by a sliding window and calculates a sum of a normalized frequency vector, from the frequency spectrum of the each frame, for each lane, to generate a maximum vector with each element thereof being a max value of the sum of a normalized frequency vectors calculated for the plurality of lane,
- generates a binary vector with columns, number of which is equal to number of the sums of normalized frequency vectors and with rows, an element of which corresponds to a time index and has a value 1 at an element position with a maximum value and 0 otherwise,
- obtains time repeated vectors of the sum of a normalized frequency vectors and maximum vectors by multiplying a time value by a magnitude value of each of the vectors,
- performs Gaussian mixture model-clustering on the time repeated vector to count number of clusters and finds start time and end time of presence of a vehicle in each lane, and
- calculates a column-wise mean value of elements corresponding to the start time and the end time, in a row of the binary matrix to decide that the vehicle is present in a lane corresponding to a column of the binary matrix for which the column-wise mean value is calculated if the column-wise mean value is not less than a predetermined threshold value,
- while if the column-wise mean value is less than a predetermined threshold value for all columns of the binary matrix, deciding that the vehicle is present in the plurality of lanes, wherein the vehicle estimation part is enabled to detect presence or absence of a vehicle passing on a lane of the bridge, without using BSS.
14. The computer-based vehicle detection method according to claim 5, wherein the estimation processing comprises:
- obtaining a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to the each frame extracted from the oscillation signal by a sliding window and calculating a sum of a normalized frequency vector, from the frequency spectrum of the each frame, for each lane, to generate a maximum vector with each element thereof being a maximum value of the sum of a normalized frequency vectors calculated for the plurality of lane;
- generating a binary vector with columns, number of which is equal to number of the sums of normalized frequency vectors and with rows, an element of which corresponds to a time index and has a value 1 at an element position with a maximum value and 0 otherwise,
- obtaining time repeated vectors of the sum of a normalized frequency vectors and maximum vectors by multiplying a time value by a magnitude value of each of the vectors,
- performing Gaussian mixture model-clustering on the time repeated vector to count number of clusters to find start time and end time of presence of a vehicle in each lane;
- calculating a column-wise mean value of elements corresponding to the start time and the end time, in a row of the binary matrix to decide that the vehicle is present in a lane corresponding to a column of the binary matrix for which the column-wise mean value is calculated if the column-wise mean value is not less than a predetermined threshold value,
- while if the column-wise mean value is less than a predetermined threshold value for all columns of the binary matrix, deciding that the vehicle is present in the plurality of lanes, wherein the estimation processing is enabled to detect presence or absence of a vehicle passing on a lane of the bridge, without using BSS.
15. The non-transitory computer readable medium according to claim 9, wherein estimation processing comprises:
- obtaining a frequency spectrum of each frame of the oscillation signal by applying Fourier transform to the each frame extracted from the oscillation signal by a sliding window and calculating a sum of a normalized frequency vector, from the frequency spectrum of the each frame, for each lane, to generate a maximum vector with each element thereof being a maximum value of the sum of a normalized frequency vectors calculated for the plurality of lane;
- generating a binary vector with columns, number of which is equal to number of the sums of normalized frequency vectors and with rows, an element of which corresponds to a time index and has a value 1 at an element position with a maximum value and 0 otherwise,
- obtaining time repeated vectors of the sum of a normalized frequency vectors and maximum vectors by multiplying a time value by a magnitude value of each of the vectors,
- performing Gaussian mixture model-clustering on the time repeated vector to count number of clusters to find start time and end time of presence of a vehicle in each lane;
- calculating a column-wise mean value of elements corresponding to the start time and the end time, in a row of the binary matrix to decide that the vehicle is present in a lane corresponding to a column of the binary matrix for which the column-wise mean value is calculated if the column-wise mean value is not less than a predetermined threshold value,
- while if the column-wise mean value is less than a predetermined threshold value for all columns of the binary matrix, deciding that the vehicle is present in the plurality of lanes, wherein the estimation processing is enabled to detect presence or absence of a vehicle passing on a lane of the bridge, without using BSS.
Type: Application
Filed: Mar 12, 2020
Publication Date: May 18, 2023
Applicant: NEC Corporation (Minato-ku, Tokyo)
Inventors: Murtuza PETLADWALA (Tokyo), Shohei KINOSHITA (Tokyo), Shigeru KASAI (Tokyo)
Application Number: 17/908,597