INTEGRATED INTELLIGENT CAB SYSTEM FOR TRAIN DRIVERS

Abstract

An integrated intelligent cab system for train drivers includes: a train auxiliary management system, configured to acquire train driver-side information; a train operation control system, configured to acquire train operation-side information; and a central control system, connected to the train auxiliary management system and the train operation control system respectively so as to implement data interaction therebetween. The central control system generates a train operation command based on the train operation-side information and the driver-side information, and sends the train operation command to the train operation control system, and the train operation control system controls train operation based on the train operation command. The train auxiliary management system, the train operation control system and the central control system adjust their respective operations based on data from one another and their own data. The system has the advantages of improving the levels of intelligence and informatization of train operation.

Description

CROSS REFERENCE TO THE RELATED APPLICATIONS

This application is the continuation-in-part application of International Application No. PCT/CN2024/131295, filed on November 11, 2024, which is based upon and claims priority to Chinese Patent Application No. 202411409569.3, filed on October 10, 2024, the entire contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present application relates to the field of train cab systems, and particularly to an integrated intelligent cab system for train drivers.

BACKGROUND

Improving a driver’s driving level and driving experience is crucial to improving train operation; however, at present, there are relatively few solutions specifically proposed for optimizing the driver cab-side of a train. In existing trains, there are multiple systems each having a human-machine interface, including Cab Integrated Radio Communication equipment (CIR), Automatic Train Protection System (ATP), a Train Control and Monitoring System (LKJ), and an interface data unit (IDU), requiring the driver to perform repeated confirmations.

Moreover, for example, there are problems such as a lack of interaction information among display programs within the same train, an insufficient level of intelligence in the train driver cab, limited auxiliary means within a short visual range of the driver, a need for improvement in the level of driver behavior inspection, and a failure to sufficiently combine the latest AI technologies such as voice recognition and image recognition. As a result, there is room for improvement in human-machine friendliness and the level of intelligence.

SUMMARY

An objective of the present application is to provide an integrated intelligent cab system for train drivers, which has the advantage of improving the levels of intelligence and informatization of train operation.

To achieve the above objective, the present application provides an integrated intelligent cab system for train drivers, comprising: a train auxiliary management system configured to acquire train driver-side information; a train operation control system configured to acquire train operation-side information; and a central control system connected to the train auxiliary management system and the train operation control system respectively, so as to implement data interaction therebetween; the central control system generates a train operation command based on the train operation-side information and the train driver-side information, and sends the train operation command to the train operation control system, and the train operation control system controls train operation based on the train operation command; the train auxiliary management system, the train operation control system, and the central control system adjust their respective operations based on data from one another and their own data; the train auxiliary management system comprises an intelligent driver behavior verification system, a driver visual range system, and a driver operation assistance system; the driver visual range system comprises an unmanned aerial vehicle body, and observation images of a route ahead of the train are captured via a camera mounted on the unmanned aerial vehicle body.

Preferably, the central control system comprises a display interaction system configured to display all data received by the central control system, and is further configured to implement basic control over the train auxiliary management system and the train operation control system via the display interaction system.

Preferably, the train driver-side information is train operation-related information generated with the train driver as the core.

Preferably, the train operation-side information is train operation-related information generated with train operation as the core.

Preferably, the intelligent driver behavior verification system comprises: an action capture module configured to acquire driver action information; an action analysis module connected to the action capture module, which is configured to receive and analyze the driver action information and convert the driver action information into a driver action result; and an action verification module connected to the action analysis module and the central control system respectively, which is configured to receive the driver action result and collect an ideal action result, perform comparative verification between the driver action result and the ideal action result, and output corresponding train driver-side information to the central control system.

Preferably, respective artificial intelligence models are embedded in the action capture module, the action analysis module, and the action verification module.

Preferably, the artificial intelligence models adopt diffusion models; the action capture module converts the driver action information into a form of data codes; the action analysis module analyzes the data codes to extract key action nodes from the data codes; and the action verification module verifies the key action nodes and outputs corresponding results.

Preferably, the driver visual range system further comprises a plurality of cameras mounted on a train body; the cameras are all connected to the central control system, and the central control system displays captured content in real time.

Preferably, the driver visual range system further comprises: an unmanned aerial vehicle activation module connected to the central control system and the unmanned aerial vehicle body respectively, configured to store parameters and operating programs of an unmanned aerial vehicle, and output an unmanned aerial vehicle command to the unmanned aerial vehicle body based on data from the central control system; the unmanned aerial vehicle body executes an observation task and acquires observation data based on the unmanned aerial vehicle command from the unmanned aerial vehicle activation module; and an unmanned aerial vehicle data collection module connected to the unmanned aerial vehicle activation module, the unmanned aerial vehicle body and the central control system respectively, configured to receive data from the unmanned aerial vehicle activation module and the unmanned aerial vehicle body, and transmit the data to the central control system.

Preferably, the driver operation assistance system comprises: an identity verification module connected to the central control system and configured to receive identity card information from the central control system, verify an identity of a driver, and send an assistance system activation instruction when the identity card verification is successful; an object selection module connected to the identity verification module, and configured to generate a communication instruction when receiving the assistance system activation instruction; and an information communication module connected to the object selection module, and configured to receive the communication instruction from the object selection module and conduct information communication in accordance with the communication instruction. The information communication module is further connected to the central control system to achieve interaction with the outside world.

Preferably, the driver operation assistance system comprises: a train information call module connected to the central control system, configured to generate an information call instruction based on an information call request from the central control system; and a cloud database module connected to the train information call module and the central control system, respectively. The cloud database module is configured to store train information, extract corresponding cloud data according to the received information call instruction, and transmit the cloud data to the central control system to achieve interaction with the outside world.

Preferably, the train operation control system comprises: an ATP, and/or an Automatic Train Operation System (ATO), and/or a CIR, and/or an LKJ; each of the devices is connected to the central control system; the ATP, and/or the ATO, and/or the CIR, and/or the LKJ all control train operation based on the train operation command.

Preferably, each of the devices is provided with a corresponding misoperation prevention module and connected to the corresponding misoperation prevention module, and the corresponding misoperation prevention module provides corresponding feedback when the driver performs a misoperation.

Preferably, each of the devices is provided with a corresponding alarm device and connected to the corresponding alarm device; when the corresponding alarm device detects hazard information, the corresponding alarm device sends alarm information to the driver; the corresponding alarm device sends the hazard information to the central control system via the corresponding device, and the central control system then sends the hazard information to the driver operation assistance system to achieve the query of relevant information of an emergency plan.

Preferably, each of the devices is provided with a corresponding emergency call module and connected to the corresponding emergency call module, and the corresponding emergency call module triggers an emergency call and automatically sends rescue information.

Preferably, the display interaction system comprises: a security protection layer connected to the train operation control system and the train auxiliary management system respectively, and configured to receive the train driver-side information/train operation-side information and perform security inspection on the train driver-side information/train operation-side information; and a human-machine interaction layer being in signal connection with the security protection layer, and configured to receive the inspected train driver-side information/train operation-side information and display the inspected train driver-side information/train operation-side information.

A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the aforementioned integrated intelligent cab system for train drivers is implemented.

An electronic device comprises a processor and a memory. A computer program is stored in the memory. When the computer program is executed by the processor, the aforementioned integrated intelligent cab system for train drivers is implemented.

In summary, compared with the prior art, the integrated intelligent cab system for train drivers provided by the present application has the following beneficial effects:

• • 1. The present application provides an integrated intelligent cab system for train drivers, thereby realizing efficient information transmission.
  • 2. The present application provides a driver visual range system based on an unmanned aerial vehicle, which supports remote control by the driver and transmits real-time images to the central control system, thereby extending the driver's visual range.
  • 3. The present application provides an integrated intelligent cab system for train drivers, enabling the driver to obtain more information, which is conducive to formulating better driving strategies.
  • 4. The present application provides an integrated intelligent cab system for train drivers, supporting voice input to facilitate driver operations, providing operation suggestions for the driver, improving the driver's emergency disposal efficiency in case of failures, and enabling the driver to focus on train control observation and operation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of an embodiment of a driver visual range system according to the present application.

FIG. 2 is a schematic diagram of an embodiment of a display interaction system according to the present application.

FIG. 3 is a schematic diagram of an embodiment of an intelligent driver behavior verification system according to the present application.

FIG. 4 is a schematic diagram of an embodiment of an intelligent driver behavior verification system according to the present application.

FIG. 5 is a schematic diagram of an embodiment of an integrated intelligent cab system for train drivers according to the present application.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The technical solutions, structural features, and achieved objectives and effects in embodiments of the present application are described below in detail with reference to FIG. 1 to FIG. 5 in the embodiments of the present application.

It should be noted that the accompanying drawings adopt a very simplified form and all use inaccurate proportions, which are only used to assist in conveniently and clearly describing the implementation of the present application and are not intended to limit the implementation conditions of the present application. Therefore, it has no technical substantive significance. Any structural modification, change of a scale relationship or adjustment of size should still fall within the scope that can be covered by the technical content disclosed by the present application without affecting the effects and the objective achieved by the present application.

It should be noted that in this specification, relational terms such as first and second are only used to differentiate one entity or operation from another entity or operation, and do not necessarily require or imply that any actual relation or sequence exists between these entities or operations. Furthermore, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes elements explicitly listed, but further includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

The present application provides an integrated intelligent cab system for train drivers, which is used to facilitate train drivers in handling various train operation situations, such as communication between trains, communication between trains and radio block centers, emergency braking of trains, capture of train operation environment conditions, etc. The system has the advantages of improving the intelligence and convenience of train operation.

As shown in FIG. 5, the system includes:

a train auxiliary management system, configured to acquire train driver-side information;

a train operation control system, configured to acquire train operation-side information; and

a central control system, connected to the train auxiliary management system and the train operation control system respectively to achieve data interaction therebetween, including receiving train operation-side information and train driver-side information;

The central control system generates a train operation command based on the train operation-side information and the train driver-side information, and sends the train operation command to the train operation control system, and the train operation control system controls train operation based on the train operation command.

The train auxiliary management system, the train operation control system and the central control system can adjust their respective operations based on data from one another and their own data. For example, the central control system can determine an information transmission strategy to be adopted based on a priority order of the train driver-side information sent by the train auxiliary management system; the train auxiliary management system can determine which functions to activate based on train operation-side information of the train operation control system (as described in detail below); and the train auxiliary management system can acquire an operating status of a driver based on the train driver-side information, and to determine whether to record certain scenarios (such as driver operation errors).

Examples of the train driver-side information are as follows: (1) the driver's action confirmation feedback on train operation signals; (2) the driver's voice confirmation feedback on train operation signals; (3) the driver's visual range adjustment; (4) execution status of the train driver and a dispatching center; (5) the driver's action feedback in emergencies, etc. In summary, the train driver-side information refers to a series of train operation-related information generated with the train driver as the core.

Furthermore, the present application may also provide a dexterous manipulator, which is configured to receive voice operation instructions from the driver, execute actions specified by the driver's instructions, and assist the driver in completing cab operations. To avoid instruction recognition errors, a method of multiple inputs and multiple confirmations may be adopted, that is, the same instruction is repeated multiple times in different description ways, and only when the multiple inputs are consistent can it be used as a valid input instruction for the manipulator.

Examples of the train operation-side information are as follows: (1) transmission of train operation data; (2) automatic train operation status; (3) activation status of the ATO; (4) operation status of the LKJ, etc. In summary, the train operation-side information refers to a series of train operation-related information generated with train operation as the core.

Further, in a preferred embodiment, the central control system includes a display interaction system, which can display all data received by the central control system (including train operation-side information and train driver-side information) to facilitate the reading of corresponding situations by the outside world. In addition, the controls of the train auxiliary management system and the train operation control system can also be set in the display interaction system, and the driver can implement basic control of the train auxiliary management system and the train operation control system via the display interaction system, which is quite convenient; in a specific embodiment, the display interaction system can be implemented with a display screen as the core and by configuring corresponding operating programs.

As further shown in FIG. 5, the following describes a specific embodiment of a control system, which will introduce the train auxiliary management system, the train operation control system and the central control system, respectively:

I. Train Auxiliary Management System

The function of the train auxiliary management system is to acquire train driver-side information. To ensure information acquisition, the train auxiliary management system includes an intelligent driver behavior verification system, a driver visual range system and a driver operation assistance system. The following will introduce the three subordinate systems one by one.

1. Intelligent Driver Behavior Verification System

The intelligent driver behavior verification system is mainly aimed at verifying and comparing the ideal action result (instructions from station attendants or signals from the train operation control system) and the driver action result (driver's action feedback) when the driver needs to give corresponding action feedback to the instructions from station attendants or signals from the train operation control system when the train enters or exits a station. For this reason, the intelligent driver behavior verification system is designed.

The intelligent driver behavior verification system includes:

an action capture module, configured to acquire driver action information;

an action analysis module, connected to the action capture module, and configured to receive and analyze the driver action information and convert the driver action information into a driver action result; and

an action verification module, connected to the action analysis module and the central control system respectively, and configured to receive the driver action result, collect an ideal action result, perform comparative verification between the driver action result and the ideal action result, and output corresponding train driver-side information to the central control system.

To further optimize the smooth operation of the intelligent driver behavior verification system, artificial intelligence models can also be used for auxiliary operation. Respective artificial intelligence models are embedded in the action capture module, the action analysis module and the action verification module to achieve operation optimization.

The application of specific scenarios is as follows:

When the train departs from the station, the station attendant gives a corresponding gesture signal for departure on a platform (i.e., the ideal action result); or the train operation control system receives relevant signals from a train operation section, and the driver needs to make corresponding actions to indicate receipt.

Specifically, the action capture module automatically captures gesture actions of the driver (driver action information) and inputs the driver action information into the artificial intelligence model for preliminary judgment. The action analysis module receives the gesture actions of the driver and uses the artificial intelligence model to further analyze the gesture actions of the driver to obtain a corresponding driver action result. In this embodiment, it is assumed to be the driver action result of "driving at a safe speed"; at this time, the driver action result is transmitted to the action verification module, which uses the artificial intelligence model to perform verification within a certain period of time. If the driver action result is inconsistent with the ideal action result, the action verification module outputs the train driver-side information of "the driver has not executed a standard procedure". As mentioned above, the central control system receives the train driver-side information and then interacts with the outside world, such as transmitting the train driver-side information to the radio block center or to other trains on the same track. The outside world here has a broad meaning.

In addition, as mentioned above, the train auxiliary management system, the train operation control system and the central control system can adjust their respective operations based on data from one another and their own data; this is also the case herein. When the train auxiliary management system outputs the train driver-side information of "the driver has not performed a standard procedure", the remaining modules of the train auxiliary management system can operate independently. For example, when the train auxiliary management system outputs the information indicating "the driver has not executed the standard process", the remaining modules of the train auxiliary management system automatically query an emergency manual, send the emergency manual to the driver, and automatically initiate an active telephone communication reminder, among other actions. For example, the train operation control system may also enter a standby activation mode based on the information (“the driver has not executed a standard procedure”), that is, a predefined standard procedure is preset for the condition that “the driver has not executed a standard procedure”, such that, when the foregoing condition is satisfied, the train can automatically respond so as to reduce operational risks. The central control system may also determine, based on the information (“the driver has not executed a standard procedure”), whether to explicitly display the information on a display screen, that is, a predefined response procedure is preset for the condition that “the driver has not executed a standard procedure,” such that, when the foregoing condition is satisfied, the central control system actively intervenes to remind the driver.

In addition, an artificial intelligence model may be implemented using a diffusion model. The diffusion model is a method for generating high-quality images by learning the reverse process of noise. An embodiment using the diffusion model is described as follows: the action capture module converts gesture images of a driver (driver action information) into data codes; the action analysis module analyzes the data codes to extract key action nodes from the data codes; and the action verification module only needs to verify the key action nodes and output corresponding results.

In addition, the intelligent driver behavior verification system may capture posture actions of the driver, so as to monitor a driver's fatigue state. For example, when the driver is in a fatigue state and the train is operating at a high speed, the central control system sends a train operation command of “safe operation” to the train operation control system.

In addition, the intelligent driver behavior verification system may further include a speech recognition module. In this case, the intelligent driver behavior verification system records, analyzes, and converts driver’s speech into text information, and searches for and matches the text information with text keywords corresponding to an ideal result, so as to output a corresponding result. The specific principle is the same as described above and will not be repeated herein.

2. Driver Visual Range System

The driver visual range system refers to a system in which a driver, while in a cab, observes a route ahead of the train, and is a system for assisting the driver in observing a driver visual distance of train operation; for example, a plurality of cameras may be installed on the train body, and the cameras are all connected to the central control system (in this case, the display interaction system of the central control system employs a display screen), and the driver may observe captured environmental information in real time through the central control system. In addition, in order to further save space resources and circuit resources, solar cells may be installed to power the cameras.

The above description illustrates one example of the driver visual range system. In this embodiment, a driver visual range system designed based on an unmanned aerial vehicle is proposed. Under such a design, the driver visual range system includes:

an unmanned aerial vehicle activation module, which is connected to the central control system, and configured to store parameters and operating programs of an unmanned aerial vehicle, and output unmanned aerial vehicle commands based on data from the central control system, where the data from the central control system includes, for example, driver operation behaviors in the display interaction system of the central control system; the unmanned aerial vehicle activation module converts such operation behaviors into unmanned aerial vehicle commands for the unmanned aerial vehicle, so as to implement subsequent processes; for example, the unmanned aerial vehicle activation module is configured with certain conditions for outputting unmanned aerial vehicle commands; for example, when the central control system receives information that the driver, via the intelligent driver behavior verification system, has repeatedly confirmed the posture of the route ahead and this condition is satisfied, because data interaction occurs between the systems, the unmanned aerial vehicle activation module can clearly obtain the corresponding data, and thereby initiate subsequent processes;

an unmanned aerial vehicle body, which is connected to the unmanned aerial vehicle activation module, according to unmanned aerial vehicle commands from the unmanned aerial vehicle activation module, executes observation tasks to acquire observation data, and is generally equipped with a camera for observation, without specific limitation herein; and

an unmanned aerial vehicle data collection module, which is connected to the unmanned aerial vehicle activation module, the unmanned aerial vehicle body and the central control system respectively, and configured to receive data from the unmanned aerial vehicle activation module and the unmanned aerial vehicle body, and transmit the data to the central control system, where the purpose of connecting to the unmanned aerial vehicle activation module is to store unmanned aerial vehicle commands to facilitate subsequent review operations, etc.; the purpose of connecting to the unmanned aerial vehicle body is to acquire observation data; the purpose of connecting to the central control system is to transmit data (train driver-side information, specifically the observation data used by the driver) to display corresponding results to the outside world.

The following is an operation mode of the driver visual range system using an unmanned aerial vehicle:

Step S1. Preset parameters and operating programs of the unmanned aerial vehicle activation module in advance. When an activation condition of the unmanned aerial vehicle activation module is satisfied, the unmanned aerial vehicle activation module sends an unmanned aerial vehicle command to the unmanned aerial vehicle body and proceeds to Step S2; otherwise, the unmanned aerial vehicle activation module remains in a silent state;

Step S2. The unmanned aerial vehicle body observes a corresponding area in accordance with the unmanned aerial vehicle command and transmits observation data to the unmanned aerial vehicle data collection module;

Step S3. The unmanned aerial vehicle data collection module performs subdivision processing on the observation data and transmits key information to the central control system.

The subdivision processing in Step S3 refers to capturing key images of observation images, such as whether there are obstacles or automatically selecting the best segments, etc.; Step S3 can also skip the stage of subdivision processing. For example, when the central control system adopts a display screen, the observation data is directly transmitted to the display screen of the central control system via the unmanned aerial vehicle data collection module, so that information of the corresponding area can be obtained in the form of real-time images, facilitating the driver's grasp of the environment of the route ahead; in this case, the unmanned aerial vehicle data collection module only plays a role of transmitting the observation data.

The following describes a specific embodiment where the activation condition of the driver visual range system using an unmanned aerial vehicle is "when the train operation control system needs to perform a braking operation". Because the driver also needs to perform corresponding operations when the train operation control system needs to perform a braking operation on the train, the driver visual range system needs to provide the driver with the corresponding situation of the route ahead; in this embodiment, the central control system adopts a display screen;

Step Q1. The unmanned aerial vehicle activation module satisfies the activation conditions (when the train operation control system needs to perform a braking operation, the driver needs to confirm that the route ahead is a free route), and the unmanned aerial vehicle activation module is activated and sends an unmanned aerial vehicle command to the unmanned aerial vehicle body;

The specific data transmission method will not be described herein;

Step Q2. The unmanned aerial vehicle body observes a corresponding area in accordance with the unmanned aerial vehicle command and transmits observation data to the unmanned aerial vehicle data collection module;

Step Q3. The unmanned aerial vehicle data collection module directly transmits the observation data to the central control system;

Step Q4. The display screen of the central control system directly displays the observation data in the form of real-time images;

Step Q5. The driver observes the corresponding area through the display screen and performs auxiliary operations for train braking.

The observation mode in Step Q2 may be an automatic mode or an active mode; when in the automatic mode, the unmanned aerial vehicle body automatically runs and observes along a track of the route ahead according to the unmanned aerial vehicle command; when in the active mode, the unmanned aerial vehicle command only activates the unmanned aerial vehicle body, and the driver remotely controls the unmanned aerial vehicle body to fly along the track of the route ahead through the central control system, etc.; other situations may be adjusted as needed.

Step Q2 supports the driver to input an operation type to the unmanned aerial vehicle, and the types include detection operation, guidance operation, integrity confirmation and other train maintenance operations. Corresponding to the operation type, there are also parameters corresponding to the operation type. For the detection operation, the parameter may be specified as a station track number or a default value (indicating a current station track), and the unmanned aerial vehicle can independently travel forward along the station track until a signal machine ahead, and send the images to the central control system in real time to confirm that the section between the train and the signal machine ahead is free. For the guidance operation, the route number may be input, and the unmanned aerial vehicle may travel forward along a station track route in accordance with configuration data and send images of the route ahead to a central control screen in a driver cab in real time; for integrity confirmations and other train inspection operations, the unmanned aerial vehicle travels rearward along the train and transmits image data to the driver central control system. The driver may remotely control the unmanned aerial vehicle to fly to a corresponding area and capture corresponding high-definition images.

3. Driver Operation Assistance System

The driver operation assistance system mainly functions to assist the driver in communicating with other trains, radio block centers, information centers, and other entities, so as to facilitate information transmission by the driver and acquisition of required information.

The driver operation assistance system is described below with reference to corresponding embodiments. Two embodiments are provided, including a first embodiment of information communication and a second embodiment of information query.

1. Information Communication

The driver operation assistance system includes:

an identity verification module, connected to the central control system, and configured to receive identity card information from the central control system and verify an identity of a driver, and send an assistance system activation instruction when the identity card verification is successful; specifically, when the driver needs to use the driver operation assistance system, the driver inputs his/her relevant identity information into the identity verification module through the central control system to achieve activation;

an object selection module, connected to the identity verification module, configured to generate a communication instruction when receiving the assistance system activation instruction; where the communication instruction includes the selection of a communication object, the identity confirmation of the communication object, the configuration of a communication channel, the setting of a communication channel key, etc.;

an information communication module, connected to the object selection module and configured to receive the communication instruction from the object selection module and conduct information communication in accordance with the communication instruction;

In addition, the information communication module is further connected to the central control system to achieve interaction with the outside world; specifically, when the central control system adopts a display screen, the display screen may be used to display real-time data during information communication, such as communication time and communication channels; or when the information communication module needs to be configured, update operations may be performed through the central control system; similarly, artificial intelligence may also be introduced into the information communication module to convert the voice content in information communication into text form for the driver's reference; the configuration and reception of the other party are general settings for those skilled in the art, not the focus of this case, and will not be repeated herein.

Specifically, the following will introduce a specific embodiment where the information communication module adopts the form of "telephone communication":

Step W1. The driver inputs his/her own information into the identity verification module. After passing the identity authentication, the identity verification module sends an assistance system activation instruction to the object selection module, and proceeds to Step W2; otherwise, the identity verification module is in a silent state;

Step W2. The object selection module generates a communication instruction;

In this embodiment, the communication instruction includes adopting telephone communication, and the purpose of this communication is a train speed-related problem;

Step W3. The information communication module achieves information communication in accordance with the communication instruction;

During information communication, a software automatic recording module is configured inside the information communication module to record chat content; for overseas trains, a voice translation software module may be equipped, and the voice translation software module outputs voice or text according to the language selected by the driver, facilitating the communication between drivers in different languages on overseas railways, and thereby achieving automatic translation.

In addition, the information communication module supports group chat and group data sharing among multiple drivers, multiple dispatchers, multiple signal workers and other authorized personnel.

2. Information Query

The driver operation assistance system includes:

a train information call module, connected to the central control system, and configured to generate an information call instruction based on an information call request from the central control system; the information call request includes, for example, data input by the driver through the central control system;

a cloud database module, connected to the train information call module and the central control system respectively, the cloud database module being configured to store train information, extract corresponding cloud data according to the received information call instruction, and transmit the cloud data to the central control system to achieve interaction with the outside world, where the expression mode is as described earlier, and will not be repeated here.

The train information includes but is not limited to train manuals, train maintenance guides, train emergency plans, train historical data, etc.; for example, the operation manuals, maintenance manuals, emergency disposal manuals of various devices such as ATP, ATO, CIR, and LKJ in the train operation control system may be input into the cloud database module (the aforementioned devices are described in detail below).

When the display interaction system of the central control system adopts a display screen, the driver can interact with the central control system through touch or voice, so that the central control system sends corresponding data to the train information call module to generate an information call instruction, and the cloud database module extracts according to the information call instruction; in addition, when the driver describes the information call request through voice, it may correspond to multiple information query results, and the cloud database module returns multiple information query results for the driver to select. After the driver selects through touch or voice, the cloud database module outputs target information required by the driver; in addition, the cloud database module should also be updated in real time to ensure the accuracy of the required train information.

In this case, the driver can also input his/her own operation suggestions in a certain scenario into the cloud database module through the central control system, including scenario events of a corresponding vehicle type and corresponding driver operations; after input, the input content is in a non-public state. After manual review and confirmation, the input content can be fixedly recorded in the cloud database module, and then the input content is in a public state for other trains to use.

II. Train Operation Control System

The train operation control system includes: ATP, ATO, CIR, and LKJ; each of the devices is connected to the central control system; the ATP, ATO, CIR, and LKJ all control train operation based on the train operation command.

In a preferred embodiment, each of the devices may be provided with a corresponding misoperation prevention module and connected to the corresponding misoperation prevention module, and the corresponding misoperation prevention module provides corresponding feedback when the driver performs a misoperation; for example, when detecting that the driver touches an ATP ceiling speed, causing braking, the misoperation prevention module automatically gives driver operation suggestions, including voice suggestions and image display suggestions.

In a preferred embodiment, each of the devices may be provided with a corresponding alarm device and connected to the corresponding alarm device; when detecting hazard information, the corresponding alarm device sends alarm information to the driver; at the same time, the corresponding alarm device may also send the hazard information to the central control system through the corresponding device, and the central control system then sends the hazard information to the driver operation assistance system to achieve the query of relevant information of the emergency plan.

In a preferred embodiment, each of the devices may be provided with a corresponding emergency call module and connected to the corresponding emergency call module; when the driver determines that the alarm information cannot be handled by himself/herself, the driver is supported to trigger an emergency call through the emergency call module, and the emergency call module automatically sends current train positioning data, speed data, device alarm and other information to relevant rescuers to facilitate rapid rescue.

III. Central Control System

The central control system mainly functions to generate computation instructions and interact with the outside world; as a data interaction platform, this embodiment is described on the basis that the display interaction system is a display screen.

The central control system includes a display interaction system; the CIR, ‌ATP, ‌LKJ and ATO are connected to the display interaction system; the intelligent driver behavior verification system, the driver visual range system and the driver operation assistance system are connected to the display interaction system; the display interaction system is only a part of the central control system, and the computing and other functions of the central control system are not the focus of this case and will not be repeated herein.

Specifically, the display interaction system includes:

a security protection layer, connected to the train operation control system and the train auxiliary management system respectively, and configured to receive the train driver-side information/train operation-side information and perform security inspection on the train driver-side information/train operation-side information; and

a human-machine interaction layer, being in signal connection with the security protection layer, and configured to receive the inspected train driver-side information/train operation-side information and display the train driver-side information/train operation-side information; the human-machine interaction layer may be understood as a display screen;

in addition, the human-machine interaction layer is respectively connected to the train operation control system and the train auxiliary management system, and can send corresponding basic instructions to the train operation control system and the train auxiliary management system through the human-machine interaction layer; the basic instructions refer to simple train control commands such as system on-off instructions, information transmission confirmation instructions, information feedback confirmation instructions, etc. Different from train operation commands, the basic instructions have simple operation steps and operation logic and do not require complex processes, so they can be transmitted through the human-machine interaction layer.

The above is the structure of the display interaction system. As mentioned earlier, in specific applications, the corresponding functions can be achieved by adopting a display screen.

As described in the display interaction system, the train driver-side information/train operation-side information is first subjected to security inspection by the security protection layer. If the result of the security inspection is "illegal", the corresponding information is discarded; if the inspection is passed, the information enters the human-machine interaction layer for display.

In a preferred embodiment, to ensure the effectiveness of the security inspection performed by the security protection layer on the train driver-side information/train operation-side information, the security communication protocol carried by the security protection layer is RSSP-I (Railway Signal Safety Protocol, national standard) or RSSP-II (Railway Signal Safety Communication Protocol, national standard) or Subset-037 (European Radio System Functional Interface Specification), etc.; different security communication protocols can be selected according to actual conditions. To ensure the convenience of display in the human-machine interaction layer, the human-machine interaction layer displays the train driver-side information/train operation-side information by using html (hypertext mark-up language); or the human-machine interaction layer displays the train driver-side information/train operation-side information by using a custom format based on JSON (JavaScript Object Notation, a lightweight data exchange format). For example, when the information needs to be displayed in the form of images, JSON is used to predefine the starting point, width, length, image content, type information, etc. of the image to achieve the corresponding display.

In specific applications, to further optimize the display of the train driver-side information/train operation-side information by the human-machine interaction layer and the process of sending corresponding basic instructions from the human-machine interaction layer to the train operation control system and the train auxiliary management system, a language module may be added to the human-machine interaction layer. The language module may receive voice input, and the human-machine interaction layer operates through voice recognition. For example, "display operation time information of ATO" is input through voice to achieve the corresponding function. In addition, to prevent false activation, a secondary confirmation process may be configured. For example, the first voice input is "display operation time information of ATO", and then the second voice input is "confirm to display operation time information of ATO", so that the human-machine interaction layer can execute the display of operation time information of the ATO.

Similarly, when basic instructions are sent to the train auxiliary management system/train operation control system, a secondary confirmation form may also be adopted, and the basic instructions can be sent to the train auxiliary management system/train operation control system only after secondary confirmation, which is as described earlier and will not be repeated here.

Of course, other modules may be configured for the human-machine interaction layer, such as a weather function module for forecasting weather; or a voice broadcast module for broadcasting texts in the form of voice; or a one-key control module for controlling the basic instructions corresponding to subsystems in the train auxiliary management system and the train operation control system (such as the intelligent driver behavior verification system, the driver operation assistance system and the driver visual range system) in a group-based manner, so that all the subsystems within the group operate through the one-touch control; or a three-dimensional space representation module for intuitively displaying the "operation status of front and rear trains" in the train operation-side information on the track as a top-down view, thereby facilitating the driver in providing corresponding dispatch commands.

In a preferred embodiment, the central control system may be provided with a corresponding voice control system, which converts voice information into specific instruction code data for use by the central control system. The system supports the driver through voice input instructions. The commands may be categorized into 2 types: General control commands, which do not affect train operation safety, such as air-conditioning control, seat posture adjustment, screen display parameter control, and telephone chat control commands. These commands can be designed as one-time commands, meaning that the driver only needs to speak the command once for execution. Train operation control commands, which may affect the operating status of the train and correspond to operations of acceleration/deceleration and directional handles of the train. These commands are designed to require secondary or multiple confirmations, with each confirmation using a different password.

The following will introduce an application case of the integrated intelligent cab system for train drivers proposed by the present application:

As shown in FIGS. 1 and 2, since the train restarts on the station track and is ready to depart, the train loses information of the route ahead due to the restart. The driver sends data to the unmanned aerial vehicle activation module through the central control system, the unmanned aerial vehicle activation module generates an unmanned aerial vehicle command, the unmanned aerial vehicle body operates in accordance with the unmanned aerial vehicle command and acquires images, and the unmanned aerial vehicle data collection module transmits the data to the central control system (the display interaction system in the central control system as shown in FIG. 2), so that the driver can know the information of the route ahead; after completing the operation, the unmanned aerial vehicle returns to the original position in the train to stand by.

As shown in FIG. 2, the human-machine interaction layer of this case adopts a display screen, and the display screen is configured with corresponding programs; as mentioned earlier, the ATP, the CIR and the LKJ are respectively connected to the security protection layer, and the human-machine interaction layer displays the train driver-side information/train operation-side information by using html. Taking the unmanned aerial vehicle operation as an example, the display screen respectively displays multiple input boxes for "distance", "speed", "operation type", and a video receiving box.

As shown in FIG. 2, the human-machine interaction layer also describes the information communication function of the driver operation assistance system, and the train can also achieve information communication with other trains through the human-machine interaction layer.

FIG. 3 illustrates an application case of the intelligent driver behavior verification system. The action capture module acquires driver action information, and the action analysis module converts the driver action information into a driver action result. At this time, an ideal action result is to confirm that the train does not exceed a yellow code position. The action verification module compares and verifies the driver action result (track position) with the ideal action result (the train does not exceed the yellow code position), and outputs the information to the central control system that the driver has confirmed not exceeding the yellow code position.

FIG. 4 illustrates a model architecture, where an image model and a text model are used to further judge action behaviors of the driver, and a big data model can adjust the image model and the text model in real time, so that the judgment can be more accurate.

Although the content of the present application has been described in detail through the above-mentioned preferred embodiments, it should be understood that the above-mentioned description should not be considered a limitation to the present application. Various modifications and alternatives to the present application will become apparent to those skilled in the art upon reading the foregoing application. Therefore, the protection scope of the present application should be defined by the appended claims.

Claims

1. An integrated intelligent cab system for train drivers, comprising:

a train auxiliary management system, configured to acquire train driver-side information;

a train operation control system, configured to acquire train operation-side information; and

a central control system connected to the train auxiliary management system and the train operation control system respectively, so as to implement data interaction therebetween,

wherein the central control system generates a train operation command based on the train operation-side information and the train driver-side information, and sends the train operation command to the train operation control system, and the train operation control system controls train operation based on the train operation command;

the train auxiliary management system, the train operation control system and the central control system adjust their respective operations based on data from one another and their own data; and

the train auxiliary management system comprises an intelligent driver behavior verification system, a driver visual range system and a driver operation assistance system, wherein the driver visual range system comprises an unmanned aerial vehicle body, and observation images of a route ahead of the train are captured via a camera mounted on the unmanned aerial vehicle body.

2. The integrated intelligent cab system according to claim 1, wherein the central control system comprises a display interaction system configured to display all data received by the central control system, and the central control system is further configured to implement basic control over the train auxiliary management system and the train operation control system via the display interaction system.

3. The integrated intelligent cab system according to claim 1, wherein the train driver-side information is train operation-related information generated with a train driver as a core.

4. The integrated intelligent cab system according to claim 1, wherein the train operation-side information is train operation-related information generated with train operation as a core.

5. The integrated intelligent cab system according to claim 1, wherein the intelligent driver behavior verification system comprises:

an action capture module, configured to acquire driver action information;

an action analysis module, connected to the action capture module, and configured to receive and analyze the driver action information and convert the driver action information into a driver action result; and

an action verification module, connected to the action analysis module and the central control system respectively, and configured to receive the driver action result, collect an ideal action result, perform comparative verification between the driver action result and the ideal action result, and output corresponding train driver-side information to the central control system.

6. The integrated intelligent cab system according to claim 5, wherein respective artificial intelligence models are embedded in the action capture module, the action analysis module and the action verification module.

7. The integrated intelligent cab system according to claim 6, wherein the artificial intelligence models adopt diffusion models; the action capture module converts the driver action information into a form of data codes; the action analysis module analyzes the data codes to extract key action nodes from the data codes; and the action verification module verifies the key action nodes and outputs corresponding results.

8. The integrated intelligent cab system according to claim 1, wherein the driver visual range system further comprises a plurality of cameras mounted on a train body; wherein the plurality of cameras are all connected to the central control system, and the central control system displays captured content in real time.

9. The integrated intelligent cab system according to claim 1, wherein the driver visual range system further comprises:

an unmanned aerial vehicle activation module, connected to the central control system and the unmanned aerial vehicle body respectively, and configured to store parameters and operating programs of an unmanned aerial vehicle, and output an unmanned aerial vehicle command to the unmanned aerial vehicle body based on data from the central control system, wherein the unmanned aerial vehicle body executes an observation task and acquires observation data based on the unmanned aerial vehicle command from the unmanned aerial vehicle activation module; and

an unmanned aerial vehicle data collection module, connected to the unmanned aerial vehicle activation module, the unmanned aerial vehicle body and the central control system, respectively, and configured to receive data from the unmanned aerial vehicle activation module and the unmanned aerial vehicle body, and transmit the data to the central control system.

10. The integrated intelligent cab system according to claim 1, wherein the driver operation assistance system comprises:

an identity verification module, connected to the central control system, and configured to receive identity card information from the central control system, verify an identity of a driver, and send an assistance system activation instruction when an identity card verification is successful;

an object selection module, connected to the identity verification module, and configured to generate a communication instruction when receiving the assistance system activation instruction; and

an information communication module, connected to the object selection module and configured to receive the communication instruction from the object selection module and conduct information communication in accordance with the communication instruction;

wherein the information communication module is further connected to the central control system to achieve interaction with an outside world.

11. The integrated intelligent cab system according to claim 1, wherein the driver operation assistance system comprises:

a train information call module, connected to the central control system and configured to generate an information call instruction based on an information call request from the central control system; and

a cloud database module, connected to the train information call module and the central control system respectively, and configured to store train information, extract corresponding cloud data according to the received information call instruction, and transmit the cloud data to the central control system to achieve interaction with an outside world.

12. The integrated intelligent cab system according to claim 1, wherein the train operation control system comprises:

an Automatic Train Protection System (ATP), and/or an Automatic Train Operation System (ATO), and/or Cab Integrated Radio Communication Equipment (CIR), and/or a Train Control and Monitoring System (LKJ);

wherein each of the ATP, the ATO, the CIR and the LKJ is connected to the central control system; and

the ATP, and/or the ATO, and/or the CIR, and/or the LKJ all control train operation based on the train operation command.

13. The integrated intelligent cab system according to claim 12, wherein each of the ATP, the ATO, the CIR and the LKJ is provided with a corresponding misoperation prevention module and connected to the corresponding misoperation prevention module, and the corresponding misoperation prevention module provides corresponding feedback when the driver performs a misoperation.

14. The integrated intelligent cab system according to claim 12, wherein each of the ATP, the ATO, the CIR and the LKJ is provided with a corresponding alarm device and connected to the corresponding alarm device; when detecting hazard information, the corresponding alarm device sends alarm information to the driver; the corresponding alarm device sends the hazard information to the central control system via the corresponding device, and the central control system then sends the hazard information to the driver operation assistance system to achieve a query of relevant information of an emergency plan.

15. The integrated intelligent cab system according to claim 12, wherein each of the the ATP, the ATO, the CIR and the LKJ is provided with a corresponding emergency call module and connected to the corresponding emergency call module, and the corresponding emergency call module triggers an emergency call and automatically sends rescue information.

16. The integrated intelligent cab system according to claim 2, wherein the display interaction system comprises:

a security protection layer, connected to the train operation control system and the train auxiliary management system respectively, and configured to receive the train driver-side information/train operation-side information and perform security inspection on the train driver-side information/train operation-side information; and

a human-machine interaction layer, being in signal connection with the security protection layer, and configured to receive and display the inspected train driver-side information/train operation-side information.

17. A computer-readable storage medium, storing a computer program, wherein when the computer program is executed by a processor, the integrated intelligent cab system according to claim 1 is implemented.

18. An electronic device, comprising a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the integrated intelligent cab system according to claim 1 is implemented.