Abstract: In one embodiment, a system uses an actor-critic reinforcement learning model to generate a trajectory for an autonomous driving vehicle (ADV) in an open space. The system perceives an environment surrounding an ADV. The system applies a RL algorithm to an initial state of a planning trajectory based on the perceived environment to determine a plurality of controls for the ADV to advance to a plurality of trajectory states based on map and vehicle control information for the ADV. The system determines a reward prediction by the RL algorithm for each of the plurality of controls in view of a target destination state. The system generates a first trajectory from the trajectory states by maximizing the reward predictions to control the ADV autonomously according to the first trajectory.

Abstract: In one embodiment, simulation of an autonomous driving vehicle (ADV) includes capturing first data that includes a control command output by an autonomous vehicle controller of the ADV, and capturing second data that includes the control command being implemented at a control unit of the ADV. The control command, for example, a steering command, a braking command, or a throttle command, is implemented by the ADV to affect movement of the ADV. A latency model is determined based on comparing the first data with the second data, where the latency model defines time delay and/or amplitude difference between the first data and the second data. The latency model is applied in a virtual driving environment.

Abstract: An autonomous driving vehicle (ADV) receives instructions for a human test driver to drive the ADV in manual mode and to collect a specified amount of driving data for one or more specified driving categories. As the user drivers the ADV in manual mode, driving data corresponding to the one or more driving categories is logged. A user interface of the ADV displays the one or more driving categories that the human driver is instructed collect data upon, and a progress indicator for each of these categories as the human driving progresses. The driving data is uploaded to a server for machine learning. If the server machine learning achieves a threshold grading amount of the uploaded data to variables of a dynamic self-driving model, then the server generates an ADV self-driving model, and distributes the model to one or more ADVs that are navigated in the self-driving mode.

Abstract: A device and method for separating and recovering intestinal contents, comprising removing the impurities from the intestinal contents by means of coarse filtration and cross-flow fine filtration, followed by obtaining a concentrate by microporous membrane cross-flow filter, and collecting the target contents. The microporous membrane has a spongy porous structure, and can rapidly and effectively achieve the separation and recovery of flora from the intestinal contents by cooperation with cross-flow filtration. The separated and recovered dry flora comprises at least 10-20% of the initial wet intestinal contents, and comprises at least 1011/1 g dry flora.

Abstract: Systems and methods are disclosed for reducing second order dynamics delays in a control subsystem (e.g. throttle, braking, or steering) in an autonomous driving vehicle (ADV) and increasing control system bandwidth by accounting for time-latency in a control subsystem actuation system. A control input is received from an ADV's autonomous driving system. The control input is translated into a control command of the control subsystem of the ADV. A reference actuation output and a predicted actuation output are generated corresponding to a by-wire (“real”) actuation action for the control subsystem. A control error is determined between the reference actuation action and the by-wire actuation action. A predicted control error is determined between the predicted actuation action and the between the by-wire actuation action. Adaptive gains are determined and applied to the by-wire actuation action to generate a second by-wire actuation action.

Abstract: According to some embodiments, described herein is a system and method for handling sensor failures in autonomous driving vehicles (ADV) that is navigating in a world coordination as an absolute coordination system. When the ADV encounters a sensor failure, but still has at least one camera working properly, the sensor failure handling system can switch the ADV from navigating in the world coordination to a local coordination, in which the ADV relies camera-based obstacle detection and lane mark detection to drive safely until human dis-engagement or until the ADV is parked along a road side.

Abstract: Systems and methods for sound source detection and localization utilizing an autonomous driving vehicle (ADV) are disclosed. The method includes receiving audio data from a number of audio sensors mounted on the ADV. The audio data comprises sounds captured by the audio sensors and emitted by one or more sound sources. Based on the received audio data, the method further includes determining a number of sound source information. Each sound source information comprises a confidence score associated with an existence of a specific sound. The method further includes generating a data representation to report whether there exists the specific sound within the driving environment of the ADV. The data representation comprises the determined sound source information. The received audio data and the generated data representation are utilized to subsequently train a machine learning algorithm to recognize the specific sound source during autonomous driving of the ADV in real-time.

Abstract: In one embodiment, an open space model is generated for a system to plan trajectories for an ADV in an open space. The system perceives an environment surrounding an ADV including one or more obstacles. The system determines a target function for the open space model based on constraints for the one or more obstacles and map information. The system iteratively, performs a first quadratic programming (QP) optimization on the target function based on a first trajectory while fixing a first set of variables, and performs a second QP optimization on the target function based on a result of the first QP optimization while fixing a second set of variables. The system generates a second trajectory based on results of the first and the second QP optimizations to control the ADV autonomously according to the second trajectory.

Abstract: Disclosed are performance metrics for evaluating the accuracy of a dynamic model in predicting the trajectory of ADV when simulating the behavior of the ADV under the control commands. The performance metrics may indicate the degree of similarity between the predicted trajectory of the dynamic model and the actual trajectory of the vehicle when applied with identical control commands. The performance metrics measure deviations of the predicted trajectory of the dynamic model from the actual trajectory based on the ground truths. The performance metrics may include cumulative or mean absolute trajectory error, end-pose difference (ED), two-sigma defect rate (?2?), the Hausdirff Distance (HAU), the longest common sub-sequence error (LCSS), or dynamic time warping (DTW). The two-sigma defect rate represents the ratio of the number of points with true location error falling out of the 2? range of the predicted location error over the total number of points in the trajectory.

Abstract: Systems and methods for sound source detection and localization utilizing an autonomous driving vehicle (ADV) are disclosed. The method includes receiving audio data from a number of audio sensors mounted on the ADV. The audio data comprises sounds captured by the audio sensors and emitted by one or more sound sources. Based on the received audio data, the method further includes determining a number of sound source information. Each sound source information comprises a confidence score associated with an existence of a specific sound. The method further includes generating a data representation to report whether there exists the specific sound within the driving environment of the ADV. The data representation comprises the determined sound source information. The received audio data and the generated data representation are utilized to subsequently train a machine learning algorithm to recognize the specific sound source during autonomous driving of the ADV in real-time.

Abstract: Systems and methods for generating labelled audio data and onboard validation of the labelled audio data utilizing an autonomous driving vehicle (ADV) while the ADV is operating within a driving environment are disclosed. The method includes recording a sound emitted by an object within the driving environment of the ADV, and converting the recorded sound into audio samples. The method further includes labelling the audio samples, and refining the labelled audio samples to produce refined labelled audio data. The refined labelled audio data is utilized to subsequently train a machine learning algorithm to recognize a sound source during autonomous driving of the ADV. The method further includes generating a performance profile of the refined labelled audio data based at least on the audio samples, a position of the object, and a relative direction of the object. The position of the object and the relative direction of the object are determined by a perception system of the ADV.

Abstract: Sound signals are received by one or more microphones disposed at an ADV. The sound signals are analyzed to extract a feature of a road on which the ADV is driving. A road condition of the road is determined based on the extracted feature. A path planning and speed planning is performed to generate a trajectory based on the road condition. The ADV is controlled to drive autonomously according to the generated trajectory.

Abstract: According to various embodiments, systems, methods, and mediums for operating an autonomous driving vehicles (ADV) are described. The embodiments use a number of machine learning models to extract features individually from audio data and visual data captured by sensors mounted on the ADV, and then to fuse these extracted features to create a concatenated feature vectors. The concatenated feature vector is provided to a multiplayer perceptron (MLP) as input to generate a detection result related to the presence of an emergency vehicle in the surrounding environment. The detection result can be used by the ADV to take appropriate actions to comply with the local traffic rules.

Abstract: In one embodiment, an emergency vehicle detection system can be provided in the ADV travelling on a road to detect the presence of an emergency vehicle in a surrounding environment of the ADV using both audio data and visual data. The emergency vehicle detection system can use a trained neutral network to independently generate a detection result from the audio data, and use another trained network to independently generate another detection result from the visual data. The emergency vehicle detection system can fuse the two detection results to determine the position and moving direction of the emergency vehicle. The ADV can take appropriate actions in response to the position and moving direction of the emergency vehicle.

Abstract: Sound signals that are not audible are generated by one or more speakers disposed in the vehicle. Reflected sound signals from a driver or a passenger of the vehicle that are not audible are received by one or more microphones disposed in the vehicle. A behavior-induced acoustic pattern is detected based on the reflected ultrasound signals. The behavior-induced acoustic pattern is analyzed to recognize a behavior of the driver or the passenger of the vehicle. A response or an alert is generated according to the recognized behavior of the driver or the passenger in the vehicle.

Abstract: Systems and methods for automatic generation of labelled audio data are disclosed. The method is performed by an autonomous driving system (ADS) of an autonomous driving vehicle (ADV). The method includes recording a sound emitted by an object within a driving environment, and converting the recorded sound into audio data. The method further includes capturing at least one position of the object while the sound is being recorded. The method further includes automatically labelling the audio data using the captured at least one position of the object as an audio label, to generate labelled audio data, where the labelled audio data is utilized to subsequently train a machine learning algorithm to recognize a sound source during autonomous driving of the ADV.

Abstract: Generating control effort to control an autonomous driving vehicle (ADV) includes determining a direction (forward or reverse) in which the ADV is driving and selecting a driving model and a predictive model based upon the direction. In a forward direction, the driving model is a dynamic model, such as a “bicycle model,” and the predictive model is a look-ahead model. In a reverse direction, the driving model is a hybrid dynamic and kinematic model and the predictive model is a look-back model. Current and predicted lateral error and heading error are determined using the driving model and predictive model, respectively. A linear quadratic regulator (LQR) uses the current and predicted lateral error and heading errors to determine a first control effort An augmented control logic determines a second, additional, control effort, to determine a final control effort that is output to a control module to drive the ADV.

Abstract: This application discloses a method, apparatus and storage medium for application identification. A network device performs flow behavior feature analysis according to a flow table to obtain a plurality of services. Each service includes one IP address and one port identifier, and one application may usually include a group of services. Therefore, the network device clusters the plurality of services according to the flow table and a domain name table, to obtain a plurality of application types. Each application type includes a plurality of services. Each application type corresponds to one application. Further, the network device may determine a label corresponding to each of the plurality of application types, the label identifying an application to which a data flow belongs.

Abstract: A sensor system includes an assay chamber configured to receive a fluid sample. Dispense chemistry disposed within the assay chamber. A first electrode structure includes at least one conductive element and a second electrode structure proximate to the first electrode structure is configured to transmit an electrical signal through the fluid sample. The first electrode structure is configured to receive the electrical signal transmitted through the fluid sample and responsively generate a sense signal. The sense signal being indicative of an interaction of the fluid sample with the dispense chemistry. A controller is electrically coupled to the first electrode structure and configured to identify at least one analyte in the fluid sample based on at least the sense signal generated by the first electrode structure. The first electrode structure is embedded within a base substrate and the second electrode structure is embedded within a microfluidic cap that is coupled to the base substrate.

Abstract: In one embodiment, an autonomous driving system of an autonomous driving vehicle perceives a driving environment surrounding the autonomous driving vehicle traveling along a path, including perceiving an obstacle in the driving environment. The system detects a vertical acceleration of the autonomous driving vehicle based on sensor data obtained from a sensor on the autonomous driving vehicle. The system further calibrates the perceived obstacle based on the vertical acceleration of the autonomous driving vehicle. The system then controls the autonomous driving vehicle to navigate through the driving environment in view of the calibrated perceived obstacle.