Abstract: A method of determining a vehicle travel trajectory, an electronic device, a storage medium and a vehicle, which relate to a field of an artificial intelligence technology, in particular to a field of autonomous driving and intelligent transportation. A specific implementation solution includes: determining an initial path information for a vehicle; optimizing the initial path information to generate a target optimized path information; determining an optimized mapping relationship for velocity according to the target optimized path information and a first energy consumption constraint parameter; and determining an optimized trajectory for the vehicle according to the target optimized path information and the optimized mapping relationship for velocity.

Abstract: Presented herein are embodiments of a two-stage methodology that integrates data-driven imitation learning and model-based trajectory optimization to generate optimal trajectories for autonomous excavators. In one or more embodiments, a deep neural network using demonstration data to mimic the operation patterns of human experts under various terrain states, including their geometry shape and material type. A stochastic trajectory optimization methodology is used to improve the trajectory generated by the neural network to ensure kinematics feasibility, improve smoothness, satisfy hard constraints, and achieve desired excavation volumes. Embodiments were tested on a Franka robot arm equipped with a bucket end-effector. Embodiments were also evaluated on different material types, such as sand and rigid blocks. Experimental results showed that embodiments of the two-stage methodology that comprises combining expert knowledge and model optimization increased the excavation weights by up to 24.

Abstract: The present application discloses an adaptive equalization method and apparatus for a probabilistic shaping system, and a readable storage medium. The adaptive equalization method may include: determining a tap length of a filter, and setting an initial coefficient of an equalizer; performing butterfly filtering on two polarized input signals according to the coefficient of the equalizer to obtain two polarized output signals; determining an error signal according to the two polarized output signals, wherein the error signal is a sum of a first error which is a minimum value of differences between a target convergence radius and squares of modulus of the output signals, and a second error which is a difference between an average value of squares of modulus of a plurality of output signals and a target average power; and adjusting the coefficient of the equalizer according to the error signal.

Abstract: Provided are a vehicle attitude estimation method, an electronic device and a storage medium, relates to a technical field of data processing, and in particular to fields of automatic driving, intelligent transportation, Internet of Things, big data and the like. A specific implementation solution includes: obtaining first target data, based on point cloud data of a vehicle, the first target data being capable of constituting a target surface of the vehicle; performing attitude estimation on a target body for surrounding the vehicle, based on the first target data, to obtain an estimation result; and estimating an attitude of the vehicle, based on the estimation result. According to the implementation solution, precise or accurate estimation of the attitude of the vehicle may be achieved.

Abstract: Embodiments of a methodology for controlling a vehicle includes (i) determining a first command signal for a first locomotion component of a vehicle and a second command signal for a second locomotion component of the vehicle, (ii) based upon a terrain classification, selecting a first pre-trained model for the first locomotion component and a second pre-trained model for the second locomotion component, (iii) determining a first signal for the first locomotion component of the vehicle by utilizing the first command signal and the second command signal as input to the first pre-trained model and a second signal for the second locomotion component of the vehicle by utilizing the first command signal and the second command signal as input to the second pre-trained model, and (iv) controlling the first locomotion component of the vehicle using the first signal and the second locomotion component of the vehicle using the second signal.

Abstract: Provided are a depth information processing method, an apparatus, and a storage medium, which relate to the field of image processing and, in particular, to computer vision, deep learning and autonomous driving. A specific implementation includes: determining intermediate depth information of a target scene according to sparse depth information of the target scene by a sub-model unit in a depth information supplementing model; and using intermediate depth information determined by a tail sub-model unit in the depth information supplementing model as dense depth information of the target scene.

Abstract: A speed determination method, an electronic device and a computer storage medium are provided, relates to the field of computer technology, and may be applied to the field of artificial intelligence, especially the field of automated driving. The method includes: determining an expected speed direction of a controlled point of a first controlled target according to an actual location of the controlled point of the first controlled target and a preset trajectory of the controlled point of the first controlled target, wherein the first controlled target is one of a plurality of controlled targets having a kinematic relationship; and determining a target speed of at least one controlled target of the plurality of controlled targets according to the expected speed direction of the controlled point of the first controlled target and the kinematic relationship.

Abstract: Embodiments of a learning-based excavation planning method are disclosed for excavating rigid objects in clutter, which is challenging due to high variance of geometric and physical properties of objects, and large resistive force during the excavation. A convolutional neural network is utilized to predict a probability of excavation success. Embodiments of a sampling-based optimization method are disclosed for planning high-quality excavation trajectories by leveraging the learned prediction model. To reduce simulation-to-real gap for excavation learning, voxel-based representations of an excavation scene are used. Excavation experiments were performed in both simulation and real world to evaluate the learning-based excavation planners. Experimental results show that embodiments of the disclosed method may plan high-quality excavations for rigid objects in clutter and outperform baseline methods by large margins.

Abstract: Presented herein are embodiments of a two-stage methodology that integrates data-driven imitation learning and model-based trajectory optimization to generate optimal trajectories for autonomous excavators. In one or more embodiments, a deep neural network using demonstration data to mimic the operation patterns of human experts under various terrain states, including their geometry shape and material type. A stochastic trajectory optimization methodology is used to improve the trajectory generated by the neural network to ensure kinematics feasibility, improve smoothness, satisfy hard constraints, and achieve desired excavation volumes. Embodiments were tested on a Franka robot arm equipped with a bucket end-effector. Embodiments were also evaluated on different material types, such as sand and rigid blocks. Experimental results showed that embodiments of the two-stage methodology that comprises combining expert knowledge and model optimization increased the excavation weights by up to 24.

Abstract: The present application provides a model training method and apparatus, and a prediction method and apparatus, and it relates to fields of artificial intelligence, deep learning, image processing, and autonomous driving. The model training method includes: inputting a first sample image of sample images into a depth information prediction model, and acquiring depth information of the first sample image; acquiring inter-image posture information based on a second sample image of the sample images and the first sample image; acquiring a projection image corresponding to the first sample image, at least according to the inter-image posture information and the depth information; and acquiring a loss function by determining a function for calculating a similarity between the second sample image and the projection image, and training the depth information prediction model using the loss function.

Abstract: A radar point cloud data processing method and device, an apparatus, and storage medium are provided, which are related to technical fields of radar point cloud, automatic driving, and deep learning. An implementation includes: determining a target location area where a target object is located by utilizing a target detection box in the radar point cloud data; removing each point of the target object in the target location area from the radar point cloud data; and adding an object model to the target location area. By applying embodiments of the present disclosure, richer radar point cloud data may be obtained by removing the target object from the radar point cloud data and adding the needed three-dimensional model to the target location area in the radar point cloud data.

Abstract: The present disclosure discloses an engineering machinery equipment, and a method, system, and storage medium for safety control thereof, and relates to the field of artificial intelligence, automatic control, and engineering machinery technologies. A method can include: acquiring spatial sensing data of a work area; performing obstacle detection based on the spatial sensing data to determine a position of an obstacle within the work area; determining a safe working range of a mechanical structural component of the engineering machinery equipment based on the position of the obstacle within the work area; and controlling a working range of the mechanical structural component of the engineering machinery equipment based on the safe working range.

Abstract: Provided are a vehicle attitude estimation method, an electronic device and a storage medium, relates to a technical field of data processing, and in particular to fields of automatic driving, intelligent transportation, Internet of Things, big data and the like. A specific implementation solution includes: obtaining first target data, based on point cloud data of a vehicle, the first target data being capable of constituting a target surface of the vehicle; performing attitude estimation on a target body for surrounding the vehicle, based on the first target data, to obtain an estimation result; and estimating an attitude of the vehicle, based on the estimation result. According to the implementation solution, precise or accurate estimation of the attitude of the vehicle may be achieved.

Abstract: A scalable solution to robot behavioral navigation following natural language instructions is presented. An example of the solution includes: receiving, by a pre-trained sequential prediction model, a navigation graph of the task environment, instructions in natural language and an initial location of the robot in the navigation graph, wherein the navigation graph comprises nodes indicating locations in the task environment, coordinates of the nodes, and edges indicating connectivity between the locations; and predicting sequentially, by the pre-trained sequential prediction model, a sequence of single-step behaviors executable by the robot to navigate the robot from the initial location to a destination.

Abstract: A speed determination method, an electronic device and a computer storage medium are provided, relates to the field of computer technology, and may be applied to the field of artificial intelligence, especially the field of automated driving. The method includes: determining an expected speed direction of a controlled point of a first controlled target according to an actual location of the controlled point of the first controlled target and a preset trajectory of the controlled point of the first controlled target, wherein the first controlled target is one of a plurality of controlled targets having a kinematic relationship; and determining a target speed of at least one controlled target of the plurality of controlled targets according to the expected speed direction of the controlled point of the first controlled target and the kinematic relationship.

Abstract: The present disclosure discloses an engineering machinery equipment, and a method, system, and storage medium for operation trajectory planning thereof, and relates to the field of artificial intelligence, automatic control, and engineering machinery technologies.

Abstract: Presented herein are embodiments of a vision-based object perception system for activity analysis, safety monitoring, or both. Embodiments of the perception subsystem detect multi-class objects (e.g., construction machines and humans) in real-time while estimating the poses and actions of the detected objects. Safety monitoring embodiments and object activity analysis embodiments may be based on the perception result. To evaluate the performance of embodiments, a dataset was collected including multi-class of objects in different lighting conditions with human annotations. Experimental results show that the proposed action recognition approach outperforms the state-of-the-art approaches on top-1 accuracy by about 5.18%.

Abstract: Autonomous excavator has developed rapidly in recent years because of a shortage of labor and hazardous working environments for operating excavators. Presented herein are embodiments of a novel hierarchical planning system for autonomous machines, such as excavators. In one or more embodiments, the overall planning system comprises a high-level task planner for task division and base movement planning, and general sub-task planners with motion primitives, which include both arm and base movement in the case of an excavator. Using embodiments of the system architecture, experiments were performed for the trench and pile removal tasks in the real world and for the large-scale material loading tasks in a simulation environment. The results show that the system architecture embodiments and planner method embodiments generate effective task and motion plans that perform well in autonomous excavation.

Abstract: Presented herein are novel approaches to synthesize video of the speech from text. In a training phase, embodiments build a phoneme-pose dictionary and train a generative neural network model using a generative adversarial network (GAN) to generate video from interpolated phoneme poses. In deployment, the trained generative neural network in conjunction with the phoneme-pose dictionary convert an input text into a video of a person speaking the words of the input text. Compared to audio-driven video generation approaches, the embodiments herein have a number of advantages: 1) they only need a fraction of the training data used by an audio-driven approach; 2) they are more flexible and not subject to vulnerability due to speaker variation; and 3) they significantly reduce the preprocessing, training, and inference times.

Abstract: Described herein are systems and methods for inverse reinforcement learning to leverage the benefits of model-based optimization method and model-free learning method. Embodiments of a framework combining human behavior model with model predictive control are presented. The framework takes advantage of feature identification capability of a neural network to determine the reward function of model predictive control. Furthermore, embodiments of the present approach are implemented to solve the practical autonomous driving longitudinal control problem with simultaneous preference on safe execution and passenger comfort.