Patents by Inventor Yongduan Song

Yongduan Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11953903
    Abstract: The present disclosure provides a neural network-based method for calibration and localization of an indoor inspection robot. The method includes the following steps: presetting positions for N label signal sources capable of transmitting radio frequency (RF) signals; computing an actual path of the robot according to numbers of signal labels received at different moments; computing positional information moved by the robot at a tth moment, and computing a predicted path at the tth moment according to the positional information; establishing an odometry error model with the neural network and training the odometry error model; and inputting the predicted path at the tth moment to a well-trained odometry error model to obtain an optimized predicted path. The present disclosure maximizes the localization accuracy for the indoor robot by minimizing the error of the odometer with the odometry calibration method.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: April 9, 2024
    Assignees: Chongqing University, Star Institute of Intelligent Systems, DB (Chongqing) Intelligent Technology Research Institute Co., LTD
    Inventors: Yongduan Song, Jie Zhang, Junfeng Lai, Huan Liu, Ziqiang Jiang, Li Huang
  • Patent number: 11804074
    Abstract: The present disclosure relates to a method for recognizing facial expressions based on adversarial elimination. First, a facial expression recognition network is built based on a deep convolutional neural network. On a natural facial expression data set, the facial expression recognition network is trained through a loss function to make facial expression features easier to distinguish. Then some key features of input images are actively eliminated by using an improved confrontation elimination method to generate a new data set to train new networks with different weight distributions and feature extraction capabilities, forcing the network to perform expression classification discrimination based on more features, which reduces the influence of interference factors such as occlusion on the network recognition accuracy rate, and improving the robustness of the facial expression recognition network.
    Type: Grant
    Filed: September 27, 2021
    Date of Patent: October 31, 2023
    Assignees: Chongqing University, University of Electronic Science and Technology of China, Dibi (Chongqing) Intelligent Technology Research Institute Co., Ltd., Star Institute of Intelligent Systems
    Inventors: Yongduan Song, Feng Yang, Rui Li, Yiwen Zhang, Haoyuan Zhong, Jian Zhang, Shengtao Pan, Siyu Li, Zhengtao Yu
  • Patent number: 11790040
    Abstract: The present disclosure provides a method for object detection and recognition based on a neural network. The method includes: adding a detection layer following three detection layers of an existing YOLOv5 network model, to construct a new YOLOv5 network model; then, training the new YOLOv5 network model by considering an overlapping area between a predicted box and a ground truth box, a center-to-center distance between the two boxes, and an aspect ratio of the two boxes; and finally, inputting a to-be-detected image into the trained new YOLOv5 network model, outputting a predicted box of an object and probability values corresponding to a class to which the object belongs, and setting a class corresponding to a maximum probability value as a predicted class of the object in the to-be-detected image. This method can quickly and effectively detect multiple classes of objects. Especially, a detection effect for small objects is more ideal.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: October 17, 2023
    Assignee: DIBI (CHONGQING) INTELLIGENT TECHNOLOGY RESEARCH INSTITUTE CO., LTD.
    Inventors: Yongduan Song, Shilei Tan, Li Huang, Ziqiang Jiang, Jian Liu, Lihui Tan
  • Patent number: 11782448
    Abstract: A method for obstacle detection and recognition for an intelligent snow sweeping robot is disclosed, comprising: 1) disposing ultrasonic sensors at a front end of the snow sweeping robot to detect distance information from an obstacle ahead; and disposing radar sensors at the front and rear of the snow sweeping robot to detect whether a creature suddenly approaches; 2) processing signals detected by each of the ultrasonic sensors and radar sensors, and calculating a forward distance of the snow sweeping robot; and 3) determining a snow cover extent of a working road, detecting a change of the distance from the obstacles, and recognizing the obstacles for conditions of an ultrasonic ranging variation ratio and a variation of the forward distance of the snow sweeping robot, a change of the signal detected by radar sensors, and a descriptive statistic of the snow cover extent within a specific time period.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: October 10, 2023
    Assignee: Chongqing University
    Inventors: Yongduan Song, Ziqiang Jiang, Shilei Tan, Junfeng Lai, Huan Liu, Li Huang, Jie Zhang, Huan Chen, Hong Long, Fang Hu, Jiangyu Wu, Qin Hu, Wenqi Li
  • Patent number: 11772264
    Abstract: The present disclosure discloses a neural network adaptive tracking control method for joint robots, which proposes two schemes: robust adaptive control and neural adaptive control, comprising the following steps: 1) establishing a joint robot system model; 2) establishing a state space expression and an error definition when taking into consideration both the drive failure and actuator saturation of the joint robot system; 3) designing a PID controller and updating algorithms of the joint robot system; and 4) using the designed PID controller and updating algorithms to realize the control of the trajectory motion of the joint robot. The present disclosure may solve the following technical problems at the same time: the drive saturation and coupling effect in the joint system, processing parameter uncertainty and non-parametric uncertainty, execution failure handling during the system operation, compensation for non-vanishing interference, and the like.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: October 3, 2023
    Assignee: Dibi (Chongqing) Intelligent Technology Research Institute Co., Ltd.
    Inventors: Yongduan Song, Huan Liu, Junfeng Lai, Ziqiang Jiang, Jie Zhang, Huan Chen, Li Huang, Congyi Zhang, Yingrui Chen, Yating Yang, Chunxu Ren, Han Bao, Kuilong Yang, Ge Song, Bowen Zhang, Hong Long
  • Patent number: 11747826
    Abstract: The present disclosure discloses a method for route optimization based on dynamic window and redundant node filtering, comprising using an existing raster map data set to determine the coordinate information of a starting position and a destination position of movement, and to mark a destination node and an obstacle node in the raster map; using A* algorithm to plan a global route; globally optimizing the global route planned by A* algorithm, and filtering redundant nodes out; combining a dynamic window algorithm to perform the local optimization section by section on the optimized global route so as to obtain a final global route. According to the present disclosure, the combination of algorithms reduces a single movement duration of a mobile robot and improves the smoothness of the movement route curve. At the same time, the problems of the robot occurring on the route during the static driving are alleviated.
    Type: Grant
    Filed: August 16, 2021
    Date of Patent: September 5, 2023
    Assignees: CHONGQING UNIVERSITY, STAR INSTITUTE OF INTELLIGENT SYSTEMS, DIBI (CHONGQING) INTELLIGENT TECHNOLOGY RESEARCH INSTITUTE CO., LTD.
    Inventors: Yongduan Song, Congyi Zhang, Lihui Tan, Junfeng Lai, Saiyu Wang, Yankai Zhang
  • Patent number: 11739484
    Abstract: A snow shovel structure of a snow plow robot. The snow shovel structure includes a housing where a snow shovel mechanism is. The snow shovel mechanism extends outside the housing and includes a first motor fixed on a top of the housing. The first motor is fixedly connected with a telescopic rod through an output shaft. A second motor is further provided on a top portion of an inner chamber of the housing, and a horizontal plate is fixedly arranged on a side wall of the inner chamber of the housing.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: August 29, 2023
    Assignee: Dibi (Chongqing) Intelligent Technology Research Institute Co., Ltd.
    Inventors: Yongduan Song, Hong Long, Fang Hu, Jiangyu Wu, Ziqiang Jiang, Junfeng Lai
  • Patent number: 11635324
    Abstract: The present disclosure discloses a method for quick weighing of loose and small packages of traditional Chinese medicine (TCM), comprising: 1) establishing an equivalent physical model of a weighing system for loose and small packages, and, through Laplace transformation and Z transformation, obtaining a formula of the mass M of medicine packages to be weighed; 2) calculating a1, a2, b1 and b2 on the basis of a vector prediction error; 3) according to a1, a2, b1, and b2 obtained and the formula of the mass of medicine packages to be weighed, obtaining the mass of the loose and small packages of TCM that are weighed. According to the method, the scalar prediction error is expanded into the vector prediction error based on the traditional method so as to construct a new identification model based on the vector prediction error, and as a result the utilization efficiency of prediction error turns higher.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: April 25, 2023
    Assignee: CHONGQING UNIVERSITY
    Inventors: Yongduan Song, Zhixi Shen, Haifeng Liu, Jie Lei
  • Publication number: 20230070427
    Abstract: The present disclosure provides a student performance evaluation method and system based on artificial intelligence (AI) identification data, and relates to the field of intelligent education. A lightweight network model suitable for student performance evaluation takes the AI identification data as an input and evaluation results as an output. A training data generation algorithm is provided, and multidimensional AI identification data and labels are uniformly processed into training data suitable for the network model through the above algorithm, which can solve the problems that dimensions between any AI identification data and various labels are not uniform, and original data cannot meet training of a multidimensional and cross-time prediction model. A simulated data generation algorithm and a simulated label generation algorithm are provided, and simulated training data is generated using these algorithms in conjunction with the training data generation algorithm.
    Type: Application
    Filed: February 25, 2022
    Publication date: March 9, 2023
    Inventors: YONGDUAN SONG, FENG YANG, RUI LI, HONGYU XIA, QIN CHEN, SHICHUN WANG, LIANGJIE LI, HAOYUAN ZHONG
  • Publication number: 20230062408
    Abstract: The invention discloses an adaptive path planning method based on neutral networks trained by the evolutional algorithms, the neutral network training method comprises input and output of the data acquired by the mobile sensors installed on the mobile robots as the neutral networks, and training and optimization of the recurrent neutral networks based on the evolutional algorithms; the path planning method refers to the application of the trained neutral networks to the path planning of the mobile robot, the invention effectively improves local quick search capability and global search capability of the algorithms by applying the evolutional algorithms to the optimization of the recurrent neutral networks, so that the robot can plan a rational path in a dense and uncertain environment.
    Type: Application
    Filed: October 18, 2021
    Publication date: March 2, 2023
    Inventors: Yongduan SONG, Lihui TAN, Lei FANG, Shilei TAN, Shuai WANG
  • Patent number: 11585843
    Abstract: A detection circuit for open, close and suspension states of a high and low level effective switch in a vehicle. The circuit includes an optocoupler circuit module, a low-level active path module, a high-level active path module, a filtering and debouncing module, a transient suppression module, and a wiring terminal. The optocoupler circuit module is connected to the low-level active path module, the high-level active path module and the low-level active path module are connected in parallel to the filtering and debouncing module, and the filtering and debouncing module is connected to the transient suppression module, and then connected to the external high-level active switch or low-level active switch through the wiring terminal. Whether it is a high-level active switch or a low-level active switch, the detection circuit can distinguish whether the switch is in the closed or suspended state, and the strong and weak voltages are isolated.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: February 21, 2023
    Assignees: CHONGQING UNIVERSITY, STAR INSTITUTE OF INTELLIGENT SYSTEMS, DB (CHONGQING) INTELLIGENT TECHNOLOGY RESEARCH INSTITUTE CO., LTD., Chongqing Yingdi Industry (Group) Co., Ltd.
    Inventors: Yongduan Song, Shuaicheng Hou, Jiawei Chen, Mi Fang
  • Patent number: 11580979
    Abstract: In some embodiments, methods and systems for pushing audiovisual playlists based on a text-attentional convolutional neural network include a local voice interactive terminal, a dialog system server and a playlist recommendation engine, where the dialog system server and the playlist recommendation engine are respectively connected to the local voice interactive terminal. In some embodiments, the local voice interactive terminal includes a microphone array, a host computer connected to the microphone array, and a voice synthesis chip board connected to the microphone array. In some embodiments, the playlist recommendation engine obtains rating data based on a rating predictor constructed by the neural network; the host computer parses the data into recommended playlist information; and the voice terminal synthesizes the results and pushes them to a user in the form of voice.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: February 14, 2023
    Assignee: Chongqing University
    Inventors: Yongduan Song, Junfeng Lai, Xin Zhou
  • Publication number: 20230025527
    Abstract: Embodiments of the present disclosure provide a quantitative method and system for attention based on a line-of-sight estimation neural network, which improves the stability and training efficiency of the line-of-sight estimation neural network. A few-sample learning method is applied to training of the line-of-sight estimation neural network, which improves generalization performance of the line-of-sight estimation neural network. A nonlinear division method for small intervals of angles of the line of sight is provided, which reduces an estimation error of the line-of-sight estimation neural network. Eye opening and closing detection is added to avoid the line-of-sight estimation error caused by an eye closing state. A method for solving a landing point of the line of sight is provided, which has high environmental adaptability and can be quickly used in actual deployment.
    Type: Application
    Filed: February 25, 2022
    Publication date: January 26, 2023
    Inventors: YONGDUAN SONG, FENG YANG, RUI LI, QIN CHEN, SHICHUN WANG, HONGYU XIA, CAISHI HE, SHIHAO PU
  • Publication number: 20220403612
    Abstract: Disclosed is a snow shoveling and snow discharging assembly of a snow sweeping robot. The snow shoveling and snow discharging assembly comprises a snow stirring structure, a snow feeding structure and a snow raising structure. Stirring cutters in the snow stirring mechanism are driven by a stirring cutter shaft to stir bottom area snow into a snow feeding pipe of the snow feeding structure, an air blower in the snow feeding structure blows accumulated snow into a snow raising pipe of the snow raising structure through a connecting pipe, the snow raising pipe can be driven by a steering motor to rotate by a certain angle to control the snow raising direction, and a second electric push rod acts to control pitching of the guide part, so that the height of snow during snow raising is controlled.
    Type: Application
    Filed: August 9, 2021
    Publication date: December 22, 2022
    Applicants: Chongqing University, Star Institute of Intelligent Systems, Dibi (Chongqing) Intelligent Technology Research Institute Co., Ltd.
    Inventors: Yongduan Song, Hong Long, Junfeng Lai, Fang Hu, Ke'er Chen
  • Publication number: 20220404836
    Abstract: The present disclosure discloses a method for route optimization based on dynamic window and redundant node filtering, comprising using an existing raster map data set to determine the coordinate information of a starting position and a destination position of movement, and to mark a destination node and an obstacle node in the raster map; using A* algorithm to plan a global route; globally optimizing the global route planned by A* algorithm, and filtering redundant nodes out; combining a dynamic window algorithm to perform the local optimization section by section on the optimized global route so as to obtain a final global route. According to the present disclosure, the combination of algorithms reduces a single movement duration of a mobile robot and improves the smoothness of the movement route curve. At the same time, the problems of the robot occurring on the route during the static driving are alleviated.
    Type: Application
    Filed: August 16, 2021
    Publication date: December 22, 2022
    Inventors: Yongduan Song, Congyi Zhang, Lihui Tan, Junfeng Lai, Saiyu Wang, Yankai Zhang
  • Publication number: 20220350329
    Abstract: The present disclosure provides a neural network-based method for calibration and localization of an indoor inspection robot. The method includes the following steps: presetting positions for N label signal sources capable of transmitting radio frequency (RF) signals; computing an actual path of the robot according to numbers of signal labels received at different moments; computing positional information moved by the robot at a tth moment, and computing a predicted path at the tth moment according to the positional information; establishing an odometry error model with the neural network and training the odometry error model; and inputting the predicted path at the tth moment to a well-trained odometry error model to obtain an optimized predicted path. The present disclosure maximizes the localization accuracy for the indoor robot by minimizing the error of the odometer with the odometry calibration method.
    Type: Application
    Filed: January 31, 2022
    Publication date: November 3, 2022
    Inventors: YONGDUAN SONG, JIE ZHANG, JUNFENG LAI, HUAN LIU, ZIQIANG JIANG, LI HUANG
  • Publication number: 20220351043
    Abstract: The present disclosure discloses an adaptive high-precision compression method and system based on a convolutional neural network model, and belongs to the fields of artificial intelligence, computer vision, and image processing. According to the method of the present disclosure, coarse-grained pruning is performed on a neural network model by using a differential evolution algorithm first, and the coarse-grained space is quickly searched through an entropy importance criterion and an objective function with good guidance to obtain a near-optimal neural network structure. Then fine-grained search space is built on the basis of an optimal individual obtained from the coarse-grained search, and fine-grained pruning is performed on the neural network model by a differential evolution algorithm to obtain a network model with an optimal structure. Finally, the performance of the optimal model is restored by using a multi-teacher multi-step knowledge distillation network to reach the precision of an original model.
    Type: Application
    Filed: September 27, 2021
    Publication date: November 3, 2022
    Applicants: Chongqing University, University of Electronic Science and Technology of China, Dibi (Chongqing) Intelligent Technology Research Institute Co., Ltd., Star Institute of Intelligent Systems
    Inventors: Yongduan Song, Feng Yang, Rui Li, Shengtao Pan, Siyu Li, Yiwen Zhang, Jian Zhang, Zhengtao Yu, Shichun Wang
  • Publication number: 20220341109
    Abstract: A snow shovel structure of a snow plow robot is provided. The snow shovel structure includes a housing where a snow shovel mechanism is. The snow shovel mechanism extends outside the housing and includes a first motor fixed on a top of the housing. The first motor is fixedly connected with a telescopic rod through an output shaft. A second motor is further provided on a top portion of an inner chamber of the housing, and a horizontal plate is fixedly arranged on a side wall of the inner chamber of the housing.
    Type: Application
    Filed: July 7, 2021
    Publication date: October 27, 2022
    Inventors: Yongduan Song, Hong Long, Fang Hu, Jiangyu Wu, Ziqiang Jiang, Junfeng Lai
  • Publication number: 20220327308
    Abstract: The present disclosure relates to a method for recognizing facial expressions based on adversarial elimination. First, a facial expression recognition network is built based on a deep convolutional neural network. On a natural facial expression data set, the facial expression recognition network is trained through a loss function to make facial expression features easier to distinguish. Then some key features of input images are actively eliminated by using an improved confrontation elimination method to generate a new data set to train new networks with different weight distributions and feature extraction capabilities, forcing the network to perform expression classification discrimination based on more features, which reduces the influence of interference factors such as occlusion on the network recognition accuracy rate, and improving the robustness of the facial expression recognition network.
    Type: Application
    Filed: September 27, 2021
    Publication date: October 13, 2022
    Applicants: Chongqing University, University of Electronic Science and Technology of China, Dibi (Chongqing) Intelligent Technology Research Institute Co., Ltd., Star Institute of Intelligent Systems
    Inventors: Yongduan Song, Feng Yang, Rui Li, Yiwen Zhang, Haoyuan Zhong, Jian Zhang, Shengtao Pan, Siyu Li, Zhengtao Yu
  • Publication number: 20220315243
    Abstract: The present disclosure relates to a method for identification and recognition of an aircraft take-off and landing runway based on a PSPNet network, wherein the method: adopts a residual network ResNet and a lightweight deep neural network MobileNetV2 as the two backbone feature-extraction networks to enhance that feature extraction; at the same time adjusts an original four-layered pyramid pooling module into five layered, with each layer being respectively sized by 9×9, 6×6, 3×3, 2×2, 1×1; uses a finite self-made image about the aircraft take-off and landing terrain for training; and labels and extracts the aircraft take-off and landing runway in the aircraft take-off and landing terrain image. The method effectively combines ResNet and MobileNetV2, and improves the detection accuracy of the aircraft take-off and landing runway in comparison with the prior art.
    Type: Application
    Filed: May 21, 2021
    Publication date: October 6, 2022
    Applicant: CHONGQING UNIVERSITY
    Inventors: Yongduan SONG, Fang HU, Ziqiang JIANG