Patents Assigned to CENTRAL CHINA NORMAL UNIVERSITY
  • Patent number: 11967175
    Abstract: Provided are a facial expression recognition method and system combined with an attention mechanism. The method comprises: detecting faces comprised in each video frame in a video sequence, and extracting corresponding facial ROIs, so as to obtain facial pictures in each video frame; aligning the facial pictures in each video frame on the basis of location information of facial feature points of the facial pictures; inputting the aligned facial pictures into a residual neural network, and extracting spatial features of facial expressions corresponding to the facial pictures; inputting the spatial features of the facial expressions into a hybrid attention module to acquire fused features of the facial expressions; inputting the fused features of the facial expressions into a gated recurrent unit, and extracting temporal features of the facial expressions; and inputting the temporal features of the facial expressions into a fully connected layer, and classifying and recognizing the facial expressions.
    Type: Grant
    Filed: May 23, 2023
    Date of Patent: April 23, 2024
    Assignee: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Sannyuya Liu, Zongkai Yang, Xiaoliang Zhu, Zhicheng Dai, Liang Zhao
  • Publication number: 20240081705
    Abstract: The present disclosure provides a non-contact fatigue detection system and method based on rPPG. The system and method adopt multi-thread synchronous communication for real-time acquisition and processing of rPPG signal, enabling fatigue status detection. In this setup, the first thread handles real-time rPPG data capture, storage and concatenation, while the second thread conducts real-time analysis and fatigue detection of rPPG data. Through a combination of skin detection and LUV color space conversion, rPPG raw signal extraction is achieved, effectively eliminating interference from internal and external environmental facial noise; Subsequently, an adaptive multi-stage filtering process enhances the signal-to-noise ratio, and a multi-dimensional fusion CNN model ensures accurate detection of respiration and heart rate.
    Type: Application
    Filed: November 16, 2023
    Publication date: March 14, 2024
    Applicant: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Liang ZHAO, Sannyuya LIU, Zongkai YANG, Xiaoliang ZHU, Jianwen SUN, Qing LI, Zhicheng DAI
  • Patent number: 11908344
    Abstract: This application relates to teaching applications of virtual reality technology, and provides a three-dimensional (3D) integrated teaching field system based on a flipped platform and a method for operating the same. The system includes a device deployment module, a teaching resource matching module, an acquisition and processing module and an edge computing module. The method includes spatial division of the 3D comprehensive teaching field system in an offline classroom, device deployment, edge computing, holographic display, data acquisition, motion positioning, and construction of a teaching interactive environment.
    Type: Grant
    Filed: October 10, 2023
    Date of Patent: February 20, 2024
    Assignee: Central China Normal University
    Inventors: Zongkai Yang, Zheng Zhong, Di Wu, Xu Chen
  • Publication number: 20240023884
    Abstract: Disclosed are a non-contact fatigue detection method and system. The method comprises: sending a millimeter-wave (mmWave) radar signal to a person being detected, receiving an echo signal reflected from the person, and determining a time-frequency domain feature, a non-linear feature and a time-series feature of a vital sign signal; acquiring a facial video image of the person, and performing facial detection and alignment on the basis of the facial video image, for extracting a time domain feature and a spatial domain feature of the person's face; fusing the determined vital sign signal with the time domain feature and the spatial domain feature of the person's face, for obtaining a fused feature; and determining whether the person is in a fatigued state by the fused feature. By fusing the two detection techniques, the method effectively suppressing the interference of subjective and objective factors, and improving the accuracy of fatigue detection.
    Type: Application
    Filed: June 23, 2021
    Publication date: January 25, 2024
    Applicant: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Sannyuya LIU, Zongkai YANG, Liang ZHAO, Xiaoliang ZHU, Zhicheng DAI
  • Publication number: 20240000345
    Abstract: Disclosed are a millimeter-wave (mmWave) radar-based non-contact identity recognition method and system. The method comprises: emitting an mmWave radar signal to a user to be recognized, and receiving an echo signal reflected from the user; performing clutter suppression and echo selection on the echo signal, and extracting a heartbeat signal; segmenting the heartbeat signal beat by beat, and determining its corresponding beat features; and comparing the beat features of the user with the beat feature sets of a standard user group; if the beat features of the user matches one of the beat feature set in the standard user group, the identity recognition being successful; otherwise, being not successful. According to the method, the use of a heartbeat signal for identity recognition has high reliability, and the use of an mmWave radar technology for non-contact identity recognition has high flexibility and accuracy.
    Type: Application
    Filed: April 22, 2021
    Publication date: January 4, 2024
    Applicant: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Zongkai YANG, Sannyuya LIU, Liang ZHAO, Zhicheng DAI, Jianwen SUN, Qing LI
  • Publication number: 20230334862
    Abstract: The present invention discloses construction method and system of a descriptive model of classroom teaching behavior events. The construction method includes steps as the followings: acquiring classroom teaching video data to be trained; dividing the classroom teaching video data to be trained into multiple events according to utterances of a teacher by using a voice activity detection technology; and performing multi-modal recognition on all events by using multiple artificial intelligence technologies to divide the events into sub-events in multiple dimensions, establishing an event descriptive model according to the sub-events, and describing various teaching behavior events of the teacher in a classroom. The present invention divides a classroom video according to voice, which can ensure the completeness of the teacher's non-verbal behavior in each event to the greatest extent.
    Type: Application
    Filed: September 7, 2021
    Publication date: October 19, 2023
    Applicant: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Sannyuya LIU, Zengzhao CHEN, Zhicheng DAI, Shengming WANG, Xiuling HE, Baolin YI
  • Publication number: 20230298382
    Abstract: Provided are a facial expression recognition method and system combined with an attention mechanism. The method comprises: detecting faces comprised in each video frame in a video sequence, and extracting corresponding facial ROIs, so as to obtain facial pictures in each video frame; aligning the facial pictures in each video frame on the basis of location information of facial feature points of the facial pictures; inputting the aligned facial pictures into a residual neural network, and extracting spatial features of facial expressions corresponding to the facial pictures; inputting the spatial features of the facial expressions into a hybrid attention module to acquire fused features of the facial expressions; inputting the fused features of the facial expressions into a gated recurrent unit, and extracting temporal features of the facial expressions; and inputting the temporal features of the facial expressions into a fully connected layer, and classifying and recognizing the facial expressions.
    Type: Application
    Filed: May 23, 2023
    Publication date: September 21, 2023
    Applicant: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Sannyuya LIU, Zongkai YANG, Xiaoliang ZHU, Zhicheng DAI, Liang ZHAO
  • Publication number: 20230290118
    Abstract: The present disclosure belongs to the technical field of artificial intelligence, and discloses an automatic classification method and system of teaching videos based on different presentation forms, which with three convolutional neural network models, may accurately locate the information required for teaching video classification by two self-trained YOLOV4 target detection neural network models and human body key point detection technology, solves the problem that the background and character features of teaching videos do not change significantly, and improves the accuracy of feature extraction. The structure of the self-built convolutional neural network models is suitable for classification of Interview type and Head type teaching videos. The depth of the network is just appropriate compared with several classical video classification algorithms, which reduces the energy consumption of computer hardware.
    Type: Application
    Filed: December 30, 2022
    Publication date: September 14, 2023
    Applicant: Central China Normal University
    Inventors: Qiusha MIN, Ziyi LI
  • Patent number: 11727915
    Abstract: Disclosed are a method and a terminal for generating simulated voices of virtual teachers. Real voice samples of teachers are collected and converted into text sequences, and a text emotion polarity training set and a text tone training set are constructed according to the text sequences; a lexical item emotion model is constructed based on lexical items in the text sequences and is trained by using the emotion polarity training set, and word vectors, an emotion polarity vector, and a weight parameter are obtained by training; and the similarity between the word vector and the emotion polarity vector is calculated, and emotion features are extracted according to a similarity calculation result, a conditional vocoder is constructed according to the voice styles and emotion features to generate new voices with emotion changes. The method and the terminal contribute to satisfying the application requirements of high-quality virtual teachers.
    Type: Grant
    Filed: January 18, 2023
    Date of Patent: August 15, 2023
    Assignees: Fujian TQ Digital Inc., Central China Normal University
    Inventors: Dejian Liu, Zhenhua Fang, Zheng Zhong, Jian Xu
  • Patent number: 11568012
    Abstract: The disclosure discloses a method for analyzing educational big data on the basis of maps. The method includes acquiring educational resource data and storing the educational resource data into databases according to certain data structures; constructing theme map layers for each analysis theme, classifying and indexing data according to the analysis themes, and superimposing the theme map layers onto base maps to form data maps; analyzing data of the theme map layers according to the analysis themes and acquiring theme analysis results; extracting the data of the multiple theme map layers in target regions, fusing the data and acquiring region analysis results; acquiring learning preference of users; combining the learning preference of the users according to content of user requests and searching the region analysis results in response to the user requests. The disclosure further discloses a system for analyzing the educational big data on the basis of the maps.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: January 31, 2023
    Assignee: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Zongkai Yang, Sannyuya Liu, Dongbo Zhou, Jianwen Sun, Jiangbo Shu, Hao Li
  • Patent number: 11410570
    Abstract: A method for operating a comprehensive three-dimensional teaching field, including: collecting, by a sensor, a depth data of a real teaching space, point cloud data of a teacher and voice data of the teacher; performing calculation and caching of an architecture for data storage, transmission and rendering of a virtual teaching space based on edge cloud; building a database model of the virtual teaching space by using a R-tree spatial index structure to realize distributed data storage; generating a virtual avatar model updating in real time by positioning and tracking an action of a user; displaying an image of the virtual teaching space on terminals of the teacher and a student through encoding, uploading, 5G rendering and decoding by using a 5G link.
    Type: Grant
    Filed: January 13, 2022
    Date of Patent: August 9, 2022
    Assignee: Central China Normal University
    Inventors: Zongkai Yang, Zheng Zhong, Di Wu, Xu Chen
  • Publication number: 20220177477
    Abstract: The present invention relates to the field of biomedicine, and discloses a pyrazolopyrimidine compound, a pharmaceutical composition, and an application therefor, the oxygen-containing substituted pyrazolopyrimidine compound having the structure shown in formula (I). The oxygen-containing substituted pyrazolopyrimidine compound having the structure shown in formula (I) provided in the present invention or a pharmaceutically acceptable salt, a stereoisomer, a geometric isomer, a tautomer, a nitrogen oxide, a hydrate, a solvate, a metabolite, or a prodrug thereof demonstrate excellent inhibitory activity against TRK kinase, and demonstrate good anti-tumour activity at the animal level.
    Type: Application
    Filed: March 19, 2020
    Publication date: June 9, 2022
    Applicant: Central China Normal University
    Inventors: Guangfu Yang, Wei Huang, Linsheng Zhuo, Hongchuang Xu, Mingshu Wang
  • Patent number: 11282404
    Abstract: A method for generating sense of reality of a virtual object in a teaching scene includes perception of a teaching space, generation of sense of reality of a virtual object and generation of real effect of dynamic interaction. The method is specifically performed through steps of collecting depth data of the teaching space; perceiving changes of a scene object in a field of view in real time; collecting a light intensity in the teaching scene to realize a virtual-real fused lighting effect; generating a shadow effect of the virtual object in real time by using ShadowMap; and guiding a teacher to use a multi-modal algorithm to complete a real-time interaction with the virtual object by setting interactive prompts of a sight target and a virtual hand.
    Type: Grant
    Filed: August 9, 2021
    Date of Patent: March 22, 2022
    Assignee: Central China Normal University
    Inventors: Zongkai Yang, Zheng Zhong, Di Wu, Ke Wu
  • Publication number: 20210345607
    Abstract: In the technical field of plant protection, a microemulsion formulation containing clacyfos herbicide, a preparation method therefor, and the use thereof are disclosed. The microemulsion formulation comprises clacyfos, an environment-friendly solvent and a surfactant. The microemulsion formulation has a particle radius of 0.01 ?m to 0.1 ?m and a pH value of 5 to 7. The microemulsion formulation containing clacyfos herbicide has good dispersibility, small particle size and strong permeability, being a novel green and environment-friendly pesticide formulation.
    Type: Application
    Filed: September 2, 2019
    Publication date: November 11, 2021
    Applicant: Central China Normal University
    Inventors: Hongwu He, Xiaosong Tan, Hao Peng
  • Patent number: 11164289
    Abstract: A method for generating a high-precision and microscopic virtual learning resource includes acquisition of high-definition specimen images, generation of a 3D model of a surface a specimen and interactive display of a microscopic virtual learning resource.
    Type: Grant
    Filed: July 8, 2021
    Date of Patent: November 2, 2021
    Assignee: Central China Normal University
    Inventors: Zongkai Yang, Zheng Zhong, Di Wu
  • Patent number: 11120640
    Abstract: A fusion method for movements of a teacher in a teaching scene includes normalization, motion perception and fusion of movements. According to interaction needs in an enhanced teaching scene, this application establishes a moving information collection and a conversion of moving position and range to realize the normalization of movement.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: September 14, 2021
    Assignee: Central China Normal University
    Inventors: Zongkai Yang, Zheng Zhong, Di Wu, Ke Wu
  • Patent number: 11105811
    Abstract: A preparation method and secondary dispersion of monodisperse aminated Nanodiamond colloid solution and its application in cellular biomarking are provided. Preparation method comprise: mixing purified Nanodiamond powder with ammonium chloride and sodium chloride, placing the mixture in a ball mill for dry ball milling, washing the ball-milled mixture with deionized water, and performing ultrasonic dispersion and centrifuging to obtain the monodispersed aminated Nanodiamond colloid solution. Secondary dispersion process comprising: drying aminated Nanodiamond colloid solution to obtain aminated Nanodiamond powder, re-dispersing the powder in DMSO (dimethyl sulphoxide), deionized water, ethanol, DMF (dimethylformamide) or other solvents with ultrasonic or shearing processing. The aminated Nanodiamond has high yield and good monodispersity.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: August 31, 2021
    Assignee: Central China Normal University
    Inventors: Yu Cao, Mingxin Fang, Xiaojuan Cai, Shurui Shi, Cui Liu
  • Publication number: 20210078953
    Abstract: The present invention relates to the field of pesticides. Disclosed are a pyrazole amide compound and an application thereof, and a fungicide. The pyrazole amide compound has a structure as represented by Formula (1). The pyrazole amide compound provided by the present invention has significant control effects on soybean rust, corn rust, wheat powdery mildew, cucumber powdery mildew, and rice sheath blight even at low concentration.
    Type: Application
    Filed: November 23, 2018
    Publication date: March 18, 2021
    Applicant: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Guangfu Yang, Hua Li, Xiaolei Zhu
  • Patent number: 10916158
    Abstract: The invention provides a classroom cognitive load detection system belonging to the field of education informationization, which includes the following. A task completion feature collecting module records an answer response time and a correct answer rate of a student when completing a task. A cognitive load self-assessment collecting module quantifies and analyzes a mental effort and a task subjective difficulty by a rating scale. An expression and attention feature collecting module collects a student classroom performance video to obtain a face region through a face detection and counting a smiley face duration and a watching duration of the student according to a video analysis result. A feature fusion module fuses aforesaid six indexes into a characteristic vector. A cognitive load determining module inputs the characteristic vector to a classifier to identify a classroom cognitive load level of the student.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: February 9, 2021
    Assignee: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Zongkai Yang, Jingying Chen, Sannvya Liu, Ruyi Xu, Kun Zhang, Leyuan Liu, Shixin Peng, Zhicheng Dai
  • Patent number: 10884112
    Abstract: The disclosure discloses a fingerprint positioning method in a smart classroom, which is specifically: firstly, performing Gaussian filtering and taking the average value on a wireless signal strength value RSSI in the fingerprint database; then finding the neighbor point closest to the signal strength of the to-be-measured point; finally, the Euclidean distance is used as the weight reference, and the weighted center of mass is obtained for the nearest neighbor points. The weight index is introduced as an index of the weight, and the coordinates of the to-be-tested node are obtained. The disclosure has a higher positioning accuracy, smaller positioning error fluctuations and greater environmental adaptability.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: January 5, 2021
    Assignee: CENTRAL CHINA NORMAL UNIVERSITY
    Inventors: Zongkai Yang, Sannvya Liu, Zhicheng Dai, Zengzhao Chen, Xiuling He