Patents by Inventor Yachong Xue

Yachong Xue has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11941171
    Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: March 26, 2024
    Assignee: BOE Technology Group Co., Ltd.
    Inventors: Menglei Zhang, Jiankang Sun, Guixin Yan, Yaoyu Lv, Yachong Xue, Xinkai Li
  • Publication number: 20240094807
    Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
    Type: Application
    Filed: May 28, 2021
    Publication date: March 21, 2024
    Inventors: Menglei ZHANG, Jiankang SUN, Guixin YAN, Yaoyu LV, Yachong XUE, Xinkai LI
  • Patent number: 11884214
    Abstract: Provided is a display method for A-pillar-mounted display assemblies of a vehicle. The method includes: acquiring facial posture information of a driver of the vehicle in a camera coordinate system by any one driver monitoring assembly of at least one driver monitoring assembly, determining a visual field of the driver based on a gaze direction of the driver and the eye position of the driver, acquiring coordinates of the two display assemblies in a world coordinate system, converting the coordinates of the two display assemblies in the world coordinate system into coordinates in the camera coordinate system based on a first conversion relationship, determining whether any one display assembly of the two display assemblies is within the visual field, and capturing an external image of the vehicle captured by the imaging assembly.
    Type: Grant
    Filed: March 10, 2021
    Date of Patent: January 30, 2024
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Gang Li, Yachong Xue, Hao Zhang, Lili Chen, Minglei Chu, Hong Zhu, Hong Li, Xinqi Lin, Shuai Liu, Hui Zhao
  • Patent number: 11854170
    Abstract: An image distortion processing method, including: determining a first relationship between a position of a human eye and a viewing position of the human eye on the VR screen; displaying an initially distorted image on the VR screen; determining a first feature point located at a first initial position in the initially distorted image; determining a first human eye position of the human eye in a case of viewing the first feature point located at a first target position; determining the first target position according to the first relationship and the first human eye position; determining a first target distortion parameter corresponding to the first feature point located at the first target position according to a relationship between a position of the feature point on the VR screen and a distortion parameter; and performing distortion on an image displayed on the VR screen according to the first target distortion parameter.
    Type: Grant
    Filed: December 24, 2020
    Date of Patent: December 26, 2023
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yaoyu Lv, Yachong Xue, Menglei Zhang, Xiaolei Liu, Lili Chen, Hao Zhang
  • Publication number: 20230351975
    Abstract: Provided is a method for controlling a display apparatus. In the method, the display apparatus receives at least two pieces of data to be displayed from at least two terminals respectively, wherein the at least two pieces of data to be displayed include screen projection data and status parameters of the at least two terminals, and then displays the status parameter, and performs a screen projection based on the screen projection data.
    Type: Application
    Filed: August 16, 2021
    Publication date: November 2, 2023
    Applicants: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yachong XUE, Xue DONG, Hao ZHANG, Lili CHEN, Jiankang SUN, Guixin YAN, Yaoyu LV, Menglei ZHANG, Xinkai LI
  • Patent number: 11805238
    Abstract: Methods and apparatuses for acquiring display image sequence, rotary stereoscopic display devices and storage media are provided. A method includes: determining voxels in a 3D display space by multiple partitioning of the 3D display space in a cylindrical coordinate system using a predetermined partitioning mode, where the predetermined partitioning mode includes non-uniform partitioning in a radius direction of the cylindrical coordinate system, and space bounding boxes resulting from a same partitioning have a same volume; determining a cross-sectional profile of a 3D object to be displayed on a display screen at each of phase positions; determining a cross-sectional image based on voxels and the cross-sectional profile at each of the phase positions; and acquiring a display image sequence by arranging the cross-sectional images according to rotation angles of the display screen.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: October 31, 2023
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yaoyu Lv, Yachong Xue, Zhanshan Ma, Jiankang Sun, Lili Chen, Hao Zhang
  • Publication number: 20230345135
    Abstract: Provided are an image processing method, apparatus and device, and a storage medium. The image processing method comprises: acquiring a plurality of original sub-images collected by means of a plurality of cameras in a camera array; converting first pixel coordinates of each pixel in each original sub-image in an image coordinate system into target pixel coordinates in a target plane coordinate system; determining a region pixel value of each sub-region according to the correspondence between the target pixel coordinates of each pixel in each original sub-image and each sub-region in a target plane; and determining a spliced image in the target plane according to the region pixel value of each sub-region. According to the present disclosure, the algorithm is simple, and original sub-images can be quickly and accurately processed, so as to obtain a spliced image with a relatively high image quality.
    Type: Application
    Filed: May 25, 2021
    Publication date: October 26, 2023
    Inventors: Yachong XUE, Hao ZHANG, Lili CHEN, Jiankang SUN, Guixin YAN, Xiaolei LIU, Gang LI
  • Patent number: 11734841
    Abstract: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: August 22, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Yachong Xue, Hao Zhang, Lili Chen, Jiankang Sun, Guixin Yan, Xiaolei Liu, Yaoyu Lv, Menglei Zhang, Xinkai Li
  • Patent number: 11717163
    Abstract: A wearable device, a signal processing method and a signal processing device are disclosed. The wearable device includes a processor and a signal collector electrically connected to the processor. The signal collector includes at least one electroencephalogram sensor configured to collect an electroencephalogram signal and at least one electrooculogram sensor configured to collect an electrooculogram signal. The processor is configured to generate a control signal based on the electroencephalogram signal and the electrooculogram signal, and the electroencephalogram sensor and the electrooculogram sensor are different sensors.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: August 8, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Huidong He, Hao Zhang, Lili Chen, Yu Lei, Peng Han, Yuanjie Lu, Yukun Sun, Qingwen Fan, Shuo Zhang, Yachong Xue
  • Patent number: 11705045
    Abstract: Disclosed are a method for generating display data by a rotatory stereoscopic display apparatus, a display driving method, a computer device, a rotatory stereoscopic display apparatus, and a stereoscopic display system. The method for generating display data includes: generating, based on display parameters of the rotatory stereoscopic display apparatus and a model to be displayed, an image array for displaying the model; generating, for an image in the image array, an initial data stream of the image, the initial data stream including: grayscale datum of each pixel in the image; and performing data compression on the initial data stream to generate a compressed data stream, the compressed data stream including: data units of pixels whose grayscale data is non-zero data, each data unit including: grayscale datum of the pixel and an order of the grayscale datum in the initial data stream.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: July 18, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yaoyu Lv, Zhanshan Ma, Yachong Xue, Menglei Zhang, Lili Chen, Hao Zhang
  • Patent number: 11699303
    Abstract: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: July 11, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yachong Xue, Hao Zhang, Lili Chen, Jiankang Sun, Xinkai Li, Guixin Yan, Xiaolei Liu, Yaoyu Lv, Menglei Zhang
  • Patent number: 11662814
    Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
    Type: Grant
    Filed: December 17, 2021
    Date of Patent: May 30, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Jiankang Sun, Hao Zhang, Lili Chen, Yachong Xue, Xinkai Li
  • Publication number: 20220402433
    Abstract: A display method for a display assembly, a display system, and a display device of a vehicle column A, and a storage medium. According to the display method, by means of a conversion relationship between a coordinate system of a target feature model and a camera coordinate system of a driver monitoring assembly and a conversion relationship between the coordinate system of the target feature model and a world coordinate system, a conversion relationship between the camera coordinate system and the world coordinate system is obtained, a coordinate of the display assembly in the world coordinate system can be converted into a coordinate in the camera coordinate system, and thus whether a driver watches the display assembly can be simply determined.
    Type: Application
    Filed: March 10, 2021
    Publication date: December 22, 2022
    Inventors: Gang LI, Yachong XUE, Hao ZHANG, Lili CHEN, Minglei CHU, Hong ZHU, Hong LI, Xinqi LIN, Shuai LIU, Hui ZHAO
  • Publication number: 20220405895
    Abstract: An image distortion processing method, including: determining a first relationship between a position of a human eye and a viewing position of the human eye on the VR screen; displaying an initially distorted image on the VR screen; determining a first feature point located at a first initial position in the initially distorted image; determining a first human eye position of the human eye in a case of viewing the first feature point located at a first target position; determining the first target position according to the first relationship and the first human eye position; determining a first target distortion parameter corresponding to the first feature point located at the first target position according to a relationship between a position of the feature point on the VR screen and a distortion parameter; and performing distortion on an image displayed on the VR screen according to the first target distortion parameter.
    Type: Application
    Filed: December 24, 2020
    Publication date: December 22, 2022
    Inventors: Yaoyu LV, Yachong XUE, Menglei ZHANG, Xiaolei LIU, Lili CHEN, Hao ZHANG
  • Patent number: 11509882
    Abstract: A three-dimensional display apparatus includes: a display layer and a transmissive phase modulator, wherein the transmissive phase modulator is disposed on a light exit side of the display layer, and includes a plurality of modulation units; and each of the modulation units is configured to perform phase modulation on light received by the modulation unit, and is configured such that a picture displayed by the display layer is presented as a contiguous curved virtual image after being processed by the transmissive phase modulator.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: November 22, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Shuo Zhang, Hao Zhang, Lili Chen, Minglei Chu, Hongzhen Xue, Guixin Yan, Zehua Dong, Huidong He, Chenxi Zhao, Xiangjun Peng, Yaoyu Lv, Yukun Sun, Qingwen Fan, Yachong Xue
  • Publication number: 20220327983
    Abstract: Disclosed are a method for generating display data by a rotatory stereoscopic display apparatus, a display driving method, a computer device, a rotatory stereoscopic display apparatus, and a stereoscopic display system. The method for generating display data includes: generating, based on display parameters of the rotatory stereoscopic display apparatus and a model to be displayed, an image array for displaying the model; generating, for an image in the image array, an initial data stream of the image, the initial data stream including: grayscale datum of each pixel in the image; and performing data compression on the initial data stream to generate a compressed data stream, the compressed data stream including: data units of pixels whose grayscale data is non-zero data, each data unit including: grayscale datum of the pixel and an order of the grayscale datum in the initial data stream.
    Type: Application
    Filed: September 11, 2020
    Publication date: October 13, 2022
    Inventors: Yaoyu LV, Zhanshan MA, Yachong XUE, Menglei ZHANG, Lili CHEN, Hao ZHANG
  • Patent number: 11463666
    Abstract: Embodiments of the present disclosure relate to a method for analyzing an imaging quality of an imaging system. The imaging system comprises a spatial light modulator. The spatial light modulator comprises pixel units arranged in an array. The method comprises obtaining a transmittance distribution function of the spatial light modulator based on a structural parameter of the pixel unit, wherein the structural parameter is an aperture ratio. The imaging quality analysis parameter of the imaging system is obtained based on the transmittance distribution function of the spatial light modulator. Then, the imaging quality of the imaging system is analyzed based on the imaging quality analysis parameter.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: October 4, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Shuo Zhang, Hao Zhang, Lili Chen, Hongzhen Xue, Minglei Chu, Guixin Yan, Yukun Sun, Chenxi Zhao, Zehua Dong, Xiangjun Peng, Yaoyu Lv, Yachong Xue, Huidong He, Qingwen Fan
  • Publication number: 20220269341
    Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
    Type: Application
    Filed: December 17, 2021
    Publication date: August 25, 2022
    Inventors: Jiankang SUN, Hao ZHANG, Lili CHEN, Yachong XUE, Xinkai LI
  • Patent number: 11410340
    Abstract: Provided is a method for compressing texture data of a three-dimensional model, including: acquiring data of polygonal surfaces constituting a contour of a target three-dimensional model, and data of a texture image and a phase plane of the contour; acquiring the texture data of texture points in a texture point group corresponding to each polygonal surface, the texture points in the texture point group including first and second texture points; assigning a weight to each texture point in each texture point group according to the texture data of the first texture points in the texture point group; calculating a sum of weights of each texture point in each texture point group; and compressing the texture data, according to a target compressed data amount, and the texture data and the sum of weights of the texture point whose sum of weights is not zero.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: August 9, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yaoyu Lv, Hongzhen Xue, Fuqiang Ma, Guixin Yan, Lili Chen, Hao Zhang, Zhanshan Ma, Yachong Xue
  • Patent number: 11398052
    Abstract: A camera positioning method, device and medium are provided. The method includes: determining positioning configuration information; determining, according to the positioning configuration information, positioning information of the camera by a preset algorithm, the positioning information including distance limitation data which defines a distance between a target and the camera; and determining a position of the camera according to the positioning information, wherein the positioning configuration information includes target data, ratio data of a target image in an image captured by the camera, and camera parameter data.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: July 26, 2022
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Jiankang Sun, Hao Zhang, Lili Chen, Yachong Xue, Hongzhen Xue, Fuqiang Ma, Zehua Dong