Patents by Inventor Xinkai Li

Xinkai Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11941171
    Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: March 26, 2024
    Assignee: BOE Technology Group Co., Ltd.
    Inventors: Menglei Zhang, Jiankang Sun, Guixin Yan, Yaoyu Lv, Yachong Xue, Xinkai Li
  • Publication number: 20240094807
    Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
    Type: Application
    Filed: May 28, 2021
    Publication date: March 21, 2024
    Inventors: Menglei ZHANG, Jiankang SUN, Guixin YAN, Yaoyu LV, Yachong XUE, Xinkai LI
  • Publication number: 20230351975
    Abstract: Provided is a method for controlling a display apparatus. In the method, the display apparatus receives at least two pieces of data to be displayed from at least two terminals respectively, wherein the at least two pieces of data to be displayed include screen projection data and status parameters of the at least two terminals, and then displays the status parameter, and performs a screen projection based on the screen projection data.
    Type: Application
    Filed: August 16, 2021
    Publication date: November 2, 2023
    Applicants: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yachong XUE, Xue DONG, Hao ZHANG, Lili CHEN, Jiankang SUN, Guixin YAN, Yaoyu LV, Menglei ZHANG, Xinkai LI
  • Patent number: 11734841
    Abstract: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: August 22, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Yachong Xue, Hao Zhang, Lili Chen, Jiankang Sun, Guixin Yan, Xiaolei Liu, Yaoyu Lv, Menglei Zhang, Xinkai Li
  • Patent number: 11699303
    Abstract: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: July 11, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yachong Xue, Hao Zhang, Lili Chen, Jiankang Sun, Xinkai Li, Guixin Yan, Xiaolei Liu, Yaoyu Lv, Menglei Zhang
  • Patent number: 11662814
    Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
    Type: Grant
    Filed: December 17, 2021
    Date of Patent: May 30, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Jiankang Sun, Hao Zhang, Lili Chen, Yachong Xue, Xinkai Li
  • Publication number: 20220269341
    Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
    Type: Application
    Filed: December 17, 2021
    Publication date: August 25, 2022
    Inventors: Jiankang SUN, Hao ZHANG, Lili CHEN, Yachong XUE, Xinkai LI
  • Publication number: 20220164966
    Abstract: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.
    Type: Application
    Filed: June 17, 2021
    Publication date: May 26, 2022
    Inventors: Yachong XUE, Hao ZHANG, Lili CHEN, Jiankang SUN, Guixin YAN, Xiaolei LIU, Yaoyu LV, Menglei ZHANG, Xinkai LI
  • Publication number: 20220129660
    Abstract: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.
    Type: Application
    Filed: May 13, 2021
    Publication date: April 28, 2022
    Applicants: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yachong XUE, Hao ZHANG, Lili CHEN, Jiankang SUN, Xinkai LI, Guixin YAN, Xiaolei LIU, Yaoyu LV, Menglei ZHANG
  • Publication number: 20210326446
    Abstract: The present application discloses a vulnerability detection method and apparatus, an electronic device and a storage medium, and relates to the field of vulnerability processing and the like. The specific implementation is as follows: implanting an agent into a target object, and performing, by the agent, preprocessing of taint tracking on actual running information of the target object, to obtain target running information to be loaded after the preprocessing; executing the target running information till a taint monitoring point for the taint tracking, to obtain taint information and probe information; and transmitting the taint information and the probe information to a scanning end, to construct, at the scanning end, a vulnerability detection request for vulnerability detection, according to the taint information and the probe information.
    Type: Application
    Filed: March 23, 2021
    Publication date: October 21, 2021
    Inventors: Xinyu Cao, Youyi Tang, Xinkai Li, Yi Pei, Menghan Gao
  • Patent number: 10601850
    Abstract: A method of identifying risky user behaviors in computer networks includes determining behavior data of a user. The behavior data describes user activities of the user using a computer network. A particular event chain is identified from the behavior data. The particular event chain includes one or more events of the user activities. A risk coefficient of the particular event chain is determined. Based on the risk coefficient, whether the particular event chain represents a risky user behavior is determined.
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: March 24, 2020
    Assignee: Alibaba Group Holding Limited
    Inventors: Renxin Mao, Chao Sun, Xinkai Li, Dijun He
  • Publication number: 20180013780
    Abstract: A method of identifying risky user behaviors in computer networks includes determining behavior data of a user. The behavior data describes user activities of the user using a computer network. A particular event chain is identified from the behavior data. The particular event chain includes one or more events of the user activities. A risk coefficient of the particular event chain is determined. Based on the risk coefficient, whether the particular event chain represents a risky user behavior is determined.
    Type: Application
    Filed: September 1, 2017
    Publication date: January 11, 2018
    Applicant: Alibaba Group Holding Limited
    Inventors: Renxin Mao, Chao Sun, Xinkai Li, Dijun He