Patents by Inventor Jiankang Sun

Jiankang Sun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11941171
    Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: March 26, 2024
    Assignee: BOE Technology Group Co., Ltd.
    Inventors: Menglei Zhang, Jiankang Sun, Guixin Yan, Yaoyu Lv, Yachong Xue, Xinkai Li
  • Publication number: 20240094807
    Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
    Type: Application
    Filed: May 28, 2021
    Publication date: March 21, 2024
    Inventors: Menglei ZHANG, Jiankang SUN, Guixin YAN, Yaoyu LV, Yachong XUE, Xinkai LI
  • Publication number: 20230351975
    Abstract: Provided is a method for controlling a display apparatus. In the method, the display apparatus receives at least two pieces of data to be displayed from at least two terminals respectively, wherein the at least two pieces of data to be displayed include screen projection data and status parameters of the at least two terminals, and then displays the status parameter, and performs a screen projection based on the screen projection data.
    Type: Application
    Filed: August 16, 2021
    Publication date: November 2, 2023
    Applicants: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yachong XUE, Xue DONG, Hao ZHANG, Lili CHEN, Jiankang SUN, Guixin YAN, Yaoyu LV, Menglei ZHANG, Xinkai LI
  • Patent number: 11805238
    Abstract: Methods and apparatuses for acquiring display image sequence, rotary stereoscopic display devices and storage media are provided. A method includes: determining voxels in a 3D display space by multiple partitioning of the 3D display space in a cylindrical coordinate system using a predetermined partitioning mode, where the predetermined partitioning mode includes non-uniform partitioning in a radius direction of the cylindrical coordinate system, and space bounding boxes resulting from a same partitioning have a same volume; determining a cross-sectional profile of a 3D object to be displayed on a display screen at each of phase positions; determining a cross-sectional image based on voxels and the cross-sectional profile at each of the phase positions; and acquiring a display image sequence by arranging the cross-sectional images according to rotation angles of the display screen.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: October 31, 2023
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yaoyu Lv, Yachong Xue, Zhanshan Ma, Jiankang Sun, Lili Chen, Hao Zhang
  • Publication number: 20230345135
    Abstract: Provided are an image processing method, apparatus and device, and a storage medium. The image processing method comprises: acquiring a plurality of original sub-images collected by means of a plurality of cameras in a camera array; converting first pixel coordinates of each pixel in each original sub-image in an image coordinate system into target pixel coordinates in a target plane coordinate system; determining a region pixel value of each sub-region according to the correspondence between the target pixel coordinates of each pixel in each original sub-image and each sub-region in a target plane; and determining a spliced image in the target plane according to the region pixel value of each sub-region. According to the present disclosure, the algorithm is simple, and original sub-images can be quickly and accurately processed, so as to obtain a spliced image with a relatively high image quality.
    Type: Application
    Filed: May 25, 2021
    Publication date: October 26, 2023
    Inventors: Yachong XUE, Hao ZHANG, Lili CHEN, Jiankang SUN, Guixin YAN, Xiaolei LIU, Gang LI
  • Patent number: 11783445
    Abstract: An image processing method is provided, the method includes: performing area division on an input image to obtain a plurality of sub-images; determining a part of the plurality of sub-images as an image to be output; stitching respective sub-images of the image to be output to obtain a stitched image; and transmitting the stitched image, wherein the stitched image is smaller than the input image. An image jointing method is provided, the method includes: receiving a stitched image obtained by the image processing method according to the present disclosure; extracting respective sub-images of an image to be output from the stitched image; and jointing the respective sub-images to obtain a display image, wherein the jointing the respective sub-images refers to obtaining the display image by an operation inverse to a stitching process of stitching the respective sub-images to obtain the stitched image.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: October 10, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Xuefeng Wang, Yukun Sun, Hao Zhang, Lili Chen, Jinghua Miao, Bin Zhao, Xi Li, Lixin Wang, Jianwen Suo, Wenyu Li, Jinbao Peng, Qingwen Fan, Yuanjie Lu, Yali Liu, Chenru Wang, Jiankang Sun
  • Patent number: 11734841
    Abstract: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: August 22, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Yachong Xue, Hao Zhang, Lili Chen, Jiankang Sun, Guixin Yan, Xiaolei Liu, Yaoyu Lv, Menglei Zhang, Xinkai Li
  • Patent number: 11729927
    Abstract: A rotary shaft mechanism of an electronic is provided. The rotary shaft mechanism includes a first rotating assembly and a second rotating assembly, wherein the first rotating assembly is provided with a first through hole, and the second rotating assembly is provided with a second through hole, wherein the first through hole is in communication with the second through hole, and an axis of the first through hole and an axis of the second through hole are both intersected with a rotary shaft between the first rotating assembly and the second rotating assembly. A flexible circuit board of the electronic device is disposed in the first through hole and the second through hole.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: August 15, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yuhong Liu, Zhanshan Ma, Jiankang Sun, Zheng Ge, Lili Chen
  • Patent number: 11699303
    Abstract: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: July 11, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yachong Xue, Hao Zhang, Lili Chen, Jiankang Sun, Xinkai Li, Guixin Yan, Xiaolei Liu, Yaoyu Lv, Menglei Zhang
  • Patent number: 11669872
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for broadcasting audio. In one aspect, the method includes receiving, from a server by a smart broadcasting device associated with a service client, an audio broadcast instruction; in response to receiving the audio broadcast instruction, downloading an audio file corresponding to the audio broadcast instruction, wherein the audio file comprises a marketing content related to services provided by the server to the service client associated with the smart broadcasting device; and broadcasting, by the smart broadcasting device, the audio file by using a speaker of the smart broadcasting device.
    Type: Grant
    Filed: August 10, 2021
    Date of Patent: June 6, 2023
    Assignee: Advanced New Technologies Co., Ltd.
    Inventors: Qimeng Zou, Jiankang Sun, Yao Qin, Linqing Wang
  • Patent number: 11662814
    Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
    Type: Grant
    Filed: December 17, 2021
    Date of Patent: May 30, 2023
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Jiankang Sun, Hao Zhang, Lili Chen, Yachong Xue, Xinkai Li
  • Publication number: 20230082346
    Abstract: An image processing method includes: according to position coordinates of any interpolation pixel in a target image, determining position coordinate of the interpolation pixel in an original image; calculating a two-dimensional image entropy of an (n×n) neighborhood of the interpolation pixel in the original image; when it is greater than or equal to a preset entropy threshold value, calculating a pixel value of the interpolation pixel based on all original pixels; when it is less than the preset entropy threshold, calculating gradient values in at least two edge directions within the threshold neighborhood and determining whether there is a strong-edge direction; if so, calculating the pixel value of the interpolation pixel based on a plurality of original pixels in the strong-edge direction; if not, calculating the pixel value of the interpolation pixel based on all the original pixels.
    Type: Application
    Filed: June 16, 2021
    Publication date: March 16, 2023
    Applicants: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Xiaolei LIU, Jiankang SUN, Lili CHEN, Hao ZHANG
  • Patent number: 11537206
    Abstract: A wearable device, an electronic system, an electronic device, a tactile feedback method and a storage medium are provided. The wearable device with tactile feedback includes an electromagnetic coil set, a driving circuit and a control circuit, the driving circuit is coupled with the electromagnetic coil set; the control circuit is configured to control the driving circuit to generate and output a coil current corresponding to the electromagnetic coil set to the electromagnetic coil set according to a control command; and the electromagnetic coil set is configured to receive the coil current and generate the tactile feedback based on the coil current.
    Type: Grant
    Filed: November 20, 2018
    Date of Patent: December 27, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., Beijing BOE Technology Development Co., Ltd.
    Inventors: Ziqiang Guo, Jian Sun, Xinjian Liu, Yakun Wang, Lin Lin, Zhen Tang, Yu Lei, Minglei Chu, Jiankang Sun, Jinghua Miao, Guixin Yan, Feng Zi
  • Patent number: 11537200
    Abstract: Provided are a human-machine interaction method, a system, a processing device and a computer readable storage medium, wherein the method includes: controlling a 3D display to output a 3D view to present a virtual target object; receiving a user image taken by a sight tracking camera, and detecting an eye gaze region according to the user image; receiving a hand image taken by a gesture detection camera, and detecting whether a user's hand collides with the virtual target object and/or grabs the virtual target object according to the hand image; controlling playing of the 3D view according to whether human eyes gaze at the virtual target object, the user's hand collides with the virtual target, and grasps the virtual target object.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: December 27, 2022
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Guixin Yan, Jiankang Sun, Lili Chen, Hao Zhang
  • Patent number: 11534063
    Abstract: An interpupillary distance measuring method, a wearable ophthalmic device and a computer readable storage medium are provided. The method includes: capturing at least one eye image; extracting corresponding one or two pupil image positions corresponding to a monocular pupil or pupils to two eyes in the at least one eye image; and determining an actual distance between the pupils of two eyes according to the one or two pupil image positions.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: December 27, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., Beijing BOE Technology Development Co., Ltd.
    Inventors: Hao Zhang, Lili Chen, Minglei Chu, Jiankang Sun, Guixin Yan, Ziqiang Guo, Yakun Wang, Wenhong Tian, Zhanshan Ma
  • Patent number: 11501282
    Abstract: Some embodiments of the application disclose a method and apparatus for paying a fare. When a user takes a public transit means, the user terminal establishes an NFC connection with the fare-collecting device of the public transit means, the user terminal transmits the encrypted account ID of the user to the fare-collecting device, and the fare-collecting device may request a server to deduct the fare from the account of the user.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: November 15, 2022
    Assignee: ADVANCED NEW TECHNOLOGIES CO., LTD.
    Inventors: Hong Zhang, Jun Wu, Jiankang Sun
  • Publication number: 20220301101
    Abstract: An image processing method, an image processing device, and a display device, relating to the technical field of image processing. In the method, interpolation processing is performed on an image to be processed, so as to obtain an interpolated image, and initial pixel values of respective interpolated pixels in the interpolated image are then updated, so as to reduce, for each interpolated pixel, the difference between a second-order derivative of the updated pixel value of the interpolated pixel and a second-order derivative of a pixel value of a target original pixel in the interpolated image, thereby reducing artifacts generated in the interpolated image, improving image continuity in the neighboring region of the interpolated pixels in the interpolated image, and improving the quality of the finally obtained processed image.
    Type: Application
    Filed: March 9, 2021
    Publication date: September 22, 2022
    Inventors: Xiaolei LIU, Jiankang SUN, Lili CHEN, Hao ZHANG
  • Patent number: 11435289
    Abstract: An optical distortion measurement method that including receiving target field of view information; processing the target field of view information using a coordinate conversion model to obtain screen coordinates of a target angle of view, wherein the coordinate conversion model may be configured to convert image plane coordinates of the target angle of view to screen coordinates of the target angle of view; and outputting at least the screen coordinates of the target angle of view.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: September 6, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Hongzhen Xue, Fuqiang Ma, Yali Liu, Lili Chen, Jiankang Sun, Shuo Zhang
  • Patent number: 11436787
    Abstract: An image rendering method for a computer product coupled to a display apparatus may include rendering an entire display region of the display apparatus with a first rendering mode to generate a first rendering mode sample image, determining a target region in the entire display region, rendering the target region with a second rendering mode to generate a second rendering mode sample image, and transmitting data of the first rendering mode sample image and the second rendering mode sample image. The second rendering mode comprises at least a value of an image rendering feature that is higher than that of the first rendering mode.
    Type: Grant
    Filed: September 6, 2018
    Date of Patent: September 6, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Xuefeng Wang, Yukun Sun, Bin Zhao, Lixin Wang, Xi Li, Jianwen Suo, Wenyu Li, Qingwen Fan, Jinbao Peng, Yuanjie Lu, Yali Liu, Chenru Wang, Jiankang Sun, Hao Zhang, Lili Chen, Jinghua Miao
  • Publication number: 20220269341
    Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
    Type: Application
    Filed: December 17, 2021
    Publication date: August 25, 2022
    Inventors: Jiankang SUN, Hao ZHANG, Lili CHEN, Yachong XUE, Xinkai LI