Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.

Abstract: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.

Abstract: Provided is a method for controlling a display apparatus. In the method, the display apparatus receives at least two pieces of data to be displayed from at least two terminals respectively, wherein the at least two pieces of data to be displayed include screen projection data and status parameters of the at least two terminals, and then displays the status parameter, and performs a screen projection based on the screen projection data.

Abstract: Provided are an image processing method, apparatus and device, and a storage medium. The image processing method comprises: acquiring a plurality of original sub-images collected by means of a plurality of cameras in a camera array; converting first pixel coordinates of each pixel in each original sub-image in an image coordinate system into target pixel coordinates in a target plane coordinate system; determining a region pixel value of each sub-region according to the correspondence between the target pixel coordinates of each pixel in each original sub-image and each sub-region in a target plane; and determining a spliced image in the target plane according to the region pixel value of each sub-region. According to the present disclosure, the algorithm is simple, and original sub-images can be quickly and accurately processed, so as to obtain a spliced image with a relatively high image quality.

Abstract: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.

Abstract: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.

Abstract: The present disclosure discloses a display device and a driving method thereof. The driving method includes: when an anti-peep mode is enabled, generating M-frame sub-picture information and M-frame raster picture information according to information of a current picture frame to be displayed; controlling a sub-display panel in the display device to sequentially display M sub-pictures according to the M-frame sub-picture information, controlling pixel rows of the sub-pictures to be periodically arranged and displayed as first pixel groups, and controlling the first pixel groups of the pixel rows corresponding to the sub-pictures to be mutually misaligned; and controlling a sub-raster panel in the display device to sequentially display M raster pictures according to the M-frame raster picture information, and controlling pixel rows of the raster pictures to be periodically arranged and displayed as second pixel groups.

Abstract: A method for interacting with an autostereoscopic display is disclosed. The method includes initiating displaying by the autostereoscopic display a left eye view and a right eye view that contain a virtual manipulated object, determining a real-world coordinate of the virtual manipulated object perceived by a user located at a predetermined viewing position of the auto stereoscopic display, receiving an interactive action of the user's manipulating body acquired by a motion tracker, where the interaction action includes a real-world coordinate of the manipulating body, determining whether an interaction condition is triggered based at least in part on the real-world coordinate of the virtual manipulated object and the real-world coordinate of the manipulating body, and refreshing the left eye view and the right eye view based on the interactive action of the manipulating body acquired by the motion tracker, in response to determining that the interaction condition is triggered.

Abstract: A method of simulating volumetric 3D display, includes: acquiring a display variable of a virtual display screen in a volumetric 3D display simulation space, the virtual display screen comprising a plurality of stereo pixels, the display variable comprising a voxel parameter of the plurality of stereo pixels, and the voxel parameter comprising a size in a first direction of the plurality of stereo pixels, a size in a second direction of the plurality of stereo pixels, and a size in a third direction of the plurality of stereo pixels; determining a display state parameter of a first stereo pixel of the plurality of stereo pixels for an object to be displayed according to the display variable; and simulating display of the object to be displayed according to the display state parameter. A computer-readable storage medium and a volumetric 3D display simulation apparatus are further provided.

Abstract: Provided are a human-machine interaction method, a system, a processing device and a computer readable storage medium, wherein the method includes: controlling a 3D display to output a 3D view to present a virtual target object; receiving a user image taken by a sight tracking camera, and detecting an eye gaze region according to the user image; receiving a hand image taken by a gesture detection camera, and detecting whether a user's hand collides with the virtual target object and/or grabs the virtual target object according to the hand image; controlling playing of the 3D view according to whether human eyes gaze at the virtual target object, the user's hand collides with the virtual target, and grasps the virtual target object.

Abstract: An interpupillary distance measuring method, a wearable ophthalmic device and a computer readable storage medium are provided. The method includes: capturing at least one eye image; extracting corresponding one or two pupil image positions corresponding to a monocular pupil or pupils to two eyes in the at least one eye image; and determining an actual distance between the pupils of two eyes according to the one or two pupil image positions.

Abstract: A wearable device, an electronic system, an electronic device, a tactile feedback method and a storage medium are provided. The wearable device with tactile feedback includes an electromagnetic coil set, a driving circuit and a control circuit, the driving circuit is coupled with the electromagnetic coil set; the control circuit is configured to control the driving circuit to generate and output a coil current corresponding to the electromagnetic coil set to the electromagnetic coil set according to a control command; and the electromagnetic coil set is configured to receive the coil current and generate the tactile feedback based on the coil current.

Abstract: A data transmission method, a method of displaying three-dimensional image, a data transmission device and a three-dimensional image display device are provided. The shift register unit includes a device. The data transmission method, comprises: performing a phase decomposition on a preset three-dimensional model to generate a plurality of phase images; acquiring position information and color information of pixels in the plurality of phase images; and sending the position information and the color information of the pixels in the plurality of phase images to a volumetric three-dimensional display device.

Abstract: A three-dimensional display apparatus includes: a display layer and a transmissive phase modulator, wherein the transmissive phase modulator is disposed on a light exit side of the display layer, and includes a plurality of modulation units; and each of the modulation units is configured to perform phase modulation on light received by the modulation unit, and is configured such that a picture displayed by the display layer is presented as a contiguous curved virtual image after being processed by the transmissive phase modulator.

Abstract: A driving method is configured to drive a display device, and the display device includes a display array and a light valve array. The display array includes rows of sub-pixels, the light valve array includes a plurality of sub light valves, a respective one sub light valve of the plurality of sub light valves corresponds to at least one row of sub-pixels, and the light valve array is on a light-emitting side of the display array. The driving method includes: any sub-pixel in the at least one row of sub-pixels being in a response phase of a display operation, the respective one sub light valve being in a light-shielding state, and the respective one sub light valve corresponding to the at least one row of sub-pixels.

Abstract: Embodiments of the present disclosure relate to a method for analyzing an imaging quality of an imaging system. The imaging system comprises a spatial light modulator. The spatial light modulator comprises pixel units arranged in an array. The method comprises obtaining a transmittance distribution function of the spatial light modulator based on a structural parameter of the pixel unit, wherein the structural parameter is an aperture ratio. The imaging quality analysis parameter of the imaging system is obtained based on the transmittance distribution function of the spatial light modulator. Then, the imaging quality of the imaging system is analyzed based on the imaging quality analysis parameter.

Abstract: A method and a device of correcting image distortion, a display device, a computer readable medium and an electronic device. The method of correcting image distortion includes: forming a correction grid on an imaging screen of a display device, the correction grid including a plurality of to-be-adjusted grid points; forming a circle on the correction grid; and moving the to-be-adjusted grid point on and outside the circle, to correct image distortion.

Abstract: Provided is a method for compressing texture data of a three-dimensional model, including: acquiring data of polygonal surfaces constituting a contour of a target three-dimensional model, and data of a texture image and a phase plane of the contour; acquiring the texture data of texture points in a texture point group corresponding to each polygonal surface, the texture points in the texture point group including first and second texture points; assigning a weight to each texture point in each texture point group according to the texture data of the first texture points in the texture point group; calculating a sum of weights of each texture point in each texture point group; and compressing the texture data, according to a target compressed data amount, and the texture data and the sum of weights of the texture point whose sum of weights is not zero.

Abstract: The present disclosure provides a sight line detection method, a sight line detection device, a computer readable storage medium, and a computer device. The sight line detection method comprises: receiving an image of a user taken by a camera; acquiring a plurality of face feature points according to the image of the user; calculating an eye center position and a pupil position based on the plurality of face feature points; obtaining an eye sight line based on the eye center position and obtaining a camera sight line base on the pupil position; and determining whether the eye sight line coincides with the camera sight line, and in a case where the eye sight line coincides with the camera sight line, performing a sight line detection with the eye sight line coincided with the camera sight line as a reference line.

Abstract: The present disclosure is related to an image processing method of virtual reality. The image processing method may include obtaining position information of a gaze point; performing a compression process on an original image to obtain a compressed image based on the position information of the gaze point; performing a compression process on a distorted image of the original image in an lens to obtain a compressed distorted image based on the position information of the gaze point; and performing an anti-distortion process on the compressed image to obtain an anti-distortion image based on a relationship between the compressed image and the compressed distorted image. The position information of the gaze point may be position information of a gaze point of a user's eye on an original image.