Abstract: The embodiments of the disclosure relate to an image acquisition method, a handle device, a head-mounted device and a head-mounted system. The handle device comprises a shell and a control module arranged in the shell. A switch control end of an infrared circuit is connected with the control module, and infrared light beads of the infrared circuit penetrate outwards through the shell; and a switch control end of a visible light circuit is connected with the control module, and visible light strips of the visible light circuit penetrate outwards through the shell. Through visible light and infrared light set on the handle, the position of the handle device can be judged, and the tracking accuracy is extremely high.

Abstract: Provided is an image transmission method. Left-eye image data and right-eye image data corresponding to a same original image frame in a target video are divided into sub-images on the image processing device side, multiple sets of image data in one-to-one correspondence with the sub-images are generated, and transmitted to the image display device through transmission threads. Each of the multiple sets of image data includes a sub-image, and first and second sequence numbers that correspond to the sub-image. Left-eye image data and right-eye image data corresponding to a same original image frame are obtained by combining sub-images in the multiple sets of image data, by the image display device, based on first and second sequence numbers in the multiple sets of image data. Finally, a left-eye image corresponding to the left-eye image data and a right-eye image corresponding to the right-eye image data are played.

Abstract: A VR image compression transmission method and system are provided. A video image to be sent by a server is obtained and the video image is locally compressed according to a compression range to obtain a first compressed video image. Video encoding is performed on the first compressed video image to obtain a transmission video image, and then the transmission video image is transmitted to a client and video decoding is performed on the transmission video image to restore the transmission video image into a second compressed video image. The second compressed video image is decompressed to obtain a display video image.

Abstract: The present disclosure relates to head-mounted vision detection equipment, vision detection method and electronic equipment, which relates to the technical field of vision detection. The head-mounted vision detection equipment includes a virtual reality headset, a sound collection device and a fundus detection device that are arranged on the virtual reality headset, and a processor. The vision detection headset is configured to display content to be recognized under control of the processor; the sound collection device is configured to obtain a recognition voice of a wearer for the content to be recognized; the fundus detection device is configured to obtain a fundus image of the wearer; and the processor is configured to acquire the recognition voice and the fundus image.

Abstract: A method and system for detecting plane information are provided. The method includes: obtaining point cloud information of a physical environment of a user; performing an iterative regressing operation on the point cloud information to fit all plane information corresponding to the physical environment; merging all the plane information according to a preset rule to obtain a merged plane information set; performing plane segmentation on the plane information set based on a pre-trained plane segmentation model to obtain segmented plane information; and filtering the segmented plane information to determine all target plane information corresponding to the physical environment.

Abstract: The present disclosure relates to a virtual object construction method and apparatus, and the method includes: obtaining a plurality of first planes on a target object in an environmental image according to an acquired environmental image; obtaining a plurality of corner points according to the plurality of first planes; constructing a virtual object corresponding to the target object according to a corner point located on the target object in the plurality of corner points.

Abstract: Provided is a high-precision anti-interference VR system, including a data selection module, a headset, and a handle matched with the headset, the data selection module selects and invokes an optical tracking module group and an electromagnetic tracking module group according to an optical FOV range; the optical tracking module group includes an optical display module and an optical tracking module, the optical display module emits a physical signal by adjusting on-off and brightness thereof; the optical tracking module obtains the physical signal emitted by the optical display module, and converts the physical signal into tracking information of the handle; the electromagnetic tracking module group includes an electromagnetic emission module and an electromagnetic receiving module, the electromagnetic emission module generates an electromagnetic signal through a driving circuit, and transmits the electromagnetic signal; and the electromagnetic receiving module receives the electromagnetic signal to complete

Abstract: A method for locating a VR device and a VR device is applied to a head-mounted displaying device of the VR device, and includes: sending a locating and synchronizing signal to the handle at a first preset interval, so that the handle controls each of LED lights of the LED light ring according to the locating and synchronizing signal to lighten for a first preset duration; simultaneously while the head-mounted displaying device is sending the locating and synchronizing signal, controlling, by the head-mounted displaying device, the camera to expose for a second preset duration to photograph the handle to obtain at least one locating photograph, wherein a starting time of the second preset duration is earlier than a starting time of the first preset duration, and the second preset duration is longer than the first preset duration; and determining spatial-position information of the handle according to the locating photograph.

Abstract: An interaction method and system based on virtual reality equipment are disclosed. The method comprises: rendering a user avatar of each virtual reality equipment in the virtual reality scene of each virtual reality equipment according to user data of multiple virtual reality equipments; acquiring in real time position-posture tracking data of multiple users collected by multiple virtual reality equipments, wherein the position-posture tracking data carries user IDs; merging the position-posture tracking data of multiple users based on the user IDs carried by the position-posture tracking data, to obtain position-posture merging data of each user, wherein the position-posture merging data carries user ID; and updating position-posture status of user avatars having a same user ID in the virtual reality scene of each virtual reality equipment by using the position-posture merging data and its carried user IDs, to realize interaction among different user avatars in the virtual reality scene.

Abstract: Disclosed is a handle controller which includes a handle body and a light-emitting unit, the light-emitting unit being provided at an end of the handle body and forming a preset angle with the handle body; the light-emitting unit includes a first surface, a second surface, a plurality of first light-emitting marks and a plurality of second light-emitting marks, the second surface covering the first surface; the first light-emitting marks and the second light-emitting marks are both provided on the first surface, and the plurality of first light-emitting marks are distributed annularly; the first light-emitting marks and the second light-emitting marks are configured to illuminate so as to be captured by an imaging device; the first light-emitting marks illuminate for a first period, and the second light-emitting marks illuminate for a second period.

Abstract: A foveated rendering method of a Virtual Reality (VR) system based on monocular eyeball tracking is provided. A first monocular mapping position, corresponding to a monocular eyeball of a user, on a display screen of the VR system is obtained, and then an Inter Pupilary Distance (IPD) corresponding to a binocular pupil distance of the user is obtained, so as to calculate a second monocular mapping position, corresponding to the other monocular eyeball of the user, on the display screen of the VR system according to the IPD and the first monocular mapping position. Then, main rendering regions are determined by taking the first monocular mapping position and the second monocular mapping position as circle centers and preset thresholds as radiuses respectively. High-resolution main rendering is performed in the main rendering regions.

Abstract: A switching method and system of interactive modes of a head-mounted device is provided. The interactive modes include gamepad tracking interactive mode and bare hand tracking interactive mode. A standard deviation of position data, a standard deviation of attitude data and a standard deviation of accelerometer data among IMU data are acquired, respectively. Whether the standard deviation of the position data, the standard deviation of the attitude data and the standard deviation of the accelerometer data meet a first preset condition is determined. Moreover, the standard deviation of the accelerometer data within a second preset duration is acquired in real time, and whether the standard deviation of the accelerometer data meets a second preset condition is determined. In cases where the standard deviation of the accelerometer data meets the second preset condition, the bare hand tracking interactive mode is paused, and the gamepad tracking interactive mode is started.

Abstract: A packaging structure of head mounted terminal and a head mounted terminal are disclosed. The packaging structure comprises an annular rear casing and a soft rubber member, and the soft rubber member is disposed between the rear casing and two lenses of the head mounted terminal. The outer edge of the soft rubber member is fixed on the inner ring of the rear casing, the soft rubber member comprises two lens barrels arranged symmetrically, and the two lens barrels are respectively sleeved on the two lenses of the head mounted terminal. The soft rubber member further comprises an extending and folding part disposed on an outer periphery of the lens barrel, which is used to realize the extension of the lens barrel with the left and right movement of the lens.

Abstract: Provided are a head-mounted display device and a head-mounted display system. The head-mounted display device includes: a processor, a first interface, a transfer switch, a wireless communication module and a display screen, the wireless communication module is configured to be in wireless communication connection with a hand-held controller; the processor is configured to control the transfer switch to switch for communication between the first interface and the display screen when detecting that the first interface is connected to a host, and send first position data and second position data to the host via the first interface, so as to allow the host to render an image according to the first position data and the second position data and to output and display a rendered image on the display screen via the first interface.

Abstract: A streaming-based VR multi-split system and method are provided. The system includes a control system, a manipulation terminal and at least one experience terminal. The control system includes a streaming media server, a streaming coding and decoding interaction module and a VR platform. The streaming decoding and interaction processing module is configured to receive a video stream sent by the streaming coding and decoding interaction module, collect interaction data at one side of the manipulation terminal in real time, and transmit the interaction data to the streaming coding and decoding interaction module. The streaming coding and decoding interaction module sends a video picture code of the VR platform to the manipulation terminal, and pushes the video stream corresponding to the interaction data to the streaming media server. A presentation picture corresponding to an operation of the experience terminal is acquired by the streaming media server.

Abstract: Provided are an image difference-based method and system for tracking a transparent object, first by training a convolutional neural network based on sample data, to generate a transparent object detection model; then inputting visible light image data acquired in real time and infrared thermal image data acquired in real time to the transparent object detection model, to acquire a visible light image transparent pixel identifier and an infrared thermal image transparent pixel identifier; then calculating three-dimensional point cloud information of each pixel marked by the infrared thermal image transparent pixel identifier, in the infrared thermal image data, wherein the three-dimensional point cloud information is in a coordinate system of an infrared thermal imaging camera; wherein the infrared thermal imaging camera is a camera for acquiring the infrared thermal image data, thereby acquiring, according to the three-dimensional point cloud information, corresponding position coordinates of each pixel, whi