Abstract: A tracking method, comprising: acquiring a feature point of a controller by a camera of a HMD, wherein the feature point is used to indicate a corresponding location of the controller; receiving state information of the controller collected by an IMU of the controller, wherein the state information includes position information and rotation information of the controller; and determining a current state of the controller according to the feature point and the state information, wherein the current state includes a current position and a current rotation of the controller.

Abstract: A three-dimensional display method is provided and comprises: acquiring target space coordinates of a target marker in a physical space; converting the target space coordinates into rendering coordinates in a virtual space; acquiring data of a virtual object to be displayed, and rendering, based on the data of the virtual object and the rendering coordinates, the virtual object to obtain a left-eye display content and a right-eye display content of the virtual object; and displaying the left-eye display content and the right-eye display content. The left-eye display content is projected onto a first optical lens, the right-eye display content is projected onto a second optical lens, and the first optical lens and the second optical lens respectively reflect the left-eye display content and the right-eye display content to human eyes. The method can achieve alignment display of the virtual object with the target marker, and a stereoscopic display.

Abstract: The present disclosure discloses a communication connection method. The method includes: capturing an image containing a marker and identifying the marker in the image; acquiring an identifier of a controller corresponding to the marker when the marker is a controller marker, the identifier being used for pairing during a communication connection with the controller; and establishing the communication connection with the controller based on the identifier.

Abstract: An alignment method is provided. A first 3D position and a first IMU calculation 3D position of a position object with an IMU is determined when the IMU enters a steady state. A second 3D position and a second IMU calculation 3D position of the position object is determined when the IMU exits the steady state. A first relative vector is determined based on the first 3D position and the second 3D position. A second relative vector is determined based on the first IMU calculation 3D position and the second IMU calculation 3D position. A rotation matrix is determined based on the first relative vector and the second first relative vector. A coordinate system of the position device is aligned with a coordinate system of the IMU based on the rotation matrix. An electronic device and a non-transitory computer readable storage medium are also provided.

Abstract: The present application provides a method of displaying virtual content. The method includes: capturing a first image including a first marker; determining a display region corresponding to a first interaction device based on the first marker in the first image and displaying the first virtual object; displaying second virtual object corresponding to the first virtual object. The first marker is arranged on the first interaction device. A first display position of the first virtual object in a virtual space corresponds to the display region. A second display position of the second virtual object in the virtual space corresponds to a predefined superimposing region, and the second virtual object is at least a part of the first virtual object.

Abstract: A method of device tracking is provided. Based on a captured image containing a marker, first spatial position is acquired. Based on a captured image of a scene, second spatial position is acquired. Based on at least one of the first spatial position and the second spatial position, a terminal device may be positioned and tracked.

Abstract: A method of controlling virtual content, a terminal device and a computer readable medium are provided. The terminal device includes a display configured to display a virtual object, a camera configured to capture a target image including a marker, at least one processor, and a memory. The memory stores one or more programs configured to be executed by the at least one processor. The one or more programs includes instructions of acquiring the target image including the marker, where a plurality of sub-markers is distributed on the marker; determining a blocked target, wherein the blocked target is a blocked sub-marker of the plurality of sub-markers in the target image; generating a control instruction according to the blocked target; and controlling the displayed virtual object based on the control instruction.

Abstract: The present application provides a method of controlling a virtual image. The method may includes acquiring relative spatial position between a terminal device and an interaction device; generating the virtual image based on the relative spatial position, wherein the virtual image includes one or more user interface elements, and a superimposing position of each user interface element in a real space correspond to the interaction device; generating in advance and acquiring a rotational vector corresponding to the interaction device, determining a spatial position of the rotational vector in a virtual space based on the relative spatial position, wherein a direction indicated by the rotational vector may be fixed; and when the spatial position is located with a region corresponding to any user interface element in the virtual space, performing a corresponded control operation based on the user interface element corresponding to the region.

Abstract: A method for displaying a virtual object includes: acquiring first spatial position information of a marker relative to a terminal device; acquiring second spatial position information of the marker relative to a target region of a physical object; determining, third spatial position information of the terminal device relative to the target region based on the first spatial position information and the second spatial position information; and displaying, based on the third spatial position information, the virtual object on the target region of the physical object.

Abstract: A method of generating a virtual object includes: capturing an image containing a target marker, wherein the target marker is at least one marker of a plurality of markers, and is within a visual range of the terminal device, and the plurality of markers are arranged at various positions dispersively; acquiring a target spatial position of the target marker relative to the terminal device, based on the image; reading a first spatial position relation between each of the plurality of markers, storing the same in the terminal device, and acquiring a second spatial position relation of a virtual object relative to the plurality of markers; determining a display position of the virtual object, based on the first spatial position relation, the second spatial position relation, and the target spatial position; and generating the virtual object based on the display position.

Abstract: An interactive method comprises: obtaining a first spatial position of the first terminal device relative to a marker; determining a first display position of a first virtual object in virtual space according to the first spatial position; receiving interaction data sent from a second terminal device, wherein the interaction data includes model data of a second virtual object and a second spatial position of the second virtual object relative to a marker; determining a second display position of the second virtual object in virtual space according to the first spatial position and the second spatial position; generating the first virtual object according to the first display position, and the second virtual object according to the data of the second virtual object and the second display position; and displaying the first virtual object and the second virtual object.

Abstract: A method for displaying virtual content and a system for sharing virtual content are disclosed. The method includes obtaining, by a first electronic device, a first spatial location information of the first electronic device with respect to at least one marker; receiving, by the first electronic device, data of a first virtual object generated in a second electronic device and a second spatial location information of the first virtual object with respect to the at least one marker; generating, by the first electronic device, a second virtual object based on the data of the first virtual object, the first spatial location information, and the second spatial location information, to obtain a display content, wherein the second virtual object is same to the first virtual object in content while the second virtual object is different from the first virtual object with a different display angle; and displaying the display content.

Abstract: A method for identifying light spot, image processing device, and image processing device, and non-transitory computer readable storage medium are disclosed herein. An example method involves: receiving a first image corresponding to a light spot image, wherein the first image is an image of the light spot image displayed in a first color space; converting the first image into a second image, wherein the second image is an image of the light spot image displayed in a second color space; and identifying the light spot with a target color in the second image according to a preset color identifying condition of the second color space.

Abstract: Method and device for searching stripe set are disclosed herein. The method involves: receiving a raw image captured by a rolling shutter image sensor, wherein the raw image includes stripe pattern formed by flashing light source; binarizing the raw image to obtain a binary image, according to a binary threshold, wherein the binary image has two pixel values, one of the two pixel values is set as a preset first value; searching a connected domain having pixels with a first value to obtain a plurality of first connected domains, according to the pixel value in the binary image; selecting a target connected domain corresponding to the stripe pattern from the plurality of first connected domains; determining stripe set according to the target connected domain, wherein the stripe set is the set of the target connected domain corresponds to the stripe pattern.

Abstract: The present disclosure provides a method and device for identifying a light source. The method includes as follows. M stripe sets in an image may be detected. A first energy spectrum data corresponding to each of M stripe sets may be obtained. A second energy spectrum data corresponding to each light source in a database may be obtained. The database may include K light sources, and the energy spectrum data corresponds to an identity of the light source. A correlation coefficient between the second energy spectrum data and the first energy spectrum data may be calculated to obtain M*K correlation coefficients. The identity of each stripe set corresponding to the light source in the database may be determined according to the M*K correlation coefficients. With this disclosure, the tracking of the light source emitted by a controller can be achieved.

Abstract: The present disclosure provides a method and device for identifying a flashing light source. The method includes as follows. A processor obtains an image captured via a rolling shutter image sensor, the rolling shutter image sensor capturing an image of an environmental background, wherein the environmental background may include movable flashing light sources. A processor obtains stripe sets in the image, wherein the stripe sets can be obtained by capturing the flashing light sources via the rolling shutter image sensor. A processor takes a center of each stripe set as a reference point, and samples along a first direction to obtain n sampling points. A processor identifies the flashing light source by processing the n sampling points. With this disclosure, the identifying automatically of the flashing light source can be achieved.

Abstract: The present disclosure provides a method and a device for aligning a coordinate of a controller or a headset with a coordinate of a binocular system. The method includes: obtaining pose data of the controller; acquiring real-time coordinate data in a binocular coordinate system during a repeating movement of the controller based on a light spot emitted from the controller; generating a motion track of the controller during the movement based on the real-time coordinate data and the pose data; obtaining a pose of the controller in controller coordinate system based on the motion track; obtaining a first angle between the positive direction of the controller coordinate system and a positive direction of the binocular coordinate system; and correcting the binocular coordinate system based on the first angle until the angle reaches zero. The method and device for aligning coordinates is easy to be implemented with low cost.

Abstract: The present application provides a method and device for searching stripe set and a system with the same. Wherein, the method includes: a plurality of first connected domains are obtained in the binary image. A target connected domain is selected from the plurality of first connected domains. The stripe set based on the target connected domain is determined to determine a stripe pattern. A center of the stripe pattern is calculated according to the target connected domain of the stripe set. Whether the stripe set is an effective stripe set is determined based on the center of the stripe pattern. The method can eliminate the impact of incomplete stripe pattern on the image and improve the accuracy of recognition.

Abstract: A method and device for communication connection are provided. The method may include: sending by a host device, a broadcast connection request to slave device according to a first timer and a broadcast frequency hopping information of the host device; the broadcast connection request being used to set the currently used frequency hopping information by a target slave device as the communication frequency hopping information; receiving by a the host device, a broadcast acknowledgement response sent from the slave device, sending by the host device, a connection request to the slave device having sent the broadcast acknowledgement response, according to the first timer and the communication frequency hopping information; and establishing by the host device, a communication connection with the slave device having sent the broadcast acknowledgement response. This method can reduce the delay of establishing a communication connection between a host device and a slave device.