Abstract: A human body portion tracking method is provided and including obtaining a first image from an image capturing apparatus; identifying a first reference point and a second reference point from the first image; determining a position relationship between a first section and a second section of the human body portion according to three-dimensional coordinates of the first reference point and the second reference point; obtaining a second image from the image capturing apparatus; identifying a third reference point from the second image.

Abstract: A method and an apparatus related to multiple modes are provided. In the method, the first mode is operated. The first mode is a host mode or a client mode, and the host mode is configured for broadcasting information related to a global coordinate system to a device operated with the client mode. A switching condition is detected, and the first mode is switched to the second mode. The second mode is another one of the host mode and the client mode. The second mode is operated. Therefore, the positioning information of a global coordinate system can be provided for motion sensing apparatuses.

Abstract: A method and an apparatus related to sentence generation are provided. In the method, a known token is determined based on a first sentence. A second sentence is determined based on the known token and a first masked token through a language model. The first masked token and the known token are inputted into the language model, to determine a first predicted token corresponding to the first masked token. The language model is trained based on an encoder of a bidirectional transformer. A second masked token is inserted when the determined result of the first predicted token is determined. The second masked token is inputted into the language model, to determine a second predicted token corresponding to the second masked token. The second sentence includes the first predicted token, the second predicted token and the known token. The second sentence is a sentence to respond to the first sentence.

Abstract: A system and a method related to data fusing are provided. The first and second sensing data are obtained. The data combination is determined based on the first and second sensing data. The third sensing data is obtained based on images. Whether the human body portion exists in the third sensing data is determined during the first duration. The motion information is determined by a first determining factor, which includes the data combination and the third sensing data of the first duration, in response to the human body portion existing in the third sensing data. The motion information is determined by a second determining factor, which includes the data combination and the third sensing data of the second duration, in response to the human body portion not existing in the third sensing data. The human body portions of the user exist in the third sensing data during the second duration.

Abstract: A method and an apparatus related to multiple modes are provided. In the method, the first mode is operated. The first mode is a host mode or a client mode, and the host mode is configured for broadcasting information related to a global coordinate system to a device operated with the client mode. A switching condition is detected, and the first mode is switched to the second mode. The second mode is another one of the host mode and the client mode. The second mode is operated. Therefore, the positioning information of a global coordinate system can be provided for motion sensing apparatuses.

Abstract: A method and an apparatus for rendering three-dimensional objects in an XR environment are provided. The first part of a first object is presented on a first render pass with a second object and without the second part of the first object. The first part is nearer to the user side than the second object. The second object is nearer to the user side than the second part. The second part is presented on a second render pass with the second object and without the first part. A final frame is generated based on the first render pass and the second render pass. The first and the second parts of the first object and the second object are presented in the final frame, and the final frame is used to be displayed on a display. Accordingly, a flexible way to render three-dimensional objects is provided.

Abstract: A method and a system for showing a cursor for user interaction on a display device are provided. In the method, a reference position initialized at the end of a ray cast emitted from the user side is determined. A target position, which moves with a human body portion of a user, is determined. The target position is different from the reference position. A modified position is determined based on the reference position and the target position. The reference, target, and the modified positions are located on the same plane parallel with the user side. The modified position is different from the target position. The modified position is used as the current position of the cursor. The modified position represents a position of the end of the ray cast emitted from the user side currently. Accordingly, the cursor may be steady in the extended reality.

Abstract: A method for adjusting skin tone of an avatar and an avatar skin tone adjusting system are provided. The method includes: obtaining an incident angle of a virtual environment light and a skin thickness value corresponding to a first skin fragment of the skin fragments; determining a skin tone adjusting parameter based on the incident angle of the virtual environment light and the skin thickness value corresponding to the first skin fragment of the avatar; and adjusting a skin tone of the first skin fragment based on a default skin tone of the first skin fragment and the skin tone adjusting parameter of the first skin fragment before rendering the avatar.

Abstract: A head mounted display and a control method thereof are provided. In the method, a first equipment information is received from a first equipment, and a second equipment information is received from a second equipment. The first equipment is identified as a first controllable equipment of the head mounted display, and the second equipment is identified as a second controllable equipment of the head mounted display. Accordingly, multiple equipments can be identified and further controllable.

Abstract: A human body portion tracking method and a human body portion tracking system are provided. In the method, a first image is obtained from an image capturing apparatus. The first image captures a first section and a second section of a human body portion at a first time point. A first reference point and a second reference point are identified from the first image. The first reference point indicates the location of the first section at the first time point, and the second reference point indicates the location of a second section at the first time point. A position relationship between the first section and the second section is determined according to the three-dimensional coordinates of the first and second reference points. A second image is obtained from the image capturing apparatus. The second image captures the first section but not the second section at a second time point. A third reference point from the second image is identified.

Abstract: A method and an electronic apparatus of modifying a three-dimensional model are provided. In the method, multiple two-dimensional images are obtained by scanning a real environment Real objects of the real environment are identified in the two-dimensional images. A three-dimensional model is generated based on the two-dimensional images. The three-dimensional model is related to the depth information of the real objects. A modifying operation for modifying one or more virtual objects in the three-dimensional model is received. The virtual objects are corresponding to one or more real objects. The modifying operation is mapped into the two-dimensional images based on the identified result of the real objects in the two-dimensional image and the depth information of the real objects, to generate a modified image. A modified three-dimensional model is generated based on the modified image, to provide a proper modified result.

Abstract: A virtual object operating method and a virtual object operating system are provided. In the method, a manipulating portion on a virtual object pointed by a user and an object type of the virtual object are identified, and the object type includes a virtual creature created in a virtual reality environment. A manipulating action performed by the user is identified, and the manipulating action is corresponding to the virtual object. An interacting behavior of an avatar of the user with the virtual object is determined according to the manipulating portion, the object type, and the manipulating action. Accordingly, a variety of interacting behaviors is provided.

Abstract: An avatar facial expression generating system and a method of avatar facial expression generation are provided. In the method, multiple user data are obtained and related to the sensing result of a user from multiple data sources. Multiple first emotion decisions are determined, respectively, based on each user data. Whether an emotion collision occurs among the first emotion decisions is determined. The emotion collision is related that the corresponding emotion groups of the first emotion decisions are not matched with each other. A second emotion decision is determined from one or more emotion groups according to the determining result of the emotion collision. The first or second emotion decision is related to one emotion group. A facial expression of an avatar is generated based on the second emotion decision. Accordingly, a proper facial expression of the avatar could be presented.

Abstract: A method and a system for modifying the position of a cursor are provided. In the method, the depth information of a human body portion of a user is determined. The user uses the human body portion to move the cursor. The cursor is located at the end of a ray cast emitted from a user side, and the user's head wears a head mounted display. The first position of the cursor is determined. The second position of the cursor different from the first position is determined based on the depth information of the human body portion and the first position. The second position is used as the current position of the cursor, and the current position is located at the end of a ray cast emitted from the user currently. Accordingly, it is easy to control the cursor for different heights or arm lengths.

Abstract: A head mounted display system includes a scanning unit and a processing unit. The scanning unit is configured to scan a real object in a real environment so as to generate a scanning result. The processing unit is coupled to the scanning unit. The processing unit is configured to identify the real object according to the scanning result of the scanning unit, determine at least one predetermined interactive characteristic according to an identification result of the processing unit, create a virtual object in a virtual environment corresponding to the real object in the real environment according to the scanning result of the scanning unit, and assign the at least one predetermined interactive characteristic to the virtual object in the virtual environment. Therefore, the present disclosure allows a user to manipulate the virtual object in different ways more naturally, which effectively improves the user's interactive experience.

Abstract: An avatar facial expression generating system and a method of avatar facial expression generation are provided. In the method, user data relating to sensing result of a user is obtained. A first and a second emotional configurations are determined. The first and second emotional configuration maintain during a first and a second duration, respectively. A transition emotional configuration is determined based on the first emotional configuration and the second emotional configuration, in which the transition emotional configuration maintains during a third duration. Facial expressions of an avatar are generated based on the first emotional configuration, the transition emotional configuration, and the second emotional configuration, respectively. The third duration exists between the first duration and the second duration. Accordingly, a normal facial expression on an avatar would be presented while encountering the emotion transformation.

Abstract: A head mounted display system and a rotation center correcting method thereof are provided. The head mounted display system is wearable on a user's head and includes a main body, a sensor, and a processor. The sensor is disposed at the main body and obtains sensing data corresponding to at least one pose of the user's head. The processor is coupled to the sensor and configured to generate pose data of the user's head based on the sensing data, and generate rotation center information of the user's head based on the pose data, wherein the rotation center information is related to a center corresponding to rotation of the user's head. Accordingly, the center of the rotation can be adjusted for different users.

Abstract: An interactive image processing system including a first infrared camera, a second infrared camera, an image processing circuit, a vision processing unit, an image signal processor, a central processing unit, and a memory device is disclosed. The present disclosure calculates depth data according to infrared images generated by the first and second infrared cameras to improve depth quality.