Abstract: Some implementations disclosed herein present a computer-generated reality (CGR) environment in which a user participates in an activity, identify a cognitive state of the user (e.g., working, learning, resting, etc.) based on data regarding the user's body (e.g., facial expressions, hand movements, physiological data, etc.), and update the environment with a surrounding environment that promotes a cognitive state of the user for the activity.

Abstract: A method for operating a head-mounted display device is presented. An RF face tracking system is operated at a first, lower power level. Based at least on an output of the RF face tracking system while operating at the first, lower power level, a first likelihood is determined that the head-mounted display device is positioned on a head of a user. If the first likelihood is greater than a first confidence threshold, the RF face tracking system is operated at a second, higher power level. A second likelihood that the head-mounted display device is positioned on the head of the user is determined based at least on an output of the RF face tracking system while operating at the second, higher power level. If the second likelihood is greater than a second confidence threshold, an eye-tracking system of the head-mounted display device is activated.

Abstract: A hand-mounted position-tracking device includes a plurality of position-tracking subsystems. Each position-tracking subsystem is associated with a different digit of a hand and includes a magnet and a sensor that generates a signal based on a distance between the magnet and the sensor. Each position-tracking subsystem further includes a rotatable coupling that rotationally couples the magnet to the sensor.

Abstract: Aspects of the disclosure relate to identifying and utilizing head and eye gestures, using a wearable computing device. The wearable computing device may include an electrooculography electrode configured to provide first feedback to one or more processors as well as an inertial measurement unit configured to provide second feedback to the one or more processors. The first feedback may correspond to eye movement, and the second feedback may correspond to head movement. The wearable computing device may also include the one or more processors which may be configured to use the first feedback and these second feedback to determine whether the head movement and eye movement correspond to a trigger for an action as well as to cause the wearable computing device to perform the action based on the determination.

Abstract: The invention provides a method for dynamically adjusting user interface, an electronic device and a computer-readable storage medium. The method includes: displaying a user interface, wherein the user interface partially displays a first block, and the first block includes at least one layer; monitoring a first moving direction of a first specific object; in response to determining that the first specific object moves toward the first block, moving at least one of the at least one layer in the first block toward a reference point in the user interface.

Abstract: Systems and methods are described herein for controlling a smart glass display based on environmental conditions. The smart glass display may be configured for presenting a media asset. Further, the smart glass display is configured with a transparent display function that adjusts the presentation of the media asset based on the environmental conditions. The smart glass display may identify environmental information and determine a hazard based on the environmental information. Further, a smart glass display may observe the user's eye movement and may execute a specific function corresponding to the user's eye movement.

Abstract: A VR (Virtual Reality) simulator acquires a virtual space image by imaging a virtual space from a virtual user position corresponding to a real user position. The VR simulator draws the virtual space image on a curved screen installed at a position distant from a user. A virtual screen position in a virtual space corresponds to the installation position of the curved screen. An inverse curved screen is placed at the virtual screen position and curved inversely to the curved screen. The VR simulator acquires a first virtual space image by imaging the virtual space from the virtual user position, and draws the first virtual space image on the inverse curved screen. Further, the VR simulator acquires a second virtual space image by imaging the first virtual space image on the inverse curved screen from the virtual user position, and draws the second virtual space image on the curved screen.

Abstract: A computing system may receive sensor data from one or more sensors coupled to a user. Based on sensor data, the computing system may generate a first upper body pose that corresponds to a first portion of a body of the user, which comprises a head and an arm of the user. The computing system may process the upper body pose of the user to generate a temporal sequence of lower body poses comprising a first lower body pose associated with the first time and a second lower body pose associated with a second time, which may correspond to a second portion of the body of the user comprising a leg of the user. The computing system may generate one or more full body poses of the user based on at least the first upper body pose and the temporal sequence of lower body poses.

Abstract: Accordingly, embodiments herein disclose a method for providing real-time virtual feedback using an electronic device. The method includes receiving, by the electronic device, motion data of each segment in a multi-segment body part of a first user. Further, the method includes determining, by the electronic device, a posture information of each of the segment in the multi-segment body part based on the motion data of each of the segment in the multi-segment body part of the first user. Further, the method includes determining, by the electronic device, a degree of similarity between the posture information of each of the segment in the multi-segment body part of the first user and a posture information of each segment in a multi-segment body part of a second user. Further, the method includes providing, by the electronic device, a virtual feedback to the first user based on the degree of similarity.

Abstract: An electromagnetic tracking system includes a handheld controller including a first phased array element characterized by a first phase and a second phased array element characterized by a second phase different than the first phase. The first phased array element and the second phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern. The electromagnetic tracking system also includes a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern.

Abstract: In some implementations, a method includes: obtaining first input data while presenting a computer-generated reality (CGR) environment from the perspective of a first character associated with a first time slice within predetermined content; determining whether or not the first input data satisfies first performance criteria associated with the first character for the first time slice within the predetermined content; and, in response to determining that the first input data satisfies the first performance criteria associated with the first character for the first time slice within the predetermined content, updating the CGR environment from the perspective of the first character associated with a second time slice within the predetermined content.

Abstract: An information processing device includes an eyeball information acquisition section, a sightline estimation section, a display control section, a gesture information acquisition section, and a mode switching section. The eyeball information acquisition section acquires position and posture information of eyeballs of a user from a first sensor. The sightline estimation section estimates a sightline vector on the basis of the position and posture information of the eyeballs. The display control section controls a display device in such a manner that the display device displays a guide image for showing a gaze state based on the sightline vector. The gesture information acquisition section acquires gesture information, which is different from the position and posture information of the eyeballs, from a second sensor.

Abstract: In one embodiment, the system may determine an estimated distance of an eye of a user to a display plane of a display. The system may access, from a memory storage, a number of transmission maps characterizing non-uniform transmission characters of the display as measured from a number of pre-determined view positions within a measurement plane. The measurement plane may be separated from the display plane by a known distance. The system may generate a custom transmission map for the estimated distance of the eye based on the transmission maps using light field rendering. The system may determine a custom correction map based on the custom transmission map. The system may adjust an image to be displayed on the display using the custom correction map. The system may display the image adjusted using the custom correction map on the display.

Abstract: A display device includes a first pixel driver connected to a sweep line, the first pixel driver generating a control current based on a first data voltage, a second pixel driver connected to a scan control line, the second pixel driver generating a driving current based on a second data voltage and controlling a period for which the driving current flows, based on the control current, and a light-emitting element connected to the second pixel driver to receive the driving current. The first pixel driver includes a first transistor generating the control current based on the first data voltage, a second transistor providing the first data voltage to a first electrode of the first transistor based on a scan write signal, and a first capacitor including a first capacitor electrode connected to a gate electrode of the first transistor, and a second capacitor electrode connected to the sweep line.

Abstract: Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.

Abstract: A display device includes: a first pixel driver to generate a control current; a second pixel driver to generate a driving current, and control a period during which the driving current flows, based on the control current; and a light-emitting element connected to the second pixel driver to receive the driving current. The first pixel driver includes: a first transistor to generate the control current based on a first data voltage; and a second transistor to provide the first data voltage to a first electrode of the first transistor based on a scan write signal from a scan write line. The second pixel driver includes: a third transistor to generate the driving current based on the control current; and a fourth transistor to provide a second data voltage to a first electrode of the third transistor based on a scan write signal from the scan write line.

Abstract: A system and a method for determining a gaze direction of a user viewing a scene is provided. The system comprises a camera for obtaining an image of at least one of the user's eyes, a depth information detection device for obtaining depth data related to the image, and a processing unit. The processing unit is configured to define a surface at a predetermined position relative to the user's eye based on the depth data, obtain a normalized image by projecting the image onto the surface and determine a normalized gaze direction based on the normalized image. The processing unit is further configured to determine a gaze direction based on the normalized gaze direction and the depth data.

Abstract: A device includes a display and an internal strap coupled to the display, the internal strap being adjustable to secure the device to the user. The device also includes a deformable material coupled to a portion of the internal strap and configured to contact the user when the device is secured to the user and a backing layer disposed against the deformable material, the backing layer including an aperture therein. The device further includes a switch coupled to the backing layer and configured such that at least a portion of the switch is insertable in the aperture of the backing layer, wherein the deformable material is configured to deform when the device is secured to the user, thereby causing the switch to be positioned in a first position when the device is secured to the user and a second position when the device is removed from the user.

Abstract: A conventional head-mounted display (HMDs) can display a virtual image at a fixed focus (e.g., infinite focus). If the user looks at an object that appears closer than the virtual image, then accommodation by the user's eyes will cause the virtual image to appear blurry. The HMDs disclosed herein include a dynamic electro-active focusing element that changes the focus of the virtual image to account for accommodation by the user. This dynamic electro-active focusing element may include a curved layer of electro-active material, such as nematic or bi-stable (e.g., cholesteric) liquid crystal, disposed between a static concave mirror and a convex surface on a beam splitter or other optical element. Changing the refractive index of the electro-active material causes the focus of the dynamic electro-active focusing element, making it possible to shift the virtual image's focus in as the user's eyes change focus.

Abstract: The present disclosure relates to a communication method and system for converging a 5th-Generation (5G) communication system for supporting higher data rates beyond a 4th-Generation (4G) system with a technology for Internet of Things (IoT). According to the present disclosure, a method performed by a first electronic device displaying AR content comprises obtaining measurement time information about a time when a user's pose is measured and measurement pose information about the measured pose, generating a first report including the measurement time information and the measurement pose information, transmitting the first report to a second electronic device, receiving a predicted image for a target point generated by the second electronic device, and displaying an AR image at the target point based on the predicted image.