Abstract: A computing system may receive sensor data from one or more sensors coupled to a user. Based on sensor data, the computing system may generate a first upper body pose that corresponds to a first portion of a body of the user, which comprises a head and an arm of the user. The computing system may process the upper body pose of the user to generate a temporal sequence of lower body poses comprising a first lower body pose associated with the first time and a second lower body pose associated with a second time, which may correspond to a second portion of the body of the user comprising a leg of the user. The computing system may generate one or more full body poses of the user based on at least the first upper body pose and the temporal sequence of lower body poses.

Abstract: Accordingly, embodiments herein disclose a method for providing real-time virtual feedback using an electronic device. The method includes receiving, by the electronic device, motion data of each segment in a multi-segment body part of a first user. Further, the method includes determining, by the electronic device, a posture information of each of the segment in the multi-segment body part based on the motion data of each of the segment in the multi-segment body part of the first user. Further, the method includes determining, by the electronic device, a degree of similarity between the posture information of each of the segment in the multi-segment body part of the first user and a posture information of each segment in a multi-segment body part of a second user. Further, the method includes providing, by the electronic device, a virtual feedback to the first user based on the degree of similarity.

Abstract: An electromagnetic tracking system includes a handheld controller including a first phased array element characterized by a first phase and a second phased array element characterized by a second phase different than the first phase. The first phased array element and the second phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern. The electromagnetic tracking system also includes a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern.

Abstract: In some implementations, a method includes: obtaining first input data while presenting a computer-generated reality (CGR) environment from the perspective of a first character associated with a first time slice within predetermined content; determining whether or not the first input data satisfies first performance criteria associated with the first character for the first time slice within the predetermined content; and, in response to determining that the first input data satisfies the first performance criteria associated with the first character for the first time slice within the predetermined content, updating the CGR environment from the perspective of the first character associated with a second time slice within the predetermined content.

Abstract: An information processing device includes an eyeball information acquisition section, a sightline estimation section, a display control section, a gesture information acquisition section, and a mode switching section. The eyeball information acquisition section acquires position and posture information of eyeballs of a user from a first sensor. The sightline estimation section estimates a sightline vector on the basis of the position and posture information of the eyeballs. The display control section controls a display device in such a manner that the display device displays a guide image for showing a gaze state based on the sightline vector. The gesture information acquisition section acquires gesture information, which is different from the position and posture information of the eyeballs, from a second sensor.

Abstract: In one embodiment, the system may determine an estimated distance of an eye of a user to a display plane of a display. The system may access, from a memory storage, a number of transmission maps characterizing non-uniform transmission characters of the display as measured from a number of pre-determined view positions within a measurement plane. The measurement plane may be separated from the display plane by a known distance. The system may generate a custom transmission map for the estimated distance of the eye based on the transmission maps using light field rendering. The system may determine a custom correction map based on the custom transmission map. The system may adjust an image to be displayed on the display using the custom correction map. The system may display the image adjusted using the custom correction map on the display.

Abstract: A display device includes a first pixel driver connected to a sweep line, the first pixel driver generating a control current based on a first data voltage, a second pixel driver connected to a scan control line, the second pixel driver generating a driving current based on a second data voltage and controlling a period for which the driving current flows, based on the control current, and a light-emitting element connected to the second pixel driver to receive the driving current. The first pixel driver includes a first transistor generating the control current based on the first data voltage, a second transistor providing the first data voltage to a first electrode of the first transistor based on a scan write signal, and a first capacitor including a first capacitor electrode connected to a gate electrode of the first transistor, and a second capacitor electrode connected to the sweep line.

Abstract: Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.

Abstract: A display device includes: a first pixel driver to generate a control current; a second pixel driver to generate a driving current, and control a period during which the driving current flows, based on the control current; and a light-emitting element connected to the second pixel driver to receive the driving current. The first pixel driver includes: a first transistor to generate the control current based on a first data voltage; and a second transistor to provide the first data voltage to a first electrode of the first transistor based on a scan write signal from a scan write line. The second pixel driver includes: a third transistor to generate the driving current based on the control current; and a fourth transistor to provide a second data voltage to a first electrode of the third transistor based on a scan write signal from the scan write line.

Abstract: A system and a method for determining a gaze direction of a user viewing a scene is provided. The system comprises a camera for obtaining an image of at least one of the user's eyes, a depth information detection device for obtaining depth data related to the image, and a processing unit. The processing unit is configured to define a surface at a predetermined position relative to the user's eye based on the depth data, obtain a normalized image by projecting the image onto the surface and determine a normalized gaze direction based on the normalized image. The processing unit is further configured to determine a gaze direction based on the normalized gaze direction and the depth data.

Abstract: A device includes a display and an internal strap coupled to the display, the internal strap being adjustable to secure the device to the user. The device also includes a deformable material coupled to a portion of the internal strap and configured to contact the user when the device is secured to the user and a backing layer disposed against the deformable material, the backing layer including an aperture therein. The device further includes a switch coupled to the backing layer and configured such that at least a portion of the switch is insertable in the aperture of the backing layer, wherein the deformable material is configured to deform when the device is secured to the user, thereby causing the switch to be positioned in a first position when the device is secured to the user and a second position when the device is removed from the user.

Abstract: A conventional head-mounted display (HMDs) can display a virtual image at a fixed focus (e.g., infinite focus). If the user looks at an object that appears closer than the virtual image, then accommodation by the user's eyes will cause the virtual image to appear blurry. The HMDs disclosed herein include a dynamic electro-active focusing element that changes the focus of the virtual image to account for accommodation by the user. This dynamic electro-active focusing element may include a curved layer of electro-active material, such as nematic or bi-stable (e.g., cholesteric) liquid crystal, disposed between a static concave mirror and a convex surface on a beam splitter or other optical element. Changing the refractive index of the electro-active material causes the focus of the dynamic electro-active focusing element, making it possible to shift the virtual image's focus in as the user's eyes change focus.

Abstract: The present disclosure relates to a communication method and system for converging a 5th-Generation (5G) communication system for supporting higher data rates beyond a 4th-Generation (4G) system with a technology for Internet of Things (IoT). According to the present disclosure, a method performed by a first electronic device displaying AR content comprises obtaining measurement time information about a time when a user's pose is measured and measurement pose information about the measured pose, generating a first report including the measurement time information and the measurement pose information, transmitting the first report to a second electronic device, receiving a predicted image for a target point generated by the second electronic device, and displaying an AR image at the target point based on the predicted image.

Abstract: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.

Abstract: A display device including a display panel including a planar portion and a curved portion extending from the planar portion, a controller to provide a data signal representing an image to be displayed on the planar portion and the curved portion to the display panel, in which the controller is configured to provide a data signal representing an image that is reduced at a greater extent to a portion of the curved portion that is disposed further away from the planar portion, and the display device is a head-mounted display device.

Abstract: In one embodiment, the system may determine an estimated distance of an eye of a user to a display plane of a display. The system may access, from a memory storage, a number of transmission maps characterizing non-uniform transmission characters of the display as measured from a number of pre-determined view positions within a measurement plane. The measurement plane may be separated from the display plane by a known distance. The system may generate a custom transmission map for the estimated distance of the eye based on the transmission maps using light field rendering. The system may determine a custom correction map based on the custom transmission map. The system may adjust an image to be displayed on the display using the custom correction map. The system may display the image adjusted using the custom correction map on the display.

Abstract: An immersive virtual reality experience is provided. A plurality of areas within a virtual environment are determined. The plurality of areas includes at least a first area and a second area. A plurality of videos associated with the virtual environment are presented. The plurality of videos include a first video associated with the first area and a second video associated with the second area. The first video has a first quality, and the second video has a second quality lower than the first quality. A three-dimensional model of a first object is overlaid in the virtual environment.

Abstract: An electronic apparatus is provided. The electronic apparatus includes a camera; a memory configured to store at least one instruction; and at least one processor configured to execute the at least one instruction to: detect at least one object included in an image captured by the camera; identify information on an engagement of each of the at least one object with the electronic apparatus; obtain gesture information of each of the at least one object; obtain a target object from among the at least one object based on an operation status of the electronic apparatus, the information on the engagement of each of the at least one object, and the obtained gesture information of each of the at least one object; identify a function corresponding to gesture information of the target object; and execute the identified function.

Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.

Abstract: According to an aspect, a detection device includes: a substrate that has a detection region; a plurality of photodiodes provided in the detection region; a plurality of lenses provided so as to overlap the respective photodiodes; and a plurality of dummy lenses that are provided in a peripheral region between an outer perimeter of the detection region and edges of the substrate and are provided so as not to overlap the photodiodes.