Abstract: An augmented reality or virtual reality (AR/VR) device pairs with a companion device to augment input interfaces associated with an AR/VR application at the AR/VR device. In implementations, an AR/VR device determines a portion of a markup file that corresponds to an AR/VR scene of a plurality of AR/VR scenes in an AR/VR environment, and communicates the portion of the markup file to the companion device to cause the companion device to configure a companion user interface associated with initiating an action as part of the AR/VR scene. In response to receiving user input via the companion user interface, the companion device communicates the action to the AR/VR device to initiate the action. The AR/VR device receives input data from the companion device, and initiates the action for the AR/VR scene.

Abstract: A method for determining a series of gaze positions of at least one eye over time is provided. The method comprises capturing a video of a user's face simultaneously with displaying a stimulus video on a screen and extracting at least one color component for each one of a plurality of images obtained from the video of the user's face. Based on the at least one color component for each one of the plurality of images, the series of gaze positions of the user's face over the time of the video is determined. A system for determining a series of gaze positions of at least one eye over time is also provided.

Abstract: A method of controlling a portable device including first and second touch screens is provided. The method includes displaying first information related to a first application on the first touch screen and displaying second information related to the first application on the second touch screen; receiving a first user input moving to the first touch screen on the second touch screen; and replacing the first information and the second information with a third information and a fourth information related to the first application on the first and second touch screens, in response to receiving the first user input, wherein each of the third information and the fourth information is displayed while being slidden from the second touch screen to the first touch screen and the third information is displayed over a boundary between the first and second screens during the sliding of the third and fourth information.

Abstract: The present disclosure relates to a method of displaying visual information to a user that includes tracking a location of the user within a pre-defined region, determining a current display screen from a plurality of display screens installed in the pre-defined region, based on current user location, determining a current display position on the current display screen based on the current user location, wherein the current display position is at a pre-defined distance from the current user location, and displaying the visual information on the current display position.

Abstract: Provided is an apparatus comprising: a determination unit configured to determine a first region to be viewed by a user in a display screen; a detection unit configured to detect a user's visual line; and a display control unit configured to change a display mode of the first region in response to the first region being not viewed.

Abstract: Methods and systems may provide for a gyratory sensing system (GSS) for extending the human machine interface (HMI) of an electronic device, particularly small form factor, wearable devices. The gyratory sensing system may include a gyratory sensor and a rotatable element to engage the gyratory sensor. The rotatable element may be sized and configured to be easily manipulated by hand to extend the HMI of the electronic device such that the functions of the HMI may be more accessible. The rotatable element may include one or more rotatable components, such as a body, edge or face of a smart watch, that each may be configured to perform a function upon rotation, such as resetting, selecting, and/or activating a menu item.

Abstract: A joystick includes a first structural component, a second structural component, a light emitter, an optical sensor and a processor. The second structural component is assembled with the first structural component to form a chamber. The light emitter is disposed inside the chamber for illuminating one surface of the second structural component. The optical sensor is disposed inside the chamber for capturing the illuminated surface of the second structural component. The processor is electrically connected to the optical sensor and adapted to analyze an intensity distribution of the illuminated surface for determining if the joystick is obliquely pressed or laterally shifted in a relative manner.

Abstract: A lighting apparatus with an image-projecting function that is convenient for a user is provided. It includes: an illuminating unit that emits illumination light; a projection-type image display unit that emits image-projecting emission light for projecting an image; and a sensor that emits operation-detecting light for operation detection and that is capable of detecting an operation by an operation object in a range including an image projection area of the projection-type image display unit, and is configured so that the image-projecting light, and the operation-detecting emission light have respective different wavelength distribution characteristics, and regarding a light amount in the wavelength range of light used by the sensor for the operation detection, a light amount of the operation-detecting light is the largest among those of the illumination light, the image-projecting emission light, and the operation-detecting light.

Abstract: While displaying a first view of a three-dimensional environment corresponding to a first viewpoint, a computer system detects a change in grip of a user's hand into a first predefined grip in conjunction with detecting a gaze input directed to a respective position in the three-dimensional environment. If the respective position is a first position, the computer system replaces the first view with a second view of the three-dimensional environment corresponding to a second viewpoint that is selected in accordance with the respective movement of the user's hand and the first position in the three-dimensional environment; and if the respective position is a second position, the computer system replaces the first view with a third view of the three-dimensional environment corresponding to a third viewpoint that is selected in accordance with the respective movement of the user's hand and the second position in the three-dimensional environment.

Abstract: Systems and methods for through-display imaging. An optical imaging sensor is positioned at least partially behind a display and is configured to emit shortwave infrared light at least partially through the display to illuminate an object, such as a fingerprint, in contact with an outer surface of the display. Surface reflections from the object are received and an image of the object can be assembled.

Abstract: Provided is a display device. The display device includes a first processor, a second processor, and a display screen. The first processor is configured to acquire at least two OSD images, and to form a combined image with at least two OSD images and send the combined image to the second processor. The second processor is electrically coupled to the first processor and is configured to receive the combined image, identify at least two OSD images from the combined image, acquire a first screen and acquire a second screen by superimposing at least two OSD images onto the first screen, and output the second screen to the display screen. The display screen is electrically coupled to the second processor and is configured to display the second screen.

Abstract: A pixel according to the present disclosure includes a light emitting diode including an anode coupled to a first node; a first capacitor including a first electrode coupled to the first node, and a second electrode coupled to a second node; a first transistor including a gate electrode coupled to the second node, a first electrode coupled to a third node, and a second electrode coupled to a fourth node; and a second transistor including a gate electrode coupled to a first scan line, a first electrode coupled to a data line, and a second electrode coupled to the third node.

Abstract: An optical display, including a first waveguide having a first set of surfaces, an input grating, a fold grating, and an output grating; an image input image node assembly; and a prismatic relay optics is provided. The prismatic relay optics may be configured to be optomechanically connected to the waveguide and the input image node assembly. The optical display is may also be configured to operate alone or as integrated with a headpiece to be used as a HUD. The HUD may have a first and a second configuration wherein the waveguide is decoupled or coupled.

Abstract: A computer implemented method for energy or resource management of a human-machine interface comprises the following steps carried out by computer hardware components of the human-machine interface: determining a level of attention of a user of the human-machine interface to the human-machine interface; and setting an energy and/or resource utilization related setting of the human-machine interface based on the determined level of attention.

Abstract: Embodiments relate to a dynamic image capturing method and apparatus using an arbitrary viewpoint image generation technology, in which an image of background content displayed on a background content display unit or an image of background content implemented in a virtual space through a chroma key screen, having a view matching to a view of seeing a subject at a viewpoint of a camera is generated, and a final image including the image of the background content and a subject area is obtained.

Abstract: A display system includes a display and a detector configured to detect an orientation of the display. The display system includes a display source image generation unit configured to generate a display source image including a first image and a second image related to this first image; and a visual field image display unit configured to display the first image in a first display region of the display and display the second image in a second display region of the display. The visual field image display unit is configured to set a predetermined fixed region of the display as the first display region when a display mode associated with the first image is a first display mode, and determine the first display region according to the orientation of the display when the display mode is a second display mode.

Abstract: In some examples an electronic device includes an image sensor and a processor. The processor is to determine an angle of an eye gaze of a user in relation to an optical axis of the image sensor and adjust, responsive to a determination that the angle exceeds a threshold angle, an active area of a display device.

Abstract: Display panel, light sensing detection method thereof and display device are provided. The display panel includes a plurality of light sensing detection units. A light sensing detection unit of the plurality of light sensing detection units includes a light sensing detection circuit. The light sensing detection circuit corresponding to a same light sensing detection unit includes N light sensing detection branches connected in parallel, a light sensing detection branch of the N light sensing detection branches includes a storage capacitor, and N?2. The N light sensing detection branches include a first light sensing detection branch and a second light sensing detection branch. The storage capacitor includes a first storage capacitor located in the first light sensing detection branch and a second storage capacitor located in the second light sensing detection branch. A capacitance of the first storage capacitor is greater than a capacitance of the second storage capacitor.

Abstract: Techniques for establishing a biomechanical model of a user performing motion are described. A plurality of sensor modules corresponding to a set of designated body parts (e.g., arms or legs) of the user generate sensing signals when the user performs a pose. Sensing data including accelerometers and/or gyroscopes data generated from the sensing signals is analyzed to detect a medio-lateral direction of each of the designated body parts to infer the pose from the captured motion of the user.

Abstract: A system for modulating user commands via command input images displayed on a graphical user interface based on a user viewing direction relative to the displayed command input images and the graphical user interface. An image capturing device captures real time images of a user's face, eyes and irises and determines the eye orientation. The graphical user interface is separated into interface portions and the system determines if any of the foregoing are viewed portions. The system determines whether a viewed portion contains a command input image and only allows user input commands via the command input image to be processed if the image is within a viewed portion. The system can modulate a position of a command input image displayed on a graphical user interface based on a user viewing direction relative to graphical user interface thereby moving an input image on the graphical user interface.