Abstract: Three-dimensional image calibration and presentation for eyewear including a pair of image capture devices is described. Calibration and presentation includes obtaining a calibration offset to accommodate flexure in the support structure for the eyewear, adjusting a three-dimensional rendering offset by the obtained calibration offset, and presenting the stereoscopic images using the three-dimension rendering offset.

Abstract: The present disclosure generally relates to controlling electronic devices. In some examples, the electronic device uses gaze information to activate a digital assistant. In some examples, the electronic device uses gaze information to identify an external device on which to act. In some examples, the electronic device provides an indication that distinguishes between different speakers.

Abstract: A method, a processing unit, and a non-transitory computer-readable medium for controlling viewpoint of attendees in immersive environment are disclosed. For controlling viewpoint, initially, presenter input is received. Presenter input indicates objects selected amongst plurality of objects displayed in 360° view of a content in immersive environment. Further, the objects to be displayed are dynamically fixed within viewpoint across the 360° view of the attendees. The objects are dynamically fixed within viewpoint irrespective of inputs received from the attendees to change objects within viewpoint. New objects, amongst the plurality of objects are detected based on at least one of real-time preferences of the attendees and real-time context of the content provided by the presenter. Upon detecting the new objects, the objects are dynamically re-fixed within the viewpoint of the attendees.

Abstract: Some examples of the disclosure are directed to systems and methods for facilitating display of content and avatars in a multi-communication session including a first electronic device and a second electronic device. In some examples, the first electronic device presents a computer-generated environment including an avatar corresponding to a user of the second electronic device and a first object, wherein the computer-generated environment is presented based on a first set of display parameters satisfying a first set of criteria, including a spatial parameter for the user of the second electronic device, a spatial parameter for the first object, and a display mode parameter for the first object. In response to detecting a change in one or more of the first set of display parameters, the first electronic device updates presentation of the computer-generated environment in accordance with the one or more changes of the first set of display parameters.

Abstract: A haptics signal generator configured to generate a haptics signal for driving a haptics transducer by amplitude modulating and frequency modulating a carrier signal based on an input audio signal.

Abstract: A texture recognition device and a display device are provided. The texture recognition device includes a backlight element, configured to provide first backlight; a light constraint element, configured to perform a light divergence angle constraint process on the first backlight to obtain second backlight with a divergence angle within a preset angle range, the second backlight being transmitted to a detection object; and a photosensitive element, configured to detect the second backlight reflected by a texture of the detection object to recognize a texture image of the texture of the detection object.

Abstract: A method for controlling a display screen according to an eye focus and a head-mounted electronic device are provided. The method is applicable to the head-mounted electronic device, the head-mounted electronic device includes a display screen, and the display screen is transparent when display is turned off. Furthermore, the method can include displaying an image on the display screen, an eye focus of a user being within a first distance range. The method can further include turning off the display screen, when it is detected that a duration in which the eye focus of the user is not within the first distance range is greater than or equal to a first duration. The method can lower power consumption, and reduce impact of an image on watching a real world.

Abstract: An information processing device according to an embodiment of the present technology includes a movement-information acquisition unit, a gaze-information acquisition unit, and a display control unit. The movement-information acquisition unit acquires movement information about a gesture by a user. The gaze-information acquisition unit acquires information about a gazing point of the user. The display control unit controls a display device on the basis of the movement information. The display control unit causes the display device to display a first virtual object including information relating to a target object in a first region related to the target object, and to vary, on the basis of a position of the gazing point in duration for which the user is making the gesture, how the first virtual object is displayed.

Abstract: In some aspects, an electronic device may display a keyboard user interface on a touchscreen display panel. The electronic device may detect a key press interaction with the keyboard user interface. The electronic device may trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern that is based at least in part on a context associated with the key press interaction. Numerous other aspects are described.

Abstract: A gesture detection system is disclosed. The gesture detection system includes a gesture detection sensor including a base sheet formed of a skin-conformable material, to be tightly attached to a skin, a sensing part formed at the base sheet, to measure deformation of the skin, and an electrode pattern formed at the base sheet and connected, at one end thereof, to the sensing part, to transmit an electrical signal varying in accordance with the deformation of the skin, a reader module connected to the gesture detection sensor, to read the electrical signal, and a computing device configured to receive the electrical signal from the reader module, thereby recognizing a gesture of the user. Through disposable use of the gesture detection sensor and multiple use of the reader module and the computing device, a hygienic gesture input environment may be provided to a plurality of users at low cost.

Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

Abstract: Virtual assistant devices and related methods are described that allow users having special needs to communicate with the virtual assistant device. The virtual assistant devices are augmented with additional intelligent sensors, including, but not limited to, three-dimensional optical sensors that are used to capture optical signals of user's non-verbal communication (e.g., sign language, lip movements, gestures or the like). Additionally, the virtual assistant device includes an Artificial Intelligence (AI)-based engine that includes one or more Machine Learning (ML) models trained on user-specific data and used to determine the non-verbal communication of the user (i.e., sign language, lip movements or other gestures) based on inputs derived from the sensors. Moreover, the virtual assistant devices may be configured to generate and display visual information, such as three-dimensional floating avatars of the user and/or the virtual assistant.

Abstract: Provided is a method for identifying a gaze behavior in a three-dimensional space, comprising: acquiring eye movement data of the two eyes of a user; selecting, from the collected eye movement data, eye movement data for gaze behavior identification; calculating eye movement angular velocities, determining gaze point data corresponding to the gaze behavior; combining pieces of gaze point data, which satisfy a time proximity condition and a space proximity condition at the same time, in the gaze point data so as to obtain a gaze duration and the 3D coordinates of gaze points; and based on the combined pieces of gaze point data, determining a gaze point at which the gaze duration is longer than a second set duration, thereby identifying the gaze behavior.

Abstract: A display device includes a main body configured to have a display module to which an image is output, a bending module located at a center of a back surface of the main body, and a controller. The controller controls the bending module to change a curvature of the display module to any one of a flat mode in which the display module is flat, a first bending mode in which the display module has a first curvature, and a second bending mode in which the display module has a second curvature. The second curvature is a maximum curvature of the display module.

Abstract: A system includes an electronic contact lens that obtains sensor measurements from integrated motion sensors or other types of sensors and a processing module that estimates a mental state of an individual based on the sensor measurements. The processing module identifies patterns of eye movements and analyzes how these patterns change over time. Based on anatomical relationships between eye movement and mental state, the processing module estimates characteristics of the individual such as fatigue, intoxication, injury, or a medical condition that have known effects on eye movement patterns. The electronic contact lens system generates an output indicative of the estimated mental state to alert the individual to the detected condition or to initiate an automated action.

Abstract: Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.

Abstract: An electronic device includes a housing, a display at least partially within the housing, a cover positioned over the display and defining an input surface of the electronic device, a motion sensing system configured to detect a motion of the electronic device, and a touch sensor configured to detect, within a time window after the motion of the electronic device is detected, a contact of an input member of a user on the input surface of the electronic device. The electronic device is configured to determine, for a time prior to the detection of the contact, a relative motion between the input member and the input surface. In accordance with a determination that a characteristic of the relative motion satisfies a threshold condition, the electronic device may determine a second input location based at least in part on the location of the contact and the relative motion.

Abstract: An electronic device and a control method using the same are provided. The electronic device may include: a photoplethysmography (PPG) sensor having a plurality of channels arranged isotropically; and a processor configured to: detect a center of gravity of an external force applied to a measurement area of the PPG sensor by an object, based on PPG signals that are detected from the plurality of channels when the object is in contact with the measurement area of the PPG sensor, and generate a control command based on a change in the detected center of gravity.

Abstract: The present disclosure discusses systems and methods to detect blur in digital images. The solution can be incorporated into the quality control systems of pathology and other slide scanners or can be a stand-alone solution. The solution can identify scanned images that include blur and cause the scanner to automatically rescan the blurry image. The solution can also identify regions of the scanned image that include blur. The solution can generate blur maps for each of the scanned images that identify regions of the scanned image that include blur.

Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.

Abstract: Systems and methods for manual gesture recognition to control prosthetic devices. Low encumbrance systems utilizing glove-based recognition to control prosthetic devices. Prosthetic control systems and methods are also provided utilizing elements for application on the user's fingernails.

Abstract: The present disclosure provides a display device comprising an external device interface connected to an external device; an infrared sensor configured to detect an infrared control signal generated from a remote control device for the external device; and a processor is configured to: initialize an auto-off timer time to count an auto-off time, when a power of the display device is turned on, initialize the auto-off timer time when the infrared control signal generated from the remote control device for the external device is detected through the infrared sensor, and control the power to be turned off when the automatic off timer time reaches a preset un-used time.

Abstract: According to one embodiment, a method, computer system, and computer program product for selecting methods of interfacing between a smart headset and a user based on privacy risk is provided. The present invention may include determining a privacy context of the smart headset based on the location, surrounding environment, and content associated with a smart headset, selecting at least one output method and at least one input method compatible with the smart headset based on the security of the output method and the input method within the privacy context, and operating the smart headset to interface with a user using the at least one output method and the at least one input method.

Abstract: An assist device includes a first harness, a second harness, a belt body, an actuator and a controller. The controller is configured to perform operation control of the actuator. The controller is configured to, upon operation of the actuator being started in a state in which the first harness and the second harness is fitted to the user, perform winding of the belt body with a first winding force, and is configured to, upon the winding of the belt body being completed, change the winding force of the actuator to a second winding force that is smaller than the first winding force.

Abstract: This document describes techniques and systems for radar-based gesture-recognition with context-sensitive gating and other context-sensitive controls. Sensor data from a proximity sensor and/or a movement sensor produces a context of a user equipment. The techniques and systems enable the user equipment to recognize contexts when a radar system can be unreliable and should not be used for gesture-recognition, enabling the user equipment to automatically disable or “gate” the output from the radar system according to context. The user equipment prevents the radar system from transitioning to a high-power state to perform gesture-recognition in contexts where radar data detected by the radar system is likely due to unintentional input. By so doing, the techniques conserve power, improve accuracy, or reduce latency relative to many common techniques and systems for radar-based gesture-recognition.

Abstract: A system and method configured for conducting a transaction between two parties using a mobile device, or a plurality of mobile devices. In various embodiments, a system for conducting a transaction can comprise an accessory device having an accessory device module and a hardware component, where the accessory device can have various accessory device capabilities. The system can further comprise a mobile device SDK incorporated into the client application and in communication with the accessory device, where the mobile device SDK includes an accessory conversion module in communication with the accessory device module and where the mobile device SDK provides data to the client application. The client application can request accessory device information and receive accessory device capabilities, and the transaction data for the transaction can be provided in a defined structure between the accessory device and the client application via the mobile device SDK.

Abstract: A method, system, and non-transitory computer readable media for converting input from a user into a human interface device (HID) output to cause a corresponding action at an mapped device includes receiving one or more user input from a user at an input device, analyzing the user input selecting a command from a command profile that maps at least one of the received user inputs to one or more mapped tasks, executing the one or more mapped tasks associated with the selected command, and causing one or more corresponding actions at one or more mapped devices associated with the one or more mapped tasks.

Abstract: A terminal device includes a calculation unit that calculates a relative position between the terminal device and a display device that displays virtual reality to be used by a user, a display control unit that changes a photographing range to be photographed in the virtual reality displayed on the display device, based on the relative position, and a video data acquisition unit that acquires video data related to video in the virtual reality photographed in the photographing range that is changed by the display control unit.

Abstract: Provided is a force feedback apparatus, including a rotation shaft, a force feedback module fixed to the rotation shaft, and a trigger movably connected to the rotation shaft. The force feedback module includes a housing fixed to the rotation shaft and having a first opening and a force feedback assembly received in the housing. The force feedback assembly includes a sliding block, an ejector pin, a first driving element, a second driving element, and a transmission portion fixed to the sliding block and extending through the first opening to abut against the trigger. The first driving element interacts with the second driving element to drive the ejector pin to drive the transmission portion to move to realize force feedback on the trigger. The force feedback apparatus requires no additional transmission structure and directly provides force feedback for the trigger in a timely manner, thereby reducing the assembly difficulty.

Abstract: A screen wake-up method, which is applied to a wearable device. The method includes: when a screen of a wearable device is in a turned-off state, performing an illuminance monitoring operation on a set position of the wearable device to obtain illuminance data (S10); identifying a contact operation corresponding to the set position according to the illuminance data (S20); and when the contact operation satisfies the set contact condition corresponding to screen wake-up, controlling the screen to be switched to a turned-on state (S30). Further disclosed are a wearable device and a readable storage medium, which may improve the endurance capabilities of the wearable device.

Abstract: The invention relates to a force application device for an aircraft control column, the control column comprising a control lever configured to rotate a first shaft and a second shaft, the force application device comprising a first force feedback member configured to exert a resistive force opposing the rotation of the first shaft, a second force feedback member configured to exert a resistive force opposing the rotation of the second shaft and a common braking device comprising a housing, a first braking member and a second braking member which are coaxial and mounted rotatably inside the housing and configured to engage with the first shaft and the second shaft, respectively, so as to brake them, preferably simultaneously.

Abstract: A gesture recognition apparatus according to the present invention includes at least one memory and at least one processor which function as: a first detection unit configured to detect from a captured image a first portion making a gesture; a second detection unit configured to detect from the captured image a second portion making the gesture in the first portion detected by the first detection unit; and a recognition unit configured to recognize the gesture on a basis of motion of the first portion detected by the first detection unit and motion of the second portion detected by the second detection unit, wherein in a case where a detection result satisfying a predetermined condition is not obtained by the second detection unit, the recognition unit recognizes the gesture using a detection result satisfying the predetermined condition obtained in a past by the second detection unit.

Abstract: A contact lens system (110) for placing in an eye for augmented reality systems is disclosed. The contact lens system (110) comprises a display (111) comprising a matrix of display elements; a driver unit (112) configured to receive data from a host (120) and to present the data on the display (111) and a set of sensors (113) integrated on the display (111) for measuring pupil size. The driver unit (112) is further configured to read outputs from the set of sensors to determine the pupil size and adjust a size of an active area of the display.

Abstract: A processor-implemented pose prediction method includes: estimating a pose of a user for a predetermined period of time in real time; calculating an estimation confidence of the estimated pose; determining a weight for the pose of the user based on the estimated pose and the estimation confidence; and predicting a pose of the user after the predetermined period of time, based on the weight.

Abstract: A vibrating device and an operation method thereof. The vibrating device includes multiple electromyography sensors, a force sensor, multiple vibrators and a controller. The electromyography sensors are respectively disposed at different positions of a user to obtain multiple pieces of electromyography information respectively. The vibrators are disposed adjacent to or overlapping with the electromyography sensors. During a setting period, the controller makes the vibrators vibrate according to a preset vibration waveform. During the setting period, the controller records multiple pieces of force information generated by the force sensor corresponding to multiple different applied forces of the user and the pieces of electromyography information generated by the electromyography sensors. The controller obtains multiple characteristic frequency parameters according to the corresponding pieces of electromyography information.

Abstract: A construction machine capable of suppressing deterioration in work efficiency includes an angle detecting device that detects a relative angle between a lower travelling body and an upper slewing body, a travel lever that can be manipulated to make the lower travelling body travel, a display, a directional information generating unit that generates information related to a travelling direction of the lower travelling body based on a detected result of the angle detecting device, and a display controller. The display controller causes the display to display an arrow image indicating the travelling direction of the lower travelling body generated by the directional information generating unit when the travel lever is manipulated and does not permit the display to display the arrow image when the travel lever is not manipulated.

Abstract: A system to provide a human-machine interface to enable a user in a real space to act/sense in a virtual space. The system includes: a ring wearable by a finger of the user; a plurality of sensors, and a plurality of feedback units. The plurality of sensors being multimodal, including: a tactile sensor disposed on an inner surface of the ring; and a temperature sensor disposed on an outer surface of the ring. The plurality of feedback units being multimodal, including: a vibrator disposed on the ring, the vibrator being disposed on the outer surface of the ring; and a heater disposed on the inner surface of the ring. The system includes a controller configured to drive the plurality of sensors and the plurality of feedback devices to enable concurrent multimodal sensing and multimodal feedback.

Abstract: Systems and methods for regulating the speed of movement of virtual objects presented by a wearable system are described. The wearable system may present three-dimensional (3D) virtual content that moves, e.g., laterally across the user's field of view and/or in perceived depth from the user. The speed of the movement may follow the profile of an S-curve, with a gradual increase to a maximum speed, and a subsequent gradual decrease in speed until an end point of the movement is reached. The decrease in speed may be more gradual than the increase in speed. This speed curve may be utilized in the movement of virtual objections for eye-tracking calibration. The wearable system may track the position of a virtual object (an eye-tracking target) which moves with a speed following the S-curve. This speed curve allows for rapid movement of the eye-tracking target, while providing a comfortable viewing experience and high accuracy in determining the initial and final positions of the eye as it tracks the target.

Abstract: Smart glasses may be used for intelligent UI webpage optimization leveraging UI and viewer extraction telemetry. The smart glasses may include an eyeball tracking device. Methods may include tracking the movement of the eye of a user on the UI webpage. Methods may further include capturing a segment of data within the movement of the eye of a user on a UI webpage and storing the segment of data in memory on the smart glasses. Methods may also include updating the UI webpage based on an instruction in the data segment transmitted to the UI. Additionally, methods may include autofilling the data segment at the point of user eye movement on the UI webpage. Eyeball movement data may transfer from the smart glasses to UI webpage code.

Abstract: A device for online gaming includes an actuation component and a controller communicatively coupled to a computer system. The controller is configured to perform operations including detecting an actuation of the actuation component, wherein the actuation component is associated with performing of an action in a video game executed by the computer system. Responsive to detecting the actuation, an instruction is provided to the computer system to perform the action, wherein, based on a current value of a timer, the computer system restricts the action from being performed. The timer, having been previously initiated based on a prior actuation of the actuation component, relates to a cooldown period during which the action cannot be repeated after the action is performed. Responsive to receiving a command from the computer system, a tactile effect is generated as an indication to a user that the action can be repeated.

Abstract: A method of providing a texture motion effect in a multisensory media system includes generating a texture signal by using linear predictive coding (LPC) filters obtained by applying LPC to each of a column and a row forming a texture image selected from an input image and generating a texture motion by using a visual roughness of the texture signal and a depth speed of a camera.

Abstract: Systems and methods are provided for operating an artificial reality device using gestures. In various exemplary embodiments, an artificial reality device may receive information initiating a gesture recognition mode via the artificial reality device, and cause a camera associated with the artificial reality device to operate in the gesture recognition mode. The artificial reality device may further receive at least one image of a gesture captured by the camera and identify and evaluate the gesture. The gesture may be indicative of a user command. The artificial reality device may also execute the user command, and may generate feedback confirming execution of the user command.

Abstract: A method for operating an electronic device includes while a display is in low power mode, detecting based on data collected by a time of flight (ToF) sensor, a movable object within a field of view of the electronic device; in response to the detecting initiating a period of detection having a plurality of frames, the period of detection being a time period over which a distance value indicative of a distance between the movable object and the display is detected; for each of the plurality of frames, changing the distance value to reflect whether the movable object is moving near or further from the electronic device; detecting that the distance value after the period of detection is less than a threshold distance value indicative of the movable object approaching the display; if the distance value is less than the threshold distance value, waking up the display.

Abstract: This disclosure generally relates to various directional input units of a mobile communication terminal, where such directional input units receive a single user input or multiple concurrent user inputs and then acquires at least one selecting (user) sub-input therefrom while a terminal is in its powered-off state or its off-state. After acquiring the selecting user sub-input, a terminal runs at least one pre-selected operation which is selected from a set of multiple pre-selected operations and which matches the selecting user sub-input when a terminal powers on from its powered-off state or wakes up from its off-state. A directional input unit may acquire the selecting user sub-input from a movement of at least a portion thereof, a contact between at least a portion thereof and a user body part, or the like. As a result, a terminal can provide a user with more seamless operations.

Abstract: Aspects of the present disclosure involve ranking augmented reality content. The program and method provide for receiving, by a messaging application, a request from a first user to compose a message for sending to a preselected second user, the message being configured to include an image captured by a device camera, the first user and the second user corresponding to contacts in the messaging application; determining, in response to receiving the request, a ranking for a plurality of augmented reality content items configured to be displayed with the image, the ranking being based on at least one signal that relates the first user to the second user; and displaying, based on the ranking, the image with a user interface comprising multiple icons, each icon being user-selectable to display a respective one of the plurality of augmented reality content items with the image.

Abstract: A near-eye display has an image projector coupled to a lightguide for receiving and propagating image light provided by the image projector, the image light carrying an image to be displayed to a viewer. Field of view of the near-eye display may be expanded by providing a beam redirector downstream of the lightguide for controllably redirecting the image light in coordination with displaying different field of view portions by the image projector. To compensate the redirection of external light by the beam redirector, a second beam redirector may be provided upstream of the first redirector and the lightguide.

Abstract: A media system and a method of using the media system to accommodate hearing loss of a user, are described. The method includes selecting a personal level-and-frequency dependent audio filter that corresponds to a hearing loss profile of the user. The personal level-and-frequency dependent audio filter can be one of several level-and-frequency-dependent audio filters having respective average gain levels and respective gain contours. An accommodative audio output signal can be generated by applying the personal level-and-frequency dependent audio filter to an audio input signal to enhance the audio input signal based on an input level and an input frequency of the audio input signal. The audio output signal can be played by an audio output device to deliver speech or music that the user perceives clearly, despite the hearing loss of the user. Other aspects are also described and claimed.

Abstract: Systems, devices, media, and methods are presented for selective location-based identity communication. The systems and methods identify a current location of a mobile computing device and detect a selection of a user interface element associated with the current location. The systems and methods cause presentation of a set of display elements corresponding to the current location and detect selection of a display element of the set of display elements. The systems and methods modify a display characteristic for the current location of the mobile computing device within a set of mobile computing devices based on the selection of the display element.

Abstract: A display panel includes a display area composed of a light-emitting area and a light-transmissive area in which a dark spot defect in the light-transmissive area does not occur. Further, in the display panel, a decrease in transmittance due to light leakage can be prevented, and color mixing between adjacent pixels can be prevented. To this end, a metal layer is disposed at a boundary between the light-emitting area and the light-transmissive area, a metal layer is disposed at a boundary between sub-pixels rendering different colors and adjacent to each other, and a metal layer is disposed at a boundary between two adjacent light-transmissive areas.

Abstract: To provide an image display apparatus and a display apparatus including the image display apparatus which are capable of achieving further simplification of an apparatus configuration, achieving further speed-up of generation of a super multi-view, achieving further suppression of an apparatus manufacturing cost, and achieving further suppression of an adjustment cost of an optical axis. Provided is an image display apparatus including a light source, at least two image forming apparatuses, a quarter-wave plate, a beam splitter, a lens, and an eyepiece for each of eyes of a user. Out of the at least two image forming apparatuses, a first image forming apparatus is provided in a predetermined angular direction with respect to an optical axis of the lens, and a second image forming apparatus is provided in a direction substantially perpendicular to the optical axis of the lens.