Abstract: A smart mask includes a first material layer, at least one display, a first sensor, and a control module. The first material layer is configured to cover a portion of a face of a person. The at least one display is connected to the first material layer and configured to display images over a mouth of the person. The first sensor is configured to detect movement of the mouth of the person and generate a signal indicative of the movement of the mouth. The control module is configured to receive the signal and display the images on the display based on the movement of the mouth.

Abstract: A wrist-pose isolation system can infer a wrist pose (e.g., the user's hand position relative to her forearm) and can reduce wrist-induced jitter for projection casting in an XR environment. A user's projection cast can be determined as a combination of a “low-wrist contribution” component (e.g., a body-and-arm component) and a “high-wrist contribution” component (e.g., the pose of the wrist with respect to the arm). Using input from a gesture-tracking system, the contribution of the user's wrist pose to the user's current projection cast is calculated as a “wrist-contribution vector.” A projection cast direction can be determined as the interpolation of the current low-wrist contribution component and the high-wrist contribution component. This interpolation can be performed by weighting each by a specified amount and combining them.

Abstract: A splicing display screen is provided. The splicing display screen includes a circuit board, a plurality of display panels, and a plurality of first metal lines. The circuit board includes a plurality of circuit areas, and each of the circuit areas includes one of mounting areas and one of electrical connection areas. A plurality of first metal parts are disposed in the electrical connection areas. The display panels are disposed on the circuit board and positioned in the mounting areas, and metal connection pads on the display panels are electrically connected to the first metal parts by the first metal lines.

Abstract: An information processing method includes determining a target area associated with a plurality of widgets that are different, determining a target display mode of the target area, and displaying the plurality of widgets in the target area based on the target display mode. Each of the plurality of widgets obtains a display content based on a target address, and the plurality of widgets are displayed differently in the target area under different display modes.

Abstract: Systems and methods for headset windowing may include determining a geometry of a first object used with a computing system in a work space; determining, based on information received from a sensor, when the user wearing a VR headset tilts their head to bring the first object into view of the VR headset; and displaying a first window on a display of the VR headset, the first window being dimensioned to conform to the geometry of the first object in view of the headset.

Abstract: Systems, methods, and apparatuses for tactile user input are described herein. A tactile user input system includes a tactile input device and a smart table. The smart table comprises a display screen, a network interface, and a processing circuit. The processing circuit comprises a processor and a memory. The processing circuit is configured to sense a placement of the tactile input device on the smart table. The processing circuit is further configured to determine a necessary user input and determine a location of the tactile input device on the smart table. The processing circuit is further configured to rearrange a user interface of the smart table. The processing circuit is further configured to communicate a necessary input configuration to the tactile input device and used by the tactile input device to generate a tactile user interface having an appropriate layout based on the necessary input configuration.

Abstract: A gesture-recognition (GR) device made to be held or worn by a user includes an electronic processor configured by program instructions in memory to recognize a gesture. The device or a cooperating system may match a gesture identifier to an action identifier for one or more target devices in a user's environment, enabling control of the target devices by user movement of the GR device in three-dimensional space.

Abstract: Human interactive texture generation and search systems and methods are described. A deep convolutional generative adversarial network is used for mapping information in a latent space into texture models. An interactive evolutionary computation algorithm for searching a texture through an evolving latent space driven by human preference is also described. Advantages of a generative model and an evolutionary computation are combined to realize a controllable and bounded texture tuning process under the guidance of human preferences. Additionally, a fully haptic user interface is described, which can be used to evaluate the systems and methods in terms of their efficiency and accuracy of searching and generating new virtual textures that are closely representative of given real textures.

Abstract: In a computer-implemented method, a portion of an electronic document is displayed on a touch screen display of a portable multifunction device. The displayed portion has a vertical position and a horizontal position in the electronic document. An object is detected on or near the displayed portion of the electronic document. In response to detecting the object, a vertical bar and a horizontal bar are displayed on top of the displayed portion. The vertical bar has a vertical position on top of the displayed portion that corresponds to the vertical position in the electronic document of the displayed portion. The horizontal bar has a horizontal position on top of the displayed portion that corresponds to the horizontal position in the electronic document of the displayed portion. After a predetermined condition is met, display of the vertical bar and of the horizontal bar is ceased.

Abstract: A system is provided for generating variable haptic feedback. The system comprises a first haptic feedback device configured to generate haptic feedback according to a received output signal, an input device configured to receive instructions from a remote source, the instructions comprising a haptic feedback output identifier, and a memory device for storing a plurality of haptic feedback profiles, the haptic feedback profiles defining unique haptic feedback patterns characterized at least by a duration and intensity of feedback to be generated by the first haptic feedback device, and said haptic feedback profiles being associated with a haptic feedback output identifier. The system also includes a processor configured to generate and transmit an output signal to the first haptic feedback device according to a haptic feedback profile associated with a received haptic feedback output identifier, said output signal comprising a haptic feedback pattern defined by said haptic feedback profile.

Abstract: A virtual space configuration system of an artificial reality system can detect a user posture and provide various corresponding customizations of the system's virtual space. The virtual space configuration system can, when a user is in a seated posture, provide for seated virtual space customizations. In various implementations, these customizations can include allowing adjustment of a floor height; setting a flag that can be surfaced to applications to adjust the applications' mechanics for seated users; customizing display of virtual space boundaries when in seated mode to be less intrusive; providing options to detect when a user leaves seated mode and trigger corresponding actions; provide a passthrough workspace area allowing a user to interact with certain real-world objects naturally without having to remove a virtual reality headset; or automatically determining virtual space dimensions for seated users.

Abstract: A method for controlling a near eye display system, includes obtaining an eye movement of a user wearing the near eye display system using an eye tracking sensor of the near eye display system, determining a target area of a display of the near eye display system based on the eye movement of the user, the target area of the display being an area that the user is looking at, and controlling a brightness of the target area of the display of the near eye display system to cause a size of a pupil of the user to be in a predetermined range.

Abstract: Instances of a single brain computer interface (BCI) system can be implemented on multiple devices. An active instance can control the associated device. The instances can each communicate with a neural decoding system that can receive neural signals from a user, process the neural signals, and output a command based on the processed neural signals. A device running the active instance of can be in communication with the neural decoding system to receive a command. The device can include a display, a non-transitory memory storing instructions, and a processor to execute the instructions to: run an instance of a control program; and execute the task based on the command.

Abstract: Devices, systems and methods that track various aspects of a person's sleep and environment to optimize one or more aspects of the user's environment and sleep conditions, quality and duration, together or alone, and help make the one or more users maintain and prolong his or her deep sleep status and improve the their sleep duration and quality.

Abstract: Implementations set forth herein relate to effectuating device arbitration in a multi-device environment using data available from a wearable computing device, such as computerized glasses. The computerized glasses can include a camera, which can be used to provide image data for resolving issues related to device arbitration. In some implementations, a direction that a user is directing their computerized glasses, and/or directing their gaze (as detected by the computerized glasses with prior permission from the user), can be used to prioritize a particular device in a multi-device environment. A detected orientation of the computerized glasses can also be used to determine how to simultaneously allocate content between a graphical display of the computerized glasses and another graphical display of another client device. When content is allocated to the computerized glasses, content-specific gestures can be enabled and actionable at the computerized glasses.

Abstract: A display method includes detecting a write operation on a display surface by a pointer, determining whether an operation button provided on the pointer is pressed or not, displaying an image corresponding to the write operation as a first image on the display surface, when the write operation is detected and it is determined that the operation button is pressed, and erasing the first image when it is determined that the operation button is not pressed during a period when the first image is displayed.

Abstract: A directional pad assembly including a directional-control unit having a plate-like structure and two or more plunger elements slidable relative to the plate-like structure; a main support structure to support a centre of the plate-like structure such that the plate-like structure is multi-directional tiltable; an interface frame structure suspended above the plate-like structure of the directional-control unit and in a fixed spatial relationship and non-movable relative to the main support structure; and two or more switches arranged around the main support structure and aligned to the two or more plunger elements. The directional-control unit being operable between a first mode, whereby the plate-like structure is tiltable, and a second mode, whereby the two or more plunger elements are individually slidable relative to the plate-like structure, to activate the two or more switches.

Abstract: An eye-tracking system (100, 302) comprises light source(s) (102, 202, 306); means (104, 200, 308) for changing direction of light beam (210) emitted by light source(s), wherein said means is to be employed to steer light beam to scan surface of user's eye (214); and light sensor(s) (106, 310) that is to be employed to sense reflected light signals. Said means is to be employed to detect when light beam is incident upon pupil of user's eye, based on variations in at least one parameter of reflected light signals; and steer light beam to be incident upon centre of pupil, wherein light beam is determined to be incident upon centre of pupil when minimum value from amongst values of at least one parameter of reflected light signals.

Abstract: A method of measuring working distance between a handheld digital device and eyes of a user, including capturing an image of at least eyes of a user via an onboard camera of the handheld digital device while the user is viewing a display of the handheld digital device and comparing an apparent angular size of a structure of the eyes or face of the user to a previously captured image of the structure of the eyes or the face that was taken in the presence of an object of known size. The method further includes calculating a working distance based on the apparent angular size of the structure of the eyes or the face; and saving at least the working distance to memory or reporting out the calculated working distance on the display. A handheld digital device programmed with an algorithm to perform the method is also included.

Abstract: A head mounted display system for displaying image content to a user comprises at least one display configured to be worn by a user to present virtual content to first and second eyes of a user, one or more inwardly facing sensors or camera configured to monitor one or both of the users eye and processing electronics. This head mounted display system is configured such that virtual content activity can be initiated and/or driven from eye inputs such as gaze direction, eyelid motions (e.g., blinking), and/or other eye gestures.

Abstract: A user terminal device and a controlling method thereof are provided. The user terminal device includes a display configured to be divided into a first area and a second area which is larger than the first area with reference to a folding line, a cover disposed on a rear side of the display, a detector configured to detect a user interaction on the display and the cover, and a controller configured to, in response to the display being folded along the folding line such that the first area and the second area face each other, control the detector to detect a user interaction through an exposure area, which is an exposed part of the second area, and the cover, and, in response to the display being folded such that the two parts of the cover face with each other with reference to the folding line, control the detector to detect a user interaction through the first area and the second area.

Abstract: An attention application, such as a web browser, includes a pipeline optimized for faster, more secure, and more private, viewing of hypermedia documents using a reader mode. The reader mode is “always on” in the sense that a classifier runs on every web page and every compatible page is rendered in the reader mode and not rendered in full, referred to as the bloat page. Significant time savings are gained by avoiding fetching and rendering the bloat page at all because the bloat page devours network bandwidth and computing resources. Avoiding loading the bloat page also avoids exposing the user to what are often abusive privacy infringements and security vulnerabilities from running executable code in the browser, while providing an uncluttered viewing experience of content that is actually of interest to the user.

Abstract: The present disclosure relates to determining when the head position of a user viewing user interfaces in a computer-generated reality environment is not in a comfortable and/or ergonomic position and repositioning the displayed user interface so that the user will reposition her/his head to view the user interface at a more comfortable and/or ergonomic head position.

Abstract: Embodiments of the present disclosure provide a method, a computer program product, and a wearable device for controlling display of content. The method is performed in a wearable device (10) comprising a head mounted display having a display region (12). The method comprises causing (S12) to display a first visual content (32) on a first portion (14) of the display region, corresponding to an eye gaze direction (22) of the user (20). The method comprises determining (S13) to transmit a second visual content (34) to one or more external display devices (40a-40 n) based on presence of the one or more external display devices (40a-40 n) in a field of view, FoV, of the wearable device (10). Further, the method comprises sending (S14) a request to at least one of the one or more external display devices (40a-40 n) to display the second visual content (34). The method further comprises causing (S15) to display the second visual content (34), at least outside the first portion (14) of the display region (12).

Abstract: A terminal device according to one aspect presents an augmented reality space to a user. The terminal device includes: an image-capturing unit configured to capture an image of a real space; a display unit configured to display an augmented reality space image representing the augmented reality space including the real space captured by the image-capturing unit and a virtual object; a determination unit configured to determine at least a part of the virtual object as an operation target; and an object control unit configured to control an operation of the operation target in the augmented reality space. The object control unit detects a direction and an amount of a movement of the terminal device after the operation target is determined and moves the operation target based on the detected direction and amount of the movement of the terminal device.

Abstract: An object is to reduce the processing time. One embodiment is a non-transitory computer readable storage medium storing a program for causing an information processing apparatus to function as: a detection unit configured to detect an area of a first object for each second object from a captured image obtained by capturing the second object including the first object; a first display control unit configured to display a display item indicating a detected area at a position corresponding to the area detected by the detection unit in the captured image displayed on a screen; and a second display control unit configured to display a temporary area that is created based on the area of the first object detected in the second object in which area detection has succeeded in the captured image of the second object that is displayed on the screen and in which area detection has failed.

Abstract: Systems and methods for gesture control are described. In some embodiments, a system may include a wearable device configured to be worn on a wrist of a user. The wearable device may include a hub and a wristband. The hub may include a plurality of hub electrodes and a biopotential microchip. The wristband may include one or more wristband electrodes and one or more wristband conductors, which may electrically connecting the one or more wristband electrodes to the electrical port of a sealed housing of the hub, which may in turn electrically connect the one or more wristband electrodes to inputs of the biopotential microchip.

Abstract: A smart conference room system is provided. The smart conference room system includes an intelligent conference interactive panel including one or more processors configured to convert user input into a conference information, and a memory configured to store the conference information. The intelligent conference interactive panel is configured to transmit conference information to one or more terminal devices. The one or more terminal devices are configured to perform a controllable operation based on the conference information transmitted to the one or more terminal devices.

Abstract: Enhanced eye-tracking techniques for augmented or virtual reality display systems. An example method includes obtaining an image of an eye of a user of a wearable system, the image depicting glints on the eye caused by respective light emitters, wherein the image is a low dynamic range (LDR) image; generating a high dynamic range (HDR) image via computation of a forward pass of a machine learning model using the image; determining location information associated with the glints as depicted in the HDR image, wherein the location information is usable to inform an eye pose of the eye.

Abstract: A wrist-wearable electronic device comprising first and second light emitting elements, a sensor, and a processor. The processor is configured to transmit a first command to the first light emitting element in response to the wrist-wearable device reaching a forward position relative to a user based on data received from the sensor and transmit a second command to the second light emitting element in response to the wrist-wearable device reaching a rearward position relative to the user based on the data from the sensor.

Abstract: A position of a user is recognized. A display unit (102) displays a content-display-frame (112). A determination unit (103) determines whether the position of the user is within a predetermined range from a wall surface (12) or not. The display control unit (104) configured to display a content-display-frame on a floor surface (11) when the position of the user is farther than the predetermined range from the wall surface, and configured to display an operation input area (113) that receives an operation input from the user on the wall surface while displaying a content-display-frame to span from the floor surface to the wall surface when the position of the user is within the predetermined range from the wall surface.

Abstract: A button module is provided. The button module comprises a base, a pressing part, and an elastic part. The pressing part includes a fixed end and a free end. The fixed end is pivotally connected to the base in a first axial direction. The elastic part is disposed on a side of the pressing part facing the base. The elastic part includes a first damping portion and a second damping portion selectively pressing against the base, where a hardness of the first damping portion is different from a hardness of the second damping portion.

Abstract: Multiple head-mounted devices and/or other electronic devices can operate in concert to provide multiple users with shared experiences and content enjoyment. Such operations can be facilitated by a connection between multiple head-mounted devices and/or other electronic devices to allow different users to receive content. Such a connection can be made possible by a connector that directly and physically connects head-mounted devices and/or other electronic devices to each other and transmits signals there between. By providing a physical connection, the signals can be efficiently transmitted even when other types of connections (e.g., wireless) are not available.

Abstract: Systems and methods enable users to build augmented reality (AR) experiences with Internet of Things (IoT) devices. The system includes an AR object studio that includes a list of IoT devices and control signals for the respective IoT devices and a list of AR objects (e.g., an AR lens). The AR object studio receives selections from users and correlates at least one IoT device to at least one AR object in response to the user selections. During use, a server receives an indication that an AR object has been activated and interacted with on a display of an AR camera device and, in response, sends a control signal to a correlated IoT device. Conversely, the server may receive a signal from an IoT device and, in response, present and control a correlated AR object on the display of the AR camera device.

Abstract: The present application provides a display panel and an electronic device. A functional region and a transition region of the display panel are located between two adjacent touch electrodes, each touch electrode is electrically connected to a first signal transmission line, first signal shielding lines are disposed between the first signal transmission lines of a same touch electrode group and the touch electrodes of an adjacent touch electrode group, and a part of the first signal shielding line is located in the transition region, so as to alleviate a problem of poor touch performance of an existing out-cut screen.

Abstract: Systems and methods are described in which the location of a tap on the body of a handheld device is determined in real time using data streams from an embedded inertial measurement unit (IMU). Taps may be generated by striking the handheld device with an object (e.g., a finger), or by moving the handheld device in a manner that causes it to strike another object. IMU accelerometer, gyroscopic and/or orientation (relative to the magnetic and/or gravitational pull of the earth) measurements are examined for signatures that distinguish a tap at a location on the body of the device compared with signal characteristics produced by taps at other locations. Neural network and/or numerical methods may be used to perform such classifications.

Abstract: In a recording device configured to record a motion of an object in a virtual space, a data structure of data related to the motion of the object recorded by the recording device is used for a process of reproducing the motion of the object in the reproduction device. The recording device includes a controller and a storage. The controller causes the storage to store, in association with the object, the data related to the motion of the object and data related to available functions for a process of moving the object. The data related to the available functions for the process of moving the object is stored in the storage so that the reproduction device is able to specify a function class that is reproducible by the reproduction device.

Abstract: A method for assessing neurological function in a subject includes a) prompting a user to follow a moving saccade-evoking stimulus on a display, b) tracking eye movement of the subject while the user follows the moving stimulus, c) collecting a first eye conjugacy data of the subject relating to the saccade-evoking stimulus, and d) comparing the first eye conjugacy data with a second eye conjugacy data, the second eye conjugacy data relating to an anti-saccade stimulus.

Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.

Abstract: An electronic device includes a housing including a first housing and a second housing; a hinge unit configured to rotate the first housing and the second housing, the housing configured to move between a folded state and an unfolded state via the hinge unit; a first display disposed in a first area of the first housing and a second area of the second housing; a second display disposed in a third area of the first housing, located at an opposite side of the first area; at least one sensor; a memory configured to store an image frame set including a plurality of image frames; and at least one processor; wherein the memory stores instructions which, when executed, cause the at least one processor to obtain, via the at least one sensor, information corresponding to a folding angle between the first housing and the second housing, based on the obtained information corresponding to a first folding angle being smaller than a first reference angle, deactivate the first display and display, via the second display, an

Abstract: A method for operating an input device. An input element of the input device is manually operated to perform an input into a computer device operatively connected to the input device. Mobility of the input element can be selectively delayed, blocked, and enabled by a controllable magneto-rheological braking device. The mobility of the input element is selectively adjusted by the computer device at least as a function of at least one input condition stored in the computer device. The input device may be a computer mouse.

Abstract: Inventive concepts and embodiments associated therewith are provided wherein an auxiliary device, that is attached to a person, is configured to function in cooperation with a destination device that is on the person. In some embodiments, the auxiliary device is uniquely associated with specific information that is to be conveyed to the destination device following reception of a signal by the auxiliary device. Embodiments are disclosed wherein, following reception of the signal by the auxiliary device, the auxiliary device processes the signal and then conveys the specific information that is uniquely associated therewith to the destination device without direct human interaction with the auxiliary device. In some embodiments, the auxiliary device comprises a personal wearable device and the destination device comprises a smartphone.

Abstract: A transducer assembly includes a mounting base, a collar, a magnet, and a Hall effect sensor. The collar defines a bore. One of the magnet and the Hall effect sensor is disposed within the bore and attached to the mounting base. The other of the magnet and the Hall effect sensor is attached to the collar. The Hall effect sensor is spaced from the magnet and is configured to detect movement of at least a portion of the collar relative to the mounting base.

Abstract: A method and device for adjusting a projected image are provided. In the method, a distance between a mobile terminal and a projection screen is acquired (S102); and at least one of a display area or a display orientation of a projected image on the projection screen is adjusted at least according to the distance between the mobile terminal and the projection screen (S104). Through the method and the device, a problem in a related art that the projected image can only be adjusted manually by a user is solved, and a viewing angle is adjusted to an optimal viewing angle for viewing a projected image in real time according to a distance with respect to a user, thereby protecting the eyesight of the user and improving user experience.

Abstract: It is an object to provide technology enabling appropriate control of a change of a parameter per operation unit. A display control apparatus is a display control apparatus to control a display apparatus, and includes: an acquisition unit to acquire a change operation to change a parameter used for an image displayed by the display apparatus from a user, and acquire a gaze of the user; and a controller to control a change of the parameter per operation unit being a unit of the change operation based on a result of gaze determination to determine whether the gaze is directed toward the image displayed by the display apparatus.

Abstract: The invention relates to a haptic interface comprising a substrate (2), a plate (4) comprising a surface (6) for interaction with one or more fingers of a user, and actuators (A1) capable of applying a vibration to said plate (4), and a control module (MC) for controlling said actuator,—said plate (4) being in the shape of a strip extending along a first direction (X) and delimited transversely to the first direction by two lateral edges (10), said lateral edges (10) being supported by said substrate (6),—said control module (MC) being configured to generate control signals to said actuator (A1) at first frequencies lower than the cut-off frequency of the first propagation mode of said plate, so that the actuator (A1) generates evanescent waves in the plate (4).

Abstract: Systems and methods for operation of a medical device may include at least two sensors to confirm a command to control a medical instrument is intentionally made by an operator. The systems may include an operator-detection sensor associated with an input device and configured to detect a presence of an operator at the input device. The systems may also include a motion sensor associated with the input device and configured to detect a displacement distance of the input device. A control unit may use a displacement threshold for the input device and may be configured to permit or prevent control signal generation based on feedback from the at least two sensors.

Abstract: A control method and an electronic device are provided. The method includes: receiving a first input for a function control in a case that the function control is displayed in a first manner; and displaying, in response to the first input, the function control in a second manner, outputting a first current at a first position of the function control, and outputting a second current at a second position of the function control, where an input position of the first input includes at least one of the first position and the second position.

Abstract: Provided is an information processing apparatus that is to be connected to a controller apparatus including a push-button, a force sense presentation section, and the push-button. The push-button moves between a first position and a second position when depressed by a finger of a user. The force sense presentation section presents a force sense to the push-button. The information processing apparatus determines, according to a prescribed force sense setting, the aspect of a force sense to be imparted to the push-button, and controls the force sense presentation section of the controller apparatus, according to the determination. Each time a predefined operation is performed, the information processing apparatus changes the force sense setting from a current force sense setting to a different force sense setting.

Abstract: Packaging media for optimizing immersive media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation; acquiring asset information associated with media assets corresponding to a set of scenes included in the immersive media data for the immersive presentation; analyzing characteristics of the media assets based on the asset information, the characteristics comprising an asset type associated with a respective media asset and a frequency that indicates a number of times the respective media asset is used among the set of scenes included in the immersive presentation; ordering the media assets in a sequence based on the asset type and the frequency associated with each of the media assets; and streaming the immersive media data for the immersive presentation based on the ordered sequence of the media assets.