Abstract: A terminal device includes a calculation unit that calculates a relative position between the terminal device and a display device that displays virtual reality to be used by a user, a display control unit that changes a photographing range to be photographed in the virtual reality displayed on the display device, based on the relative position, and a video data acquisition unit that acquires video data related to video in the virtual reality photographed in the photographing range that is changed by the display control unit.

Abstract: A contact lens system (110) for placing in an eye for augmented reality systems is disclosed. The contact lens system (110) comprises a display (111) comprising a matrix of display elements; a driver unit (112) configured to receive data from a host (120) and to present the data on the display (111) and a set of sensors (113) integrated on the display (111) for measuring pupil size. The driver unit (112) is further configured to read outputs from the set of sensors to determine the pupil size and adjust a size of an active area of the display.

Abstract: A processor-implemented pose prediction method includes: estimating a pose of a user for a predetermined period of time in real time; calculating an estimation confidence of the estimated pose; determining a weight for the pose of the user based on the estimated pose and the estimation confidence; and predicting a pose of the user after the predetermined period of time, based on the weight.

Abstract: A construction machine capable of suppressing deterioration in work efficiency includes an angle detecting device that detects a relative angle between a lower travelling body and an upper slewing body, a travel lever that can be manipulated to make the lower travelling body travel, a display, a directional information generating unit that generates information related to a travelling direction of the lower travelling body based on a detected result of the angle detecting device, and a display controller. The display controller causes the display to display an arrow image indicating the travelling direction of the lower travelling body generated by the directional information generating unit when the travel lever is manipulated and does not permit the display to display the arrow image when the travel lever is not manipulated.

Abstract: A vibrating device and an operation method thereof. The vibrating device includes multiple electromyography sensors, a force sensor, multiple vibrators and a controller. The electromyography sensors are respectively disposed at different positions of a user to obtain multiple pieces of electromyography information respectively. The vibrators are disposed adjacent to or overlapping with the electromyography sensors. During a setting period, the controller makes the vibrators vibrate according to a preset vibration waveform. During the setting period, the controller records multiple pieces of force information generated by the force sensor corresponding to multiple different applied forces of the user and the pieces of electromyography information generated by the electromyography sensors. The controller obtains multiple characteristic frequency parameters according to the corresponding pieces of electromyography information.

Abstract: Systems and methods for regulating the speed of movement of virtual objects presented by a wearable system are described. The wearable system may present three-dimensional (3D) virtual content that moves, e.g., laterally across the user's field of view and/or in perceived depth from the user. The speed of the movement may follow the profile of an S-curve, with a gradual increase to a maximum speed, and a subsequent gradual decrease in speed until an end point of the movement is reached. The decrease in speed may be more gradual than the increase in speed. This speed curve may be utilized in the movement of virtual objections for eye-tracking calibration. The wearable system may track the position of a virtual object (an eye-tracking target) which moves with a speed following the S-curve. This speed curve allows for rapid movement of the eye-tracking target, while providing a comfortable viewing experience and high accuracy in determining the initial and final positions of the eye as it tracks the target.

Abstract: A system to provide a human-machine interface to enable a user in a real space to act/sense in a virtual space. The system includes: a ring wearable by a finger of the user; a plurality of sensors, and a plurality of feedback units. The plurality of sensors being multimodal, including: a tactile sensor disposed on an inner surface of the ring; and a temperature sensor disposed on an outer surface of the ring. The plurality of feedback units being multimodal, including: a vibrator disposed on the ring, the vibrator being disposed on the outer surface of the ring; and a heater disposed on the inner surface of the ring. The system includes a controller configured to drive the plurality of sensors and the plurality of feedback devices to enable concurrent multimodal sensing and multimodal feedback.

Abstract: A device for online gaming includes an actuation component and a controller communicatively coupled to a computer system. The controller is configured to perform operations including detecting an actuation of the actuation component, wherein the actuation component is associated with performing of an action in a video game executed by the computer system. Responsive to detecting the actuation, an instruction is provided to the computer system to perform the action, wherein, based on a current value of a timer, the computer system restricts the action from being performed. The timer, having been previously initiated based on a prior actuation of the actuation component, relates to a cooldown period during which the action cannot be repeated after the action is performed. Responsive to receiving a command from the computer system, a tactile effect is generated as an indication to a user that the action can be repeated.

Abstract: Smart glasses may be used for intelligent UI webpage optimization leveraging UI and viewer extraction telemetry. The smart glasses may include an eyeball tracking device. Methods may include tracking the movement of the eye of a user on the UI webpage. Methods may further include capturing a segment of data within the movement of the eye of a user on a UI webpage and storing the segment of data in memory on the smart glasses. Methods may also include updating the UI webpage based on an instruction in the data segment transmitted to the UI. Additionally, methods may include autofilling the data segment at the point of user eye movement on the UI webpage. Eyeball movement data may transfer from the smart glasses to UI webpage code.

Abstract: A method for operating an electronic device includes while a display is in low power mode, detecting based on data collected by a time of flight (ToF) sensor, a movable object within a field of view of the electronic device; in response to the detecting initiating a period of detection having a plurality of frames, the period of detection being a time period over which a distance value indicative of a distance between the movable object and the display is detected; for each of the plurality of frames, changing the distance value to reflect whether the movable object is moving near or further from the electronic device; detecting that the distance value after the period of detection is less than a threshold distance value indicative of the movable object approaching the display; if the distance value is less than the threshold distance value, waking up the display.

Abstract: A method of providing a texture motion effect in a multisensory media system includes generating a texture signal by using linear predictive coding (LPC) filters obtained by applying LPC to each of a column and a row forming a texture image selected from an input image and generating a texture motion by using a visual roughness of the texture signal and a depth speed of a camera.

Abstract: Systems and methods are provided for operating an artificial reality device using gestures. In various exemplary embodiments, an artificial reality device may receive information initiating a gesture recognition mode via the artificial reality device, and cause a camera associated with the artificial reality device to operate in the gesture recognition mode. The artificial reality device may further receive at least one image of a gesture captured by the camera and identify and evaluate the gesture. The gesture may be indicative of a user command. The artificial reality device may also execute the user command, and may generate feedback confirming execution of the user command.

Abstract: This disclosure generally relates to various directional input units of a mobile communication terminal, where such directional input units receive a single user input or multiple concurrent user inputs and then acquires at least one selecting (user) sub-input therefrom while a terminal is in its powered-off state or its off-state. After acquiring the selecting user sub-input, a terminal runs at least one pre-selected operation which is selected from a set of multiple pre-selected operations and which matches the selecting user sub-input when a terminal powers on from its powered-off state or wakes up from its off-state. A directional input unit may acquire the selecting user sub-input from a movement of at least a portion thereof, a contact between at least a portion thereof and a user body part, or the like. As a result, a terminal can provide a user with more seamless operations.

Abstract: A near-eye display has an image projector coupled to a lightguide for receiving and propagating image light provided by the image projector, the image light carrying an image to be displayed to a viewer. Field of view of the near-eye display may be expanded by providing a beam redirector downstream of the lightguide for controllably redirecting the image light in coordination with displaying different field of view portions by the image projector. To compensate the redirection of external light by the beam redirector, a second beam redirector may be provided upstream of the first redirector and the lightguide.

Abstract: Aspects of the present disclosure involve ranking augmented reality content. The program and method provide for receiving, by a messaging application, a request from a first user to compose a message for sending to a preselected second user, the message being configured to include an image captured by a device camera, the first user and the second user corresponding to contacts in the messaging application; determining, in response to receiving the request, a ranking for a plurality of augmented reality content items configured to be displayed with the image, the ranking being based on at least one signal that relates the first user to the second user; and displaying, based on the ranking, the image with a user interface comprising multiple icons, each icon being user-selectable to display a respective one of the plurality of augmented reality content items with the image.

Abstract: Systems, devices, media, and methods are presented for selective location-based identity communication. The systems and methods identify a current location of a mobile computing device and detect a selection of a user interface element associated with the current location. The systems and methods cause presentation of a set of display elements corresponding to the current location and detect selection of a display element of the set of display elements. The systems and methods modify a display characteristic for the current location of the mobile computing device within a set of mobile computing devices based on the selection of the display element.

Abstract: To provide an image display apparatus and a display apparatus including the image display apparatus which are capable of achieving further simplification of an apparatus configuration, achieving further speed-up of generation of a super multi-view, achieving further suppression of an apparatus manufacturing cost, and achieving further suppression of an adjustment cost of an optical axis. Provided is an image display apparatus including a light source, at least two image forming apparatuses, a quarter-wave plate, a beam splitter, a lens, and an eyepiece for each of eyes of a user. Out of the at least two image forming apparatuses, a first image forming apparatus is provided in a predetermined angular direction with respect to an optical axis of the lens, and a second image forming apparatus is provided in a direction substantially perpendicular to the optical axis of the lens.

Abstract: A display panel includes a display area composed of a light-emitting area and a light-transmissive area in which a dark spot defect in the light-transmissive area does not occur. Further, in the display panel, a decrease in transmittance due to light leakage can be prevented, and color mixing between adjacent pixels can be prevented. To this end, a metal layer is disposed at a boundary between the light-emitting area and the light-transmissive area, a metal layer is disposed at a boundary between sub-pixels rendering different colors and adjacent to each other, and a metal layer is disposed at a boundary between two adjacent light-transmissive areas.

Abstract: A media system and a method of using the media system to accommodate hearing loss of a user, are described. The method includes selecting a personal level-and-frequency dependent audio filter that corresponds to a hearing loss profile of the user. The personal level-and-frequency dependent audio filter can be one of several level-and-frequency-dependent audio filters having respective average gain levels and respective gain contours. An accommodative audio output signal can be generated by applying the personal level-and-frequency dependent audio filter to an audio input signal to enhance the audio input signal based on an input level and an input frequency of the audio input signal. The audio output signal can be played by an audio output device to deliver speech or music that the user perceives clearly, despite the hearing loss of the user. Other aspects are also described and claimed.

Abstract: A system for depth-based 3D reconstruction using an a-priori depth scene is described herein. The method includes a static depth map extractor to a static scene depth map of a scene for a plurality of camera views. The system also includes a dynamic scene plane sweeper to sweep through depth planes of a dynamic scene based on the depth map from the static scene to infer a depth map of the dynamic scene for each camera view. Finally, the system includes a fusion mechanism to fuse a three-dimensional point cloud from the depth map of the dynamic scene from each camera view.

Abstract: A handheld video game controller is operable in Bluetooth Low Energy (BLE) mode to allow for sending controller input data to a target BLE device in a manner that bypasses any operating system (OS) restrictions that might otherwise be imposed on game controller input. When operating in the BLE mode, the handheld video game controller pairs (establishes a radio link) with a BLE device executing a client application used for video game streaming. During gameplay, the video game executes on a host computer and the player provides user input to the game controller to control an aspect of the video game. In response to such user input, the game controller sends controller input data to the BLE device via a radio of the game controller. The player may switch between operating the game controller in BLE mode and receiver mode using input gestures on the game controller.

Abstract: This application provides a display method and an electronic device. In the method, in a state switching process of a foldable display screen of the electronic device, the electronic device may display a target interface whose size changes on the foldable display screen. According to the application, smooth transition of interface switching in the state switching process of the foldable display screen can be achieved, so that a visual effect in which a size change of the target interface coincides an actual state switching process of the foldable display screen is implemented, thereby improving visual experience of a user.

Abstract: In a method for controlling a furniture drive via voice input, an acoustic signal is converted into an electrical signal. The electrical signal is evaluated by a local voice analysis device, and an operating state of the furniture drive is controlled when a keyword from a set of keywords is recognized during evaluation.

Abstract: In some implementations, a system may receive, at a front-end device and from an augmented reality (AR) device associated with a user, a request to use the front-end device. The system may transmit, to the AR device, a request to access an optical sensor of the AR device. The system may receive, from the AR device, an output, from the optical sensor, that indicates a hand gesture performed by the user of the AR device. Accordingly, the system may determine, based on the hand gesture, a corresponding input key of the front-end device. The system may perform an action based on the corresponding input key.

Abstract: An embodiment tactile presentation method includes: generating a first stimulus signal in a first frequency band; generating a second stimulus signal in a second frequency band, the second frequency band different from the first frequency band; applying the first stimulus signal from a first application member to a skin surface of a living body; and applying the second stimulus signal from a second application member to the skin surface.

Abstract: Techniques include a method of providing a user interface on a device. The user interface has at least a first display portion, a second display portion and a third display portion, the second display portion including a link to the third display portion that, when activated by a user, cause the device to present the third display portion of the user interface, the first display portion not including the link to the third display portion. The method includes causing the first display portion to be displayed. The method further includes receiving audible input while the first display portion is being displayed. The method further includes determining that the third display portion corresponds to an utterance in the audible input based at least in part on labels determined to match the utterance. The method further includes causing the third display portion to be displayed.

Abstract: A touch sensor device includes a first panel, a second panel, and a drive-sense circuit (DSC). The first panel that includes first electrodes arranged in a first direction and second electrodes arranged in a second direction. The second panel includes third electrodes arranged in a third direction and fourth electrodes arranged in a fourth direction. The DSC is operably coupled via a single line to a coupling of a first electrode of the first electrodes and a first electrode of the third electrodes. The DSC is configured to provide the signal, which is generated based on a reference signal, via the single line to the coupling and simultaneously to sense the signal via the single line. The DSC generates a digital signal representative of the at least one electrical characteristic associated with the first electrode of the first electrodes and/or the first electrode of the third electrodes.

Abstract: A display device includes a display panel including a display area, a first area spaced apart from the display area, and a second area disposed between the display area and the first area. An optical layer is disposed on the display panel and extends from the display area to a portion of the second area. A protective member includes a first protective layer disposed on the display panel in the first area and a second protective layer disposed on the display panel in the second area and having a thickness less than a thickness of the first protective layer.

Abstract: The present invention relates to a head-mountable information processing apparatus allowing a user to hear a desired sound even if ambient sound unnecessary for the user is present. An audio input interface includes sound microphones worn in the vicinity of the user's ear, collects the ambient sound that occurs outside the head-mountable information processing apparatus, and converts the ambient sound into an input audio signal. An audio output interface, including headphones, converts a generated output audio signal for output, and emits the audio output toward the user. Based on a volume level of the input audio signal and a volume level of the output audio signal, a controller determines whether or not a state in which the ambient sound is preventing the audio for output from being heard is occurring, and based on a determination result, the controller controls a sound emission operation of the audio output interface.

Abstract: Devices, methods, and graphical interfaces for content applications displayed in an XR environment provide for an efficient and intuitive user experience. In some embodiments, a content application is displayed in a three-dimensional computer-generated environment. In some embodiments, different viewing modes and user interfaces are available for a content application in a three-dimensional computer-generated environment. In some embodiments, different interactions are available with content items displayed in the XR environment.

Abstract: A camera assembly adaptable to a display device is provided. The camera assembly comprises a fixed base, a lifting component, an elastic element and a camera module. The fixed base is disposed in the display device and fixed with the display device. The lifting component is movably connected to the fixed base. The elastic element is connected with the lifting component and the fixed base respectively. The camera module is pivotally connected to the lifting component. The elastic element provides elastic force to drive the lifting component to raise the camera module so that the camera module is exposed from the display device, and the camera module pivots relative to the lifting component to tilt the display device.

Abstract: An example apparatus comprises a first member with a first surface, where the first member is movable relative to a second member with a second surface. The first member comprises a first magnet configured to produce a first magnetic field. The second member comprises a sensor operatively connected to a processor and a second magnet adjacent to the sensor. In a first position, the first magnet and the second magnet are engaged to magnetically hold the first member to the second member such that at least a portion of the first surface of the first member opposes at least a portion of the second surface of the second member. In the first position, the sensor is to detect the first magnetic field produced by the first magnet and is to send a signal to the processor in response to detecting the first magnetic field produced by the first magnet.

Abstract: In a server, a client information acquiring section acquires information related to a user operation from an image processing device. An operation status identifying section of an image generating section identifies the contents displayed on the image processing device side at the time when the user operation is performed. A drawing section generates a frame corresponding to the details of the user operation and the contents displayed at the time when the user operation is performed. A discard processing section determines whether or not to discard the data, on the basis of the contents of a provisional frame generated before the detection of the user operation.

Abstract: There is provided an information processing apparatus that includes a display controlling section that causes a display device to start displaying a first virtual object while a user is moving in a real space, performs distance keeping control to substantially keep a distance between the user and the first virtual object, ends the distance keeping control in a case where a predetermined condition is satisfied, and changes the distance between the user and the first virtual object.

Abstract: Systems and methods for headset windowing may include determining a geometry of a first object used with a computing system in a work space; determining, based on information received from a sensor, when the user wearing a VR headset tilts their head to bring the first object into view of the VR headset; and displaying a first window on a display of the VR headset, the first window being dimensioned to conform to the geometry of the first object in view of the headset.

Abstract: A virtual reality wearable system. The system includes a sensor, an actuator, a sleeve-type first wearable part fittable over a user's bodily part, the at least one second wearable part being wearable over the first wearable part. The first wearable part and the second wearable part are releasably connectable to each other. The at least one second wearable part supports the sensor and the actuator. A cable or cables connect the sensor and the actuator with a portion of the second wearable part distant from the sensor and the actuator. The at least one second wearable part comprises a first portion and a second portion that are separate from each other. The first portion is placeable on a first bodily part of a user, and said first portion supports the sensor and the actuator, and the second portion is placeable on a second bodily part of the user distant from the first bodily part.

Abstract: Disclosed herein are a stretchable display panel and device and a manufacturing method thereof. The stretchable display panel comprises: a lower substrate having an active area and a non-active area surrounding the active area; a plurality of individual substrates disposed on the lower substrate and located in the active area; a plurality of pixels disposed on the plurality of individual substrates; and a connection line disposed between the plurality of individual substrates and the lower substrate, wherein the modulus of the plurality of individual substrates is higher than that of at least one part of the lower substrate, and wherein the connecting line extends to the bottom surface of the individual substrates, such that the connecting line electrically connects a pad disposed on the individual substrates without a step in the top surface of the connecting line. That is, the connecting line has a uniform height from the lower substrate for its entire length.

Abstract: An electronic device includes a housing; a flexible display at least partially exposed to an outside through the housing; and at least one processor operatively connected to the flexible display, wherein the at least one processor is configured to: based on receiving a first user input on the flexible display for a sliding operation to expose a second part including at least part of a first part of the flexible display to the outside in a state in which the first part of the flexible display is exposed to the outside, identify an edge area of the flexible display to be slid, control the flexible display to display an indicator in at least part of an area of the first part of the flexible display corresponding to the edge area of the flexible display, and expose the second part to the outside by sliding at least part of the flexible display including the edge area after the indicator is displayed.

Abstract: A method for detecting motion information includes the following steps. First, a pixel array is provided for detecting an image of a measured object located in a first distance range or in a second distance range, and the pixel array includes a plurality of invisible image sensing pixels and a plurality of visible image sensing pixels. Then, image detection is conducted within the first distance range by using the invisible image sensing pixels to output a plurality of invisible images. Next, the image detection is conducted within the second distance range by using the visible image sensing pixels to output a plurality of visible images. Then, the plurality of invisible images and the plurality of visible images are analyzed by using a processing unit, so as to obtain motion information of the measured object. A pixel array for detecting motion information and an image sensor are also provided.

Abstract: Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and a table of eyelid motion identifiers and corresponding actions performable on the object in the extended reality environment is stored in memory. An eyelid motion is detected by using a sensor, and the detected eyelid motion is matched to one of the stored eyelid motion identifiers. An updated version of the extended reality environment, based on the action that corresponds to the matched eyelid motion, is generated for display, in response to matching the detected eyelid motion to one of the stored eyelid motion identifiers.

Abstract: A portable multifunction device displays a first widget on a touch screen and detects a first gesture on a settings icon on the first widget. In response to the first gesture, the device displays user-adjustable settings for a plurality of widgets, including settings for the first widget. The device detects one or more additional gestures to change one or more settings for one or more widgets in the plurality of widgets. In response to the additional gestures, the device changes one or more settings for other widgets, including changing one or more settings for a respective widget other than the first widget. Upon detecting a widget selection gesture and a finishing gesture on the touch screen, the device displays a second widget in the plurality of widgets other than the first widget.

Abstract: Haptic feedback remote control systems and methods are provided. A method for providing haptic feedback to a user of a haptic feedback remote control device includes receiving, by a receiving device, an electronic command issued from the haptic feedback remote control device. The receiving device transmits a haptic feedback command to the haptic feedback remote control device. Based on the received haptic feedback command, the haptic feedback remote control activates a haptic feedback device, within the haptic feedback remote control, to provide a haptic feedback effect to a user of the haptic feedback remote control device.

Abstract: One embodiment provides a method for discovering an entity communicating using a network communication protocol. A scanning system of a system transmits, at a plurality of communication ports, a message using the network communication protocol to elicit a response from an entity accessing one of the communication ports. The transmitting includes emulating a portion of the network communication protocol. The scanning system receives a response to the message from the entity accessing one of the communication ports. The scanning system determines the entity is an entity of interest by determining that the response is provided using the network communication protocol and is responsive to the message. Responsive to determining that the entity is an entity of interest, the entity is added to a group of entities of interest.

Abstract: The invention relates to a method, a device and a computer-readable storage medium with instructions for controlling a display of a mobile augmented reality device of a user. First a static navigation display for a destination is generated, which is positioned in a stationary manner in a real environment. If a situation is detected that requires an adaptation of the display of the mobile augmented reality device, a static navigation display adapted to the situation or a supplementary navigation display is generated.

Abstract: In some embodiments, an apparatus includes a volatile memory, a non-volatile memory, a first processor coupled to the non-volatile memory and configured to receive a data set associated with an object and user information associated with a spatial position of a user in a multi-user virtual (IMVR) environment, and a second processor coupled to the volatile memory, the second processor configured to render an instance of the portion of the object in the IMVR environment from a perspective of the user based on the spatial position of the user. The first processor is configured to generate a look-up table (LUT) based on a set of inputs received from a user. The second processor is configured to render, based on the LUT and information related to a manipulation by a user, an updated instance of the portion of the object that manifests an effect of the manipulation in the IMVR environment.

Abstract: A camera information calculation device includes a hardware processor. The hardware processor functions as a first calculation unit and a second calculation unit. The first calculation unit calculates, based on a first image and a first video, first camera positional information indicating a position of a first camera. The first image includes a first object taken by the first camera. The first video includes the first object taken by a third camera. The second calculation unit calculates, based on a second image and a second video, second camera positional information indicating a position of a second camera disposed away from the first camera. The second image includes a second object taken by the second camera. The second video includes the second object taken by the third camera.

Abstract: A method for end-to-end dynamic gesture recognition using mmWave radar is provided. The method includes triggering an electronic device to activate a gesture recognition mode in response to detecting that a condition for activating the gesture recognition mode is satisfied. The method includes obtaining radar data while the gesture recognition mode is activated, wherein the radar data includes time-velocity data (TVD). The method includes detecting a start and an end of a gesture based on the TVD of the obtained radar data. To classify the gesture, the method includes determining a gesture, from among a set of gesture, that corresponds to a portion of the TVD between the start and the end of the gesture. The method includes outputting an event indicator indicating that a user of the electronic device performed the gesture classified.

Abstract: Example smart panel display apparatus and related methods are disclosed herein. An example apparatus to control a display of an electronic device includes a user presence detector to determine a presence of a user relative to the device based on image data generated by an image sensor of the device. The example apparatus includes a gaze detector to determine a direction of a gaze of the user relative to the image sensor based on the image data. The example apparatus includes a backlight manager to selectively adjust a display brightness based on the presence of the user and the direction of the gaze of the user.

Abstract: A specific solution includes: as an electronic device is folded, dividing a display screen of the electronic device into a first screen and a second screen; when the electronic device is in a folded state, detecting that the electronic device is in a landscape state or a portrait state; and if the electronic device is in the landscape state, displaying a first interface in response to horizontal unfolding of the electronic device, where the first interface includes a payment mode of one or more applications; or if the electronic device is in the portrait state, displaying a second interface in response to vertical unfolding of the electronic device, where the second interface includes any one of a lock screen interface, a main interface, or an interface displayed before the electronic device is folded.

Abstract: Systems, apparatuses (or devices), methods, and computer-readable media are provided for generating virtual content. For example, a device (e.g., an extended reality device) can obtain an image of a scene of a real-world environment, wherein the real-world environment is viewable through a display of the extended reality device as virtual content is displayed by the display. The device can detect at least a part of a physical hand of a user in the image. The device can generate a virtual keyboard based on detecting at least the part of the physical hand. The device can determine a position for the virtual keyboard on the display of the extended reality device relative to at least the part of the physical hand. The device can display the virtual keyboard at the position on the display.