Abstract: A method for coordinating actions between an audio channel and a synchronized non-audio channel includes receiving an indication of a start of a session associated with a user and having an audio channel that is synchronized with a non-audio channel. Thereafter, repeated determinations are made as to whether a prompt on the non-audio channel has been received from the user. In response to each determination that the prompt on the non-audio channel has not been received from the user, a signal is sent to cause an inaudible output on the audio channel to the user. In response to a determination that the prompt on the non-audio channel has been received from the user, an audible output is selected based on an activity by the user on the non-audio channel, and a signal is sent to cause the audible output to be output on the audio channel.

Abstract: A method for vehicle eye tracking is described. The method includes capturing sensor data based on eye tracking of a vehicle operator. The method also includes identifying sensor data associated with an external environment of a vehicle within the captured sensor data. The method further includes filtering out a sensor data associated with the external environment from the captured sensor data to provide an internal vehicle sensor data. The method also includes controlling a vehicle interface based on the internal vehicle sensor data.

Abstract: A sensing system has transmitting antennas and receiving antennas. The placement of the sensing system is adapted to enhance the sensing system's ability to process the signals so as to provide information regarding the touch between fingertips, the pinching of fingers and the touching of objects.

Abstract: A modular display apparatus may include a docking station having a plurality of spaces; a plurality of back plates provided in the plurality of spaces; a plurality of power boards provided on the plurality of back plates, each power board of the plurality of power boards including an interface including a plurality of pins; a plurality of display apparatuses connected to the interfaces of the plurality of power boards and mounted in the plurality of spaces; and a processor.

Abstract: This disclosure relates to systems, media, and methods for quantifying and monitoring exercise parameters and/or motion parameters, including performing data acquisition, analysis, and providing scientifically valid, clinically relevant, and/or actionable diagnostic feedback. Embodiments may be related to systems, devices, methods, and computer-readable media for providing baseline-adjusted real-time feedback to a user. Embodiments may include determining a type of activity for the user. Embodiment may include receiving data from the one or more motion sensors indicating a time-dependent series of three axis acceleration data and three-axis orientation data. Embodiments additionally may include providing a graphical user interface with a real-time representation of the received data.

Abstract: A display device includes a main body provided with a display module on which an image is displayed, a bending module located at a center of a rear surface of the main body, and a controller. The controller includes controlling the bending module to change a curvature of the display module to any one of a flat mode in which the display module is flat, a first bending mode in which the display module has a first curvature, and a second bending mode in which the display module has a second curvature. Here, the second curvature is a maximum curvature of the display module. The controller further includes switching the display module to any one of the flat mode, the first bending mode, and the second bending mode based on a distance to a remote controller.

Abstract: An interactive display includes a transparent display panel configured to simulate a windowpane. The interactive display also includes a motion-tracking device located behind the transparent display panel and configured to perform tracking of movement of a device directed at a front of the transparent display panel, wherein the device is configured to be manipulated by a user. The transparent display panel is configured to display feedback indicative of the tracked movement of the device.

Abstract: An optical subsystem of a near-eye display system provides for projecting light of a virtual image of image content to an eye location, and provides for collecting light of the virtual image onto an exit pupil on a surface proximate to an outer surface of an eye when at the eye location. A subpupil modulator within an aperture in cooperation with the optical subsystem provides for forming a plurality of subpupils within the exit pupil, and provides for less than all of the light of the virtual image associated with one or more less than all of the plurality of subpupils to be projected to the eye location. In various independent aspects: at least two subpupils overlap by at least 20 percent; and the intensities of the subpupils are individually and independently controlled.

Abstract: An augmented reality system that includes processors and storage devices storing instructions. The instructions configure the processors to perform operations. The operations include identifying a writing object in a video feed being displayed in an augmented reality viewer, identify a tip of the writing object based on a contour of the writing object, and tracking movements of the tip in the augmented reality viewer. The operations may also include generating a virtual file, the virtual file storing the tracked movements and generating a text file by performing an image recognition operation associating the tracked movements stored in the virtual file with one or more characters.

Abstract: An information handling system may include a processor, a data storage device, a power management unit, a thermo-haptic mouse, including an array of thermoelectric generators of a thermo-haptic module to selectively heat or cool a portion of the thermo-haptic mouse to be felt by a user of the thermo-haptic mouse, and a piezoelectric actuator of the thermo-haptic module to selectively apply a vibration to the portions of the thermo-haptic mouse to be felt by the user of the thermo-haptic mouse, and the processor executing code of a mouse training machine learning system to: receive, as training input, captured images during the execution of a gaming application and provide, as output, image recognition dataset descriptive of recognized game action event environmental data during execution of the gaming application, the image recognition dataset to be used by the processor executing a thermo-haptic feedback model evaluation system to provide thermo-haptic signals to the array of thermoelectric generators and th

Abstract: An extended reality headset is configured to position and stabilize the headset on a face when worn. For example, the headset can include an external frame with first and second side pieces coupled to a display structure and configured to provide lateral stabilization. In some examples, the headset can include a front head-engaging structure front head-engaging structure that is rotationally coupled to the external frame via a pivot point. The headset can also include a rear head-engaging structure coupled the external frame. In some examples, the rear head-engaging structure can include a tensioning mechanism to adjust the headset to fit various head shapes. Additionally, the headset can include a flexible strap coupled to the front head-engaging structure and the tensioning mechanism. In some examples, applying tension to the flexible strap by the tensioning mechanism can cause the front head-engaging structure to rotate along the pivot point, providing a secure fit.

Abstract: Embodiments of the present application disclose a deformation control method, a deformation control apparatus, and a user equipment (UE). The method comprises: generating trigger information according to a focus behavior of a user on at least one associated region in multiple associated regions on a deformation controllable device, where the multiple associated regions are multiple regions on which the user synchronously focuses or will synchronously focus; and controlling, in response to the trigger information, the deformation controllable device to be deformed to a target shape that meets at least one shape restriction condition. The at least one shape restriction condition comprises: a value of at least one angle between at least one normal line of any associated region in the multiple associated regions and at least one normal line of any other associated region is less than an angle threshold.

Abstract: An image processing system, which estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape by using a photographed image acquired by photographing an inside of the object with the camera, includes a processor. The processor estimates a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image. In addition, the processor performs bundle adjustment for correcting the position and the pose of the camera and the coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.

Abstract: A multi-function remote control contains: a new remote control and a network control system. The new remote control includes two control panels, and each of the two control panels including a first learning unit, a learning button, and multiple blank buttons. A first learning unit of a first control panel includes a radio frequency (RF) module, and the RF module includes a first emitter element and a first receiver element. A second learning unit of a second control panel includes an infrared (IR) module which includes a second emitter element configured to send first infrared signals, and the IR module includes a second receiver element configured to receive second infrared signals of another electrical remote control. Furthermore, the second receiver element is also configured to send the second infrared signals to the integration chip.

Abstract: The moving route guidance device includes: display control means configured to execute display control to change at least one of a content and a display position of the route guidance image based on position information of the moving body. The route guidance image includes: a plurality of route identification images respectively corresponding to the plurality of the movable routes that are close to each other and displayed in a manner to correspond to a visually recognized position relationship between the plurality of the movable routes by the driver or a predetermined reference position; and an route instructing image displayed in association with the route identification image that corresponds to the moving route guided by the route guidance image of the plurality of the movable routes.

Abstract: The disclosed technologies address various technical problems, including improving human-computer interaction, by augmenting the functionality provided by user input devices using a digital glove. For example, a digital glove can be utilized to provide pressure sensitivity for non-pressure sensitive touchscreen devices, attribute input made with a digital pen to a user wearing the digital glove, augment the functionality provided by mice and other types of handheld user input devices, augment the functionality provided gaze tracking systems, improve camera-based motion tracking systems, and to augment the functionality provided by speech recognition systems.

Abstract: Enhanced eye-tracking techniques for augmented or virtual reality display systems. An example method includes obtaining an image of an eye of a user of a wearable system, the image depicting glints on the eye caused by respective light emitters, wherein the image is a low dynamic range (LDR) image; generating a high dynamic range (HDR) image via computation of a forward pass of a machine learning model using the image; determining location information associated with the glints as depicted in the HDR image, wherein the location information is usable to inform an eye pose of the eye.

Abstract: An artificial-reality system comprising (1) a wearable dimensioned to be donned on a body part of a user, wherein the wearable comprises (A) a set of electrodes that detect one or more neuromuscular signals via the body part of the user and (B) a transmitter that transmits an electromagnetic signal, (2) a head-mounted display communicatively coupled to the wearable, wherein the head-mounted display comprises a set of receivers that receive the electromagnetic signal, and (3) one or more processing devices that (1) determine, based at least in part on the neuromuscular signals, that the user has made a specific gesture and (2) determine, based at least in part on the electromagnetic signal, a position of the body part of the user when the user made the specific gesture. Various other apparatuses, systems, and methods are also disclosed.

Abstract: Methods and systems are described herein for improved techniques for consuming and interacting with media content. Specifically, the media guidance application may generate holographic animations that move from a holographic structure from which a user has selected a media asset and direct the user to a display device capable of presenting the media asset. For example, in response to a user selecting a baseball movie from a holographic bookcase, the media guidance application may generate for display a holographic baseball that is “thrown” from the bookcase to a television that will present the baseball movie.

Abstract: A martial arts training system comprising: (a) one or more hand held targets; (b) one or more wearable devices; and (c) trainee log-in hardware installed in said target(s) and said wearable device(s).

Abstract: A vehicle image processing device includes a camera that images surroundings of a vehicle and outputs video data. An image extraction unit extracts an image from the video data when a predetermined operation for instructing image acquisition is performed, and an image processing unit processes the extracted image in accordance with a field of view of the user in a vehicle interior. A display processing unit and a display device display the processed image on a screen arranged at a position aligned with a line of sight of the user.

Abstract: There are included: a detection unit that detects a positional relationship between a user and an object on the basis of an image captured by a camera; a determination unit that determines a situation of the user on the basis of the positional relationship between the user and the object detected by the detection unit; and a response control unit that executes a voice response corresponding to the situation of the user determined by the determination unit.

Abstract: The present invention concerns a method and apparatus for the modulation of an acoustic field for providing tactile sensations. A method of creating haptic feedback using ultrasound is provided. The method comprises the steps of generating a plurality of ultrasound waves with a common focal point using a phased array of ultrasound transducers, the common focal point being a haptic feedback point, and modulating the generation of the ultrasound waves using a waveform selected to produce little or no audible sound at the haptic feedback point.

Abstract: Systems and methods for intelligent display of content are disclosed herein. According to one illustrative method, a computing device camera captures an image of a face. The control circuitry determines, based on the captured image, whether at least a portion of the face is directed toward a computing device display. The control circuitry retrieves, from a memory, a rule specifying criteria for determining whether to block or permit presentation of content based on whether one or more faces are directed toward the display. The control circuitry determines, based on the rule and whether at least a portion of the face is directed toward the display, whether to block or permit the presentation of the content, and blocks or permits the presentation of the content via the computing device based on a result of the determining.

Abstract: Disclosed techniques include video performance rendering modification based on device rotation metric. A media stream is received from a server. The media stream is targeted for display on a handheld media stream playback device. An orientation of the handheld device is determined during playback of the media stream on the handheld device. A change in the orientation of the handheld device is detected. The change occurs during playback of the media stream. Based on the detecting the change of orientation, a rotation angle of the handheld device is calculated. Based on the rotation angle, the playback speed of the media stream on the handheld device is changed. The changing the playback speed changes direction of playback rendering based on the rotation angle of the handheld device. The changing direction provides forward playback by rotating the handheld device in a clockwise direction from an initial orientation.

Abstract: A method and apparatus for firearm training simulator which simulates realistic recoil of conventional firearms. The method and apparatus incorporates a linear motor and controllable mass for generating recoil. One embodiment includes an adjusting system for adjusting the amount of recoil provided. Also provided are means for simulating semiautomatic and/or full automatic operation of firearms. One embodiment can include a laser emitter which simulates the path for a bullet fired from a firearm that the method and apparatus is simulating.

Abstract: A portable information handling system rotates a lid housing portion integrating a display from a closed to an open position with a motorized hinge. One or more sensors monitor an end user position during the rotating from the closed to the open position so that the motorized hinge aligns the display with a desired viewing position relative to the end user, such as substantially perpendicular to the end user's gaze. The one or more sensors monitor the end user during usage of the information handling system to adjust the motorized hinge as the end user's position changes relative to the display over time.

Abstract: Systems and methods are provided for enhanced pose generation based on generative modeling. An example method includes accessing an autoencoder trained based on poses of real-world persons, each pose being defined based on location information associated with joints, with the autoencoder being trained to map an input pose to a feature encoding associated with a latent feature space. Information identifying, at least, a first pose and a second pose associated with a character configured for inclusion in an in-game world is obtained via user input, with each of the poses being defined based on location information associated with the joints and with the joints being included on a skeleton associated with the character. Feature encodings associated with the first pose and the second pose are generated based on the autoencoder. Output poses are generated based on transition information associated with the first pose and the second pose.

Abstract: Computer-generated image data is presented on first and second displays of a binocular headset presuming that a user's left and right eyes are located at first and second positions relative to the first and second displays respectively. At least one updated version of the image data is presented, which is rendered presuming that at least one of the user's left and right eyes is located at a position different from the first and second positions respectively in at least one spatial dimension. In response thereto, a user-generated feedback signal is received expressing either: a quality measure of the updated version of the computer-generated image data relative to computer-generated image data presented previously; or a confirmation command. The steps of presenting the updated version of the computer-generated image data and receiving the user-generated feedback signal are repeated until the confirmation command is received.

Abstract: A piezoelectric vibration module has a first soft circuit board and a plurality of piezoelectric units. The first soft circuit board includes a plurality of cutting areas. Two adjacent cutting areas are spaced with a cut through groove. Each piezoelectric unit is respectively configured below each cutting area.

Abstract: A sensor device includes a capacitive touch panel including a plurality of electrodes, an input device configured such that a resonance circuit including a first conductor and a second conductor is covered with a non-conductor, and a sensor controller. The first conductor and the second conductor are capacitively coupled to at least one of a plurality of electrodes in the touch panel when the input device is disposed on the touch panel or when the input device disposed on the touch panel is operated. The sensor controller is configured to detect positions of the first conductor and the second conductor on the touch panel by applying a voltage to the plurality of electrodes in the touch panel based on a resonance frequency of the resonance circuit.

Abstract: An information processing method is provided for a terminal device. The method includes obtaining an image including an AR target; recognizing the AR target, and generating a virtual scene including N virtual objects (N being an integer greater than or equal to 2); disassembling the virtual scene to obtain the N virtual objects; and generating object information that separately corresponds to the N virtual objects, which include a target virtual object to be interacted with by a user. The method also includes keeping the object information of virtual objects other than the target virtual object in the N virtual objects unchanged and updating the object information of the target virtual object in response to receiving an operation instruction inputted by the user for the target virtual object, such that the target virtual object is interacted independently rather than the virtual scene as whole by the user.

Abstract: Systems and methods for decoding intended symbols from neural activity in accordance with embodiments of the invention are illustrated. One embodiment includes a symbol decoding system for brain-computer interfacing, including a neural signal recorder implanted into a brain of a user, and a symbol decoder, the symbol decoder including a processor, and a memory, where the memory includes a symbol decoding application capable of directing the processor to obtain neural signal data from the neural signal recorder, estimate a symbol from the neural signal data using a symbol model, and perform a command associated with the symbol.

Abstract: A system for magnifying content including a display; a camera for acquiring a user's eye gaze direction onto a display so as to obtain gaze data; and a computer coupled to the display, wherein the computer maps the gaze data onto a desired location on the display, provides a center of magnification on the display, and moves the center of magnification onto the desired location so as to magnify the content on the display.

Abstract: An information processing device includes a processor configured to query a user about an operation item to be executed by equipment in a case where biological information about the user satisfying a specific condition is acquired, but a single operation item of the equipment to associate with the acquired biological information is not specified, and associate an operation item designated by the user in response to the query with the acquired biological information.

Abstract: A device displays a first selectable user interface (UI) element associated with a first touch activation region. The device detects a change of movement of the display. In response to the change of movement, the device adjusts the first touch activation region to encompass a new area. The new area is at least partially different from the first touch activation region prior to the change of movement and is based on the change of the movement. After detecting the change of movement, the device detects a touch input. In accordance with a determination that the touch input is detected within the adjusted first touch activation region, the device performs a user interface operation associated with the first selectable UI element. In accordance with a determination that the touch input is detected outside the adjusted first touch activation region, the device forgoes performance of the user interface operation.

Abstract: A method, system, apparatus, and/or device for moving or scrolling a virtual object in a virtual or augmented reality environment. The method, system, apparatus, and/or device may include: detecting, by a first sensor, a first gesture associated with selecting a first virtual object in an augmented reality environment displayed by a head-mounted display; displaying, by the head-mounted display, a first indicator indicating a selection of the first virtual object by a user; detecting, using the first sensor or a second sensor, a first movement of the head-mounted display associated with a first movement command; and in response to detecting the first movement of the head-mounted display, executing the first movement command, where the first movement command is a scrolling function to scroll text or a graphical object of the first virtual object or a movement function to move the text or the graphical object of the first virtual object.

Abstract: A method for interactive collaboration between a streamer user and a remote collaborator. The method includes receiving, by a collaborator computing device, streaming images taken by a streamer computing device. A collaborator user interface is generated and provided for output by the collaborator device. The collaborator user interface includes the received images. Hand tracking data is received by the collaborator device. The collaborator user interface is updated to include a representation of the hand tracking data and the received images. The hand tracking data is transmitted by the collaborator device to the streamer device for inclusion on a streamer user interface that is generated and provided for output by the streamer device.

Abstract: An object approaching a wearable device of a user is identified. In response to determining that the approaching object is a previously identified target of the user, one or more applications displayed in a user interface of the wearable device, and how said one or more applications are organized on the user interface of the wearable device, are modified based on the identified approaching object. The modified user interface is displayed to the user.

Abstract: A system for vibration-driven sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include a vibration sensor that is incorporated into the wearable and generates an electrical response that corresponds to a vibration detected at the wearable. The system may further include at least one processing device communicatively coupled to the vibration sensor. The processing device may determine, based at least in part on the electrical response generated by the vibration sensor, that the user has made a specific gesture with at least one body part. In response to this determination, the processing device may generate an input command for the artificial reality system based at least in part on the specific gesture made by the user. Various other systems and methods are also disclosed.

Abstract: A display apparatus includes: a display panel configured to display an image; a data driver configured to output a data voltage to a data line of the display panel; a touch driver configured to identify a touch input to the display panel; a power voltage generator configured to generate a touch power voltage; and a mixer configured to mix a periodical signal to the touch power voltage to generate a mixing signal and configured to provide the mixing signal to the touch driver in a test mode.

Abstract: A method includes obtaining sensor coordinates corresponding to positions on a sensor pointed to by an electronic pen, and values determined based signals received from the electronic pen; mapping, using a first mapping method, a first set of the sensor coordinates to first display screen coordinates; determining that a first one of the values is greater than or equal to a first threshold value; determining that a second one of the values is less than or equal to a second threshold value, after determining that the first one of the values is greater than or equal to the first threshold value; and in response to determining that the second one of the values is less than or equal to the second threshold value, mapping, using a second mapping method, a second set of the sensor coordinates to a second display screen coordinates.

Abstract: This patent provides a novel stereoscopic imaging system. In the preferred embodiment, the improved stereoscopic imaging system would be incorporated onto a smart phone, which is called the stereoscopic smart phone (SSP). The SSP would work in conjunction with one or more stereoscopic head display units (SHDUs). Once this system is operational, it will allow significant improvements to obtaining stereoscopic imagery. One novel aspect of this patent comprises wherein the stereoscopic cameras on the SSP can move in position to alter stereo separation distance and change the convergence to optimally image a scene.

Abstract: A system and method for simultaneously displaying, in plural spatially distinct zones via a multi-view display, differentiated content is disclosed. In accordance with the method, a plurality of spatially distinct zones are defined, differentiated content is assigned to the zones, a location for at least some of plural landing spots of beamlets projected by multi-view pixels of the multi-view display is estimated, the spatially distinct zone in which each said landing spots resides is determined, and beamlets associated with said some landing spots are driven to cause an appropriate content portion to be viewable at said some landing spots, as a function of location in a particular spatially distinct zone.

Abstract: A control system for a compressed air system is configured to implement an “away mode” of operation that provides for a temporary override of the operation of the compressed air system, which can be easily enabled and disabled. During a period of down time, when the away mode of operation is enabled, the control system causes the compressed air system to operate in a limited capacity (e.g., maintaining limited system pressure, flow, higher dewpoint/humidity level, etc.) to minimize energy usage and limit unnecessary wear on system equipment without shutting down the compressed air system.

Abstract: According to an aspect, a method for designing an eye tracker on a wearable device includes selecting a first three-dimensional (3D) model of at least a head of a person, selecting a second 3D model of a wearable device, positioning a synthetic eye within the first 3D model, positioning an eye tracker component at a first location on the second 3D model, the eye tracker component including at least one of an eye tracker sensor or a light source, moving at least one of the first 3D model or the second 3D model such that at least a portion of the first 3D model contacts at least a portion of the second 3D model, and generating performance data with the eye tracker component positioned at the first location on the second 3D model.

Abstract: A method of operating an input device can include generating a light beam by a light source module, steering the light beam towards a target location on an underlying surface, steering a reflected light beam towards an image sensor of the input device, receiving the reflected light beam by the image sensor, and generating tracking data by the image sensor that corresponds to a two-dimensional (2D) movement of the input device on the underlying surface. The method further includes determining that the input device is operating: on and in contact with the underlying surface when the reflected light beam received by the image sensor is located on a first set of pixels of the image sensor, and above and not in contact with the underlying surface when the reflected light beam is located on a second set of pixels of the plurality of pixels of the image sensor.

Abstract: The techniques disclosed herein provide systems that can control the invocation of precision input mode. A system can initially utilize a first input device, such as a head-mounted display device monitoring the eye gaze direction of a user to control the location of an input target. When one or more predetermined input gestures are detected, the system can then invoke a precision mode that transitions the control of the input target from the first input device to a second input device. The second device can include another input device utilizing different input modalities, such as a sensor detecting one or more hand gestures of the user. The predetermined input gestures can include a fixation input gesture, voice commands, or other gestures that may include the use of a user's hands or head. By controlling the invocation of precision input mode using specific gestures, a system can mitigate device coordination issues.

Abstract: When a gesture operation of a hand moving close to a display from left to right is performed, the return movement of the hand to the left side due to reflection by the wrist or the like may be detected. A detection control unit detects the approach of the hand to the display and notifies a data processing device of non-detection of hand approach when the amount of movement of the hand in the right direction starts to decrease after exceeding a threshold value. The data processing device accepts the right-moving gesture operation to perform a predetermined process when the amount of movement exceeds the threshold value.

Abstract: The present disclosure generally relates to controlling electronic devices. In some examples, the electronic device uses gaze information to activate a digital assistant. In some examples, the electronic device uses gaze information to identify an external device on which to act. In some examples, the electronic device provides an indication that distinguishes between different speakers.