Abstract: An immersive three-dimensional display with interactive content panels which is responsive to input from users' interactions is disclosed. A panoramic image is spherically mapped to a virtual three-dimensional space. Interactive content is configured with transparent images to form interactive content panels. The interactive content panels thus formed are positioned within the three-dimensional space to form the immersive 3D display with a background comprising the panoramic image. The immersive 3D display is transmitted to the client device for display to the user.

Abstract: In general, this disclosure describes a suspend mode feature for artificial reality systems and, more specifically, system configurations and techniques for generating a suspend mode environment during execution of an artificial reality application, and presenting and controlling user interface (UI) elements within the suspend mode environment. The suspend mode feature enables a user interacting with one or more other users (or one or more avatars corresponding to the one or more other users) within an artificial reality (AR) environment to suspend the AR environment from the user's perspective. While in the suspend mode environment, the user is able to view and select the other users from the AR environment. For example, the user may select another user to friend, message, mute, block, or report that user from the suspend mode environment.

Abstract: The present application provides a method and apparatus for human-computer interaction in a display device, and a computer device and a storage medium. The method comprises: a display device acquiring current image data of a user, and displaying multiple pieces of different candidate data in different display regions when it is detected that the user is in a squarely viewing state, so that the user browses the candidate data; and the display device identifying a target display region which is focused on, and reading candidate data corresponding to the target display region, and executing an operation corresponding to the read candidate data.

Abstract: The present technology relates to devices and systems for volume visualization and interaction in a virtual reality or augmented reality environment.

Abstract: Methods, apparatus, systems are disclosed for altering displayed content on a display device responsive to a user's proximity. In accord with an example, a computing system includes a memory, a sensor to collect data representative of a viewing distance between a display and a user of the display, and a scaler to adjust a size of at least one object displayed by the display based on the viewing distance from the display.

Abstract: A backlight device includes a first surface and a second surface that is opposite to the first surface. The backlight device is configured to emit light in a first optical band through the second surface toward a display panel of a head-mounted display (HMD). The display panel is configured to convert the light from the backlight device to image light. The backlight device is transparent to light in a second optical band that is different than the first optical band. An eye tracking system illuminates an eyebox with light in the second optical band. A camera assembly positioned adjacent to the first surface of the backlight device. The camera assembly is configured to capture images of the eye in the second optical band through the backlight device, the display panel. The eye tracking system determines eye tracking information based at least in part on the captured images.

Abstract: Systems and methods for transferring data via a smart contact lens from a first user interface (“UI”) to a second UI is provided. Methods may include triggering a tracking of the focus of the user's eyes on the first UI and further tracking a start point and an end point of the focus of the user's eyes based on detection of deliberate blink gestures. Methods may further include capturing a segment of data within the start point of focus and the end point of focus and storing the segment of data in memory on the smart contact lenses. Methods may further include updating the second UI based on an instruction in a data packet transmitted to the second UI, by inputting the segment of data at a point of focus of the user's eye on the second UI.

Abstract: A method for rendering computer graphics based on saccade detection is provided. One embodiment of the method includes rendering a computer simulated scene for display to a user, detecting an onset of a saccade that causes saccadic masking in an eye movement of the user viewing the computer simulated scene, and reducing a computing resource used for rendering frames of the computer simulated scene during at least a portion of a duration of the saccade. Systems perform similar steps, and non-transitory computer readable storage mediums each storing one or more computer programs are also provided.

Abstract: An electronic device such as a wearable device may have a light guide system. The light guide system may have one or more light guide members. The light guide members may be formed from transparent elastomeric material such as silicone or other flexible material. Light sources such as light-emitting diodes and/or lasers may be used to supply light to the light guide members. The light guide members may have light-scattering structures that are configured to scatter light out of the light guide members at one or more locations along the lengths of the light guide members. Optical isolation layers such as coatings of white polymer or other flexible structures may be used to help confine light within the light guide members. A detector may be coupled to a light guide to detect light guide deformation due to contact with an external object.

Abstract: A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.

Abstract: A finger-mounted device may include finger-mounted units. The finger-mounted units may each have a body that serves as a support structure for components such as force sensors, accelerometers, and other sensors and for haptic output devices. The body may have sidewall portions coupled by a portion that rests adjacent to a user's fingernail. The body may be formed from deformable material such as metal or may be formed from adjustable structures such as sliding body portions that are coupled to each other using magnetic attraction, springs, or other structures. The body of each finger-mounted unit may have a U-shaped cross-sectional profile that leaves the finger pad of each finger exposed when the body is coupled to a fingertip of a user's finger. Control circuitry may gather finger press input, lateral finger movement input, and finger tap input using the sensors and may provide haptic output using the haptic output device.

Abstract: A controller is configured to be coupled to a millimeter-wave radar mounted on a device, where the millimeter-wave radar includes a field of view in a direction away from the device. The controller is configured to: detect a presence of an object in a first range zone of a plurality of range zones of the field of view, where each range zone of the plurality of range zones respectively corresponds to different distance ranges relative to the device, and where each range zone is associated with a respective command database; determine a gesture signature based on detecting the presence of the object in the first range zone of the field of view; and cause execution of a command chosen from the respective command database associated with the first range zone as a function of the gesture signature.

Abstract: A method for remotely controlling a computing device comprises repeatedly capturing an image from a video frame, detecting a human face in the captured image, matching the detected human face to a previously detected human face, extracting facial landmarks from the matched detected human face, estimating a 3D head pose of the matched detected human face based on the extracted facial landmarks, the 3D head pose being represented in an egocentric coordinate system by a 3D pose vector which is directed from the human face, the 3D pose vector being free to rotate around x-, y- and z-axes of the egocentric coordinate system using respective rotation matrices and free to translate along these x-, y- and z-axes using a translation vector, and controlling a user interface on a display screen of the computing device according to the estimated 3D head pose.

Abstract: A method including capturing a series of image frames of a hand. The method includes generating a map of hand landmarks for each in the series of image frames. The method includes determining whether the maps of hand landmarks include at least: (i) a first map that matches a first reference map of hand landmarks representing a hand in substantially a start position of a snap motion and (ii) a subsequent, second map that matches a second reference map of hand landmarks representing a hand in a progressed (e.g., intermediate or end) position of a snap motion. The method includes determining that a finger-snap gesture is detected in response to determining that the first map and second map were generated from image frames captured within a snap time limit; and executing an action corresponding to a determination that a finger-snap gesture is detected in the series of image frames.

Abstract: The present document relates to a user intention-based gesture recognition method and apparatus, and an electronic device comprises one or more sensors, a memory, and a processor, wherein the processor can be configured to check a distance between the electronic device and the user by using the one or more sensors, detect a user gesture by operating in a first gesture mode on the basis of the checked distance satisfying a designated range by using the one or more sensors, detect the user gesture by operating in a second gesture mode on the basis of the checked distance deviating from the designated range, and perform an operation corresponding to a valid gesture on the basis of the detected gesture being a valid gesture. Other various embodiments are possible.

Abstract: An integrated functional multilayer structure includes a flexible, 3D-formable substrate film having a first surface facing towards an environment of the structure and a user therein, and an opposite second surface facing towards the internals of the structure, wherein the first and second surfaces and remaining material of the substrate film in between locally define a three-dimensional protrusion extending from a plane of surrounding substrate film material and formed from locally stretched and shaped material of the substrate film, side walls perceptible by touch; circuitry provided upon the substrate film includes a number of conductive traces, electrodes and/or components to detect touch on two or more of the plurality of side walls and at least one fill layer upon the substrate film to at least partially embed the circuitry.

Abstract: An electronic device includes an enclosure, a substrate within the enclosure, a keycap support mechanism, and a keycap supported by the keycap support mechanism and movable relative to the substrate. The keycap includes a body, a mask layer defining a glyph opening, and a semitransparent mirror layer positioned within the glyph opening. The electronic device also includes a light source configured to direct light through the semitransparent mirror layer.

Abstract: A keyboard overlay film forming a plurality of keycap accommodating cavities and a key-gap space, the key-gap space surrounding the keycap accommodating cavities, and the keycap accommodating cavities respectively including a key projection surface, wherein the keyboard overlay film includes a top protective layer; a character layer located on a side of the top protective layer forming the keycap accommodating cavities, and the character layer includes a plurality of light-transparent characters respectively corresponding to the key projection surface of the keycap accommodating cavities; a set of touch electrodes located on a side of the character layer opposite to the top protective layer; and a lower protective layer located on a side of the set of touch electrodes opposite to the character layer.

Abstract: A method for controlling movement of a computer display cursor based on a point-of-aim of a pointing device within an interaction region includes projecting an image of a computer display to create the interaction region. At least one calibration point having a predetermined relation to the interaction region is established. A pointing line is directed to substantially pass through the calibration point while measuring a position of and an orientation of the pointing device. The pointing line has a predetermined relationship to the pointing device. Movement of the cursor is controlled within the interaction region using measurements of the position of and the orientation of the pointing device.

Abstract: A mouse device comprising a base, a first circuit board, a scroll wheel bearing, a light-emitting component and a scroll wheel. The first circuit board is disposed on the base. The scroll wheel bearing is mounted to the base. The light-emitting component is disposed on the scroll wheel bearing, and is electrically connected to the first circuit board. The scroll wheel is rotatably connected to the base and the scroll wheel bearing. The light-emitting component is disposed between the scroll wheel and the scroll wheel bearing. By disposing the light-emitting component in the scroll wheel, the light emitted from the light-emitting component would pass through the scroll wheel and the scroll wheel bearing to the outside, which can be evenly emitted from each side of the scroll wheel and the scroll wheel bearing for even light distribution and scrolling without obstruction.

Abstract: Electrode configurations for reducing wobble error for a stylus translating on a surface over and between electrodes of a touch sensor panel are disclosed. In some examples, electrodes associated with a more linear signal profile are correlated with lower wobble error. In some examples, electrodes can have projections which can interleave with projections of adjacent electrodes. In some configurations, projections of adjacent electrodes can be interleaved in one-dimension; in other configurations, projections of adjacent electrodes can be interleaved in two-dimensions. In some configurations, the width and length of one or more projections in an electrode can be selected based on a desired signal profile for that electrode.

Abstract: An electronic device includes a display for displaying data stored on the electronic device; input means; sensing means for sensing the three-dimensional position of the input means relative to the device; and control means for controlling the data displayed on the display in dependence on the three-dimensional position of the input means relative to the device. The input means includes a source of electromagnetic radiation for directing an infrared conical beam onto the display. The sensing means can sense the elliptical eccentricity of the electromagnetic radiation incident on the display to determine the angle at which it strikes the display, and can sense the area of the electromagnetic radiation incident on the display to determine the distance of the input means from the display.

Abstract: Disclosed are a driving circuit, a stylus and an electronic device. The driving circuit includes: a power supply assembly, at least one energy storage capacitor, a switch assembly and a driving electrode. In a driving cycle: the switch assembly is configured to control connections among the power supply assembly, the at least one energy storage capacitor and the driving electrode, so that the driving electrode outputs a first voltage, at least one second voltage and a third voltage, wherein the first voltage and the third voltage are respectively a maximum voltage and a minimum voltage output by the driving electrode, and the sum of energy storage voltages of the at least one energy storage capacitor is less than the first voltage. The driving circuit, the stylus and the electronic device of the embodiment of the present application could reduce a power consumption.

Abstract: A knob device is applicable to a touch panel. The knob device includes a knob cover, a plurality of sensing pads and a rotation sensing element. The plurality of sensing pads are fixedly arranged on the touch panel. A gap is form between two sensing pads. The plurality of sensing pads and gaps are distributed in a ring area around a center of an orthographic projection of the knob cover. The rotation sensing element is connected to the knob cover. When the knob cover is turned to be rotated, the rotation sensing element is rotated synchronously. When a user touches the knob device and the rotation sensing element overlaps one of the plurality of sensing pads, the touch panel generates a rotation sensing signal in response to a location of the rotation sensing element.

Abstract: The present disclosure provides a touch device and a manufacturing method thereof. The touch device includes a substrate, a touch electrode layer, a protective layer, and a plurality of wires. The substrate includes a first region and a second region, in which the second region is adjacent to the first region. The touch electrode layer is disposed in the first region and is completely covered by the protective layer. The protective layer has a plurality of openings. The openings expose a portion of the touch electrode layer and extend from the first region to the second region. Each wire is formed in the corresponding openings and extends from the portion of the touch electrode layer to the second region, in which each opening is partially filled with one of the wires, and thereby a recess is defined in each opening.

Abstract: A touch display device includes a display unit including pixels disposed in an active area, an encapsulation unit disposed on the display unit, and a touch-fingerprint fusion sensor unit having a touch sensor function and a fingerprint sensor function in the active area on the encapsulation unit. The touch-fingerprint fusion sensor unit includes first fingerprint sensor electrodes disposed in a fingerprint sensor area on the encapsulation unit, a first touch insulating layer disposed on the first fingerprint sensor electrodes, second fingerprint sensor electrodes disposed in the fingerprint sensor area on the first touch insulating layer, a second touch insulating layer disposed on the second fingerprint sensor electrodes, and a plurality of first and second touch electrodes disposed on the second touch insulating layer. The first fingerprint sensor electrodes, the second fingerprint sensor electrodes, and the first and second touch electrodes overlap the non-emissive area.

Abstract: Provided is a display device and a portable terminal including the same. The display device includes a display panel including an active region and a peripheral region adjacent to the active region, n first touch sensors which are arranged successively along a first direction, extend in a second direction, each include a plurality of first connecting parts and a plurality of first sensor parts connected through the first connecting parts, and each generate an electric field together with an external touch pen; m second touch sensors which are insulated from the n first touch sensors, extend successively along the first direction, are arranged in the second direction, each include a plurality of second connecting parts and a plurality of second sensor parts connected through the second connecting parts, and each generate an electric field together with an external touch pen.

Abstract: A touch sensor according to an embodiment of the present disclosure may include a substrate layer, sensing electrodes that are formed on the substrate layer, and a black matrix that is formed on the same layer as the sensing electrodes or on a lower portion of the sensing electrodes. It may be possible to prevent excessive thermal damage to the sensing electrode which may occur during forming the black matrix after the sensing electrode is formed.

Abstract: A display device includes a display panel including a display area in which an image is displayed and a peripheral area disposed outside of the display area, and a touch sensor disposed on the display panel. The touch sensor includes a plurality of sensor electrodes formed in a repeated arrangement of sensor patterns that forms a touch active area, a plurality of sensor wirings connected to the sensor electrodes and disposed outside of the touch active area, and at least one insulating layer overlapping the display area and the peripheral area. At least a portion of the sensor electrodes is formed over the display area and the peripheral area.

Abstract: An electronic device described herein includes a touch screen for a touch sensitive display carried by a portable housing. The electronic device is configured to operate in a high detection threshold mode to determine whether an object is in contact with the touch sensitive display, and operate in a low detection threshold mode to determine whether the object is adjacent to the touch sensitive display, based on lack of detection of the object being in contact with the touch sensitive display. The electronic device is further configured to determine whether the object is in contact with a peripheral edge of the portable housing by determining whether the object is adjacent opposite sides of the touch sensitive display, based on detection of the object being adjacent to the touch sensitive display.

Abstract: A capacitive touch sensing device, with: (i) a logical array of capacitive buttons have a number R of rows and a number C of columns; (ii) a first node coupled to a first column in the number C of columns, the first node for receiving a first transmit voltage; (iii) a second node coupled to a second column in the number C of columns, the second node for receiving a second transmit voltage; (iv) a number of intermediate nodes between the first node and the second node, wherein each intermediate node is coupled to a respective column in the number C of columns; and (v) circuitry for applying a respective different voltage to each of the intermediate nodes in response to the first transmit voltage and the second transmit voltage.

Abstract: [Object] To make information processing based on a given application program operable by contactless operations. [Solution] A display unit forming a capacitive touch panel is provided. Changes in the capacitance values of respective capacitive sensors in the display unit are detected during a contactless operation, and on the basis of such changes in capacitance values, a contactless operation mode (gesture) of the contactless operation, and two-dimensional coordinate information corresponding to the contactless operation mode are detected. Then, execution of information processing corresponding to the detected contactless operation mode and two-dimensional coordinate information from among respective information processing in the currently activated application program is controlled. Thus, information processing in a given application program can be made operable by a contactless operation.

Abstract: A touch panel, a driving method thereof and a touch device are provided. The touch panel includes a plurality of electrode groups and a plurality of signal lines. In a first direction, the plurality of electrode groups are sequentially arranged and include a head electrode group arranged foremost; the plurality of signal lines include at least a first signal line and a second signal line; the head electrode group includes a first head electrode, a fourth head electrode, and a second head electrode and a third head electrode which are between the first head electrode and the fourth head electrode; the first head electrode and the fourth head electrode are electrically connected with the first signal line; the second signal line is only electrically connected with the second electrode alone.

Abstract: The present disclosure relates to a touch display panel capable of significantly reducing a number of touch channels provided in a touch display panel in related art and a touch display device including the touch display panel. To this end, the touch display panel according to the present disclosure includes a plurality of touch blocks with a plurality of touch electrodes arranged in a row direction and a plurality of touch lines arranged in a column direction and connected to the touch electrodes, and the touch block includes a total of 25 touch electrodes and nine touch lines. Accordingly, according to the present disclosure, the touch display panel may significantly reduce a number of touch channels and the touch electrodes may be flush with the touch lines.

Abstract: A display device includes a display panel which displays an image, a touch sensor which senses a touch, a display controller which drives the display panel, and a touch controller which drives the touch sensor. The display controller transfers a timing signal representing a timing of a display operation to the touch controller, and provides display driving information to the touch controller by modulating the timing signal in a blank period of a frame period.

Abstract: Disclosed is an electronic device that includes a housing including a first plate facing a first direction, the first plate including a fingerprint sensing area, a second plate facing a second direction opposite to the first direction, and a side member interposed between the first and second plates, a touch screen display interposed between the first and second plates and having at least a portion exposed through the first plate of the housing, a fingerprint sensor interposed between the touch screen display and the second plate, and a processor connected to the fingerprint sensor. The processor may determine whether the fingerprint sensing area is contaminated and determine whether to register a fingerprint image captured by the fingerprint sensor based on whether the fingerprint sensing area is contaminated. In addition, it is possible to implement other various embodiment understood through the disclosure.

Abstract: A content input method is provided. The content input method includes: obtaining pressure information applied to a first preset area of a display area; determining, according to a first pressure threshold, whether the pressure information applied to the first preset area is inadvertent touch information; when the pressure information applied to the first preset area is the inadvertent touch information, ignoring the pressure information.

Abstract: Implementations of a proximity detection device according to the present disclosure include a plurality of light emitting elements and a plurality of light receiving elements arranged in a lower portion of a touch panel display. The proximity detection device detects an object that is in proximity by reflected light received by the light receiving elements when irradiation light from the light emitting elements is reflected by the object. Implementations of a proximity detection device includes a drive circuit sequentially driving the plurality of light emitting elements, a measurement circuit measuring detection levels of the light receiving elements when the plurality of light emitting elements sequentially emit light, respectively, and a control unit having a function to estimate a position in the horizontal direction from a plurality of measurement results and correct the estimated position.

Abstract: A system includes a screen and a computer that detects an object near the screen and allows interaction between the object and the computer.

Abstract: An electronic device with ultrasonic touch is provided. The electronic device includes a display device, an ultrasonic transmission device, an ultrasonic reception device, a substrate, an ultrasonic controller, and a sensing circuit. The substrate is adjacent to the ultrasonic transmission device and the ultrasonic reception device. The ultrasonic controller generates a control signal. The ultrasonic transmission device generates an ultrasonic wave in a direction toward the substrate according to the control signal, and the ultrasonic reception device simultaneously receives the ultrasonic wave according to the control signal through the substrate and generates a sensing signal corresponding to the received ultrasonic wave. The sensing circuit determines a position whether a touch occurs according to the sensing signal to generate a touch signal.

Abstract: An electronic device with touch sensing function is provided, which includes first touch electrodes, second touch electrodes, and pixel circuits. The first touch electrodes are in parallel with a Y-axis, in which each first touch electrode includes first electrode blocks and bridge patterns. The first electrode blocks are coupled with the bridge patterns in series. The second touch electrodes are in parallel with an X-axis, in which each second touch electrode includes second electrode blocks and connection patterns. The second electrode blocks are coupled with the connection patterns in series and the X-axis is substantially perpendicular to the Y-axis. The pixel circuits are arranged as corresponding to the first touch electrodes and the second touch electrodes in a projection direction. The pixel circuits are configured to receive one or more voltages from the first touch electrodes and the second touch electrodes.

Abstract: A display device, includes: a base substrate; a display element layer on the base substrate, the display element layer including a driving electrode; an insulation layer on the display element layer, the insulation layer defining an active region and a peripheral region adjacent to the active region; an input sensing layer on the insulation layer, the input sensing layer including a sensing electrode that overlaps the active region and a compensation electrode that overlaps the peripheral region, the sensing electrode and the driving electrode forming a parasitic capacitor; and a detection control circuit electrically connected through an output node to the sensing electrode and the compensation electrode, wherein the detection control circuit is configured to control a capacitance of the parasitic capacitor using a first offset capacitor, the first offset capacitor being formed by the compensation electrode.

Abstract: A display device includes a display area and a frame area surrounding the display area. The display device comprises a TFT layer, a light-emitting element layer, a sealing layer including a first inorganic sealing film, an organic sealing film, and a second inorganic sealing film, a bank coated with the first inorganic sealing film and the second inorganic sealing film, a touch panel function layer, and a plurality of touch panel wires running to intersect with the bank in planar view and connected to the touch panel function layer. The second inorganic sealing film includes a bank coating that coats an upper face of the bank, and a protrusion, in a clearance between neighboring two of the plurality of touch panel wires, protrudes from the bank coating toward the display area or away from the display area.

Abstract: A chat robot may be used to facilitate interaction with a user in the determination of whether to initiate and process a data subject access request (DSAR). At a DSAR submission webpage, the chatbot may interact with a user to determine the information the user is in need of and/or the actions that the user may take. The chatbot may provide the information desired by the user, avoiding the processing overhead of submission and fulfillment of a DSAR. The chatbot may also facilitate completion of a DSAR on behalf of the user when needed.

Abstract: An interactive system is provided. The interactive system includes an electronic device, a first image display device and a second image display device. The electronic device transmits a first image information to the first image display device for display. The electronic device transmits a second image information to the second image display device for display. Through the second image display device, a three-dimensional second image information is displayed in a space on one side of the second image display device. The three-dimensional second image information at least interacts with an object.

Abstract: A user device may receive sensor data relating to one or more physical objects, transmit the sensor data to a server, receive a user profile relating to a user of the device, identify a user interface element corresponding to an application, modify the user interface element based on the user profile, and display the modified user interface element. A server may receive data relating to one or more physical objects, identify the one or more design patterns based on the one or more physical objects, create a user profile, update the user profile, receive application data relating to one or more applications running on a device remote from the server, identify a user interface element corresponding to the one or more applications running on the device, modify the user interface element based on the updated user profile, and transmit the modified user interface element to the device.

Abstract: A method for displaying an application interface on a terminal. The method includes determining a first application of an application group. The application group includes multiple identical applications installed on the terminal, and the first application is a most recently used application of the multiple identical applications. The method further includes displaying application indication information in a specific area in an interface of the terminal, for indicating the first application.

Abstract: According to one embodiment, a method for remotely controlling peripheral devices in a mobile communication terminal includes acquiring a profile for a controlled peripheral device, configuring a control application for the controlled peripheral device based on the acquired profile, and controlling the controlled peripheral device using the configured control application.

Abstract: A mobile terminal and a control method therefor are disclosed. The mobile terminal includes a body, an input unit configured to receive user input, a display coupled to the body to vary a display region viewed from a front face of the body according to switching between an enlarged display mode and a reduced display mode, and a controller. The controller receives a first signal in a state in which at least two applications are being executed in split regions of the display, controls output of an icon according to the first signal, controls selection of at least one region among the split regions based on a second signal for the icon, and controls a function of an application which is being executed in a selected region based on a third signal for the icon.

Abstract: Searching and locating an event on a calendar with a timeline is provided. An application such as a calendar application detects a search on the calendar or the timeline. One or more events are located on the calendar or on the timeline that match a search term of the search. The search term on the one or more events is highlighted. The one or more events with the search term that is highlighted are displayed on the calendar or the timeline.