Abstract: Methods and devices to customize a virtual keyboard on a touchscreen display. A request or other trigger event may be associated with an image that has one or more dominant colours. A set of colours is determined within colour space by varying the coordinates of the dominant colour(s) in one or more dimensions. Each colour in the set of colours is applied to one or more keys of the virtual keyboard. The colours may produce a gradient effect. The dominant colour may be determined based on object recognition and segmentation. Multiple objects may be identified and used to determine the set of colours and their relative spatial relationship may be reflected in how the colours are mapped to the virtual keyboard.

Abstract: Methods and devices for tracking continuous touch events, such as drag operations, across adjacent capacitive touch surfaces. The adjacent capacitive touch surfaces may include a foldable touch screen having a hinged area between the two capacitive touch surfaces. The adjacent capacitive touch surfaces may include separate touch screens separated by a gap. The methods and devices may enable hover detection, predictive continuation of a touch operation, and simultaneous touch resolution.

Abstract: There are provided methods and systems for multimodal dragging interactions with virtual objects. In examples, dragging interactions may be assisted by audio input in the form of voice commands. In response to detecting that a dragging gesture has been initiated, voice recognition is enabled. In examples, one or more voice commands for instructing a modification to a virtual object during a dragging gesture is received. A modification action for modifying the virtual object is determined, based on the dragging gesture and the voice command. In response to detecting a completion of the dragging gesture, the virtual object, modified using the one or more modification actions, is placed at the destination. The disclosed methods and systems may enable improved UI interaction with virtual objects, by enabling the modification of virtual objects during dragging gestures.

Abstract: An embodiment provides a feedback method, applied to an electronic device provided with a touchscreen. The touchscreen is provided with a plurality of vibration feedback elements. The method includes detecting a first contact operation acting on the touchscreen, and obtaining first location information of a first contact point corresponding to the first contact operation, where the first location information corresponds to a first virtual key on a virtual keyboard. The method also includes if the first virtual key is an anchor point key, obtaining, from the plurality of vibration feedback elements, a first vibration feedback element that matches the first virtual key, and indicating the first vibration feedback element to emit a vibration wave, to prompt that the first virtual key is an anchor point key, so that the user can sense a location of the anchor point key. This can reduce difficulty in implementing touch typing on the touchscreen.

Abstract: This application relates to the field of human-computer interaction, and provides a virtual keyboard processing method. The method is applied to an electronic device, where the electronic device is provided with a display. The method includes: selecting, in response to a detected first gesture operation, a first type of virtual keyboard corresponding to the first gesture operation from a plurality of types of virtual keyboards, where virtual keys included in different types of virtual keyboards in the plurality of types of virtual keyboards are not completely the same; and displaying the first type of virtual keyboard by using the display. More virtual keys are provided for a user by different types of virtual keyboards. This improves flexibility of a process in which the user enables the virtual keyboard, and helps provide more abundant virtual keys, so that an additional physical keyboard does not need to be provided.

Abstract: Methods, devices, and processor-readable media for managing a virtual workspace shared by multiple devices are described. A unified GUI is presented to each device in which the other devices sharing the virtual workspace are represented by GUI elements, with the location of the other local devices present within the same local environment corresponding to a display location of the corresponding GUI element around the perimeter of the GUI screen. The locations of the other local devices are determined based on sensor data from the local devices, such as NFC radio data or other short-range sensor data, without the need for a dedicated, specially positioned camera or other sensor configured to track the devices within the local environment.

Abstract: Methods and devices for tracking continuous touch events, such as drag operations, across adjacent capacitive touch surfaces. The adjacent capacitive touch surfaces may include a foldable touch screen having a hinged area between the two capacitive touch surfaces. The adjacent capacitive touch surfaces may include separate touch screens separated by a gap. The methods and devices may enable hover detection, predictive continuation of a touch operation, and simultaneous touch resolution.

Abstract: Systems and methods are disclosed for providing a virtual mouse for a computing device have a touchscreen. A first placement region of the touchscreen may be determined. The first placement region may then be determined to contain a first portion of at least one touch target. The first portion of the at least one touch target may then be deactivated. A virtual mouse may then be activated at the first placement region.

Abstract: There are provided methods and systems for a user-adaptive virtual keyboard comprising a plurality of virtual adaptive keys. In examples, the systems, methods, and processor-readable media can be applied to dynamically configure a user interface of the user-adaptive virtual keyboard, to adapt to a user's needs and preferences, while the user is performing a typing action. In response to detecting a user touch input, the user-adaptive virtual keyboard may generate an updated virtual keyboard UI, by dynamically adjusting one or more properties of the plurality of virtual adaptive keys. The disclosed methods and systems may enable improved user interaction with a virtual keyboard on an electronic device, for example, while a user is performing blind typing actions.

Abstract: This application relates to the field of human-computer interaction, and provides a virtual keyboard processing method. The method is applied to an electronic device, where the electronic device is provided with a display. The method includes: selecting, in response to a detected first gesture operation, a first type of virtual keyboard corresponding to the first gesture operation from a plurality of types of virtual keyboards, where virtual keys included in different types of virtual keyboards in the plurality of types of virtual keyboards are not completely the same; and displaying the first type of virtual keyboard by using the display. More virtual keys are provided for a user by different types of virtual keyboards. This improves flexibility of a process in which the user enables the virtual keyboard, and helps provide more abundant virtual keys, so that an additional physical keyboard does not need to be provided.

Abstract: Methods, devices, and processor-readable media for managing a virtual workspace shared by multiple devices are described. A unified GUI is presented to each device in which the other devices sharing the virtual workspace are represented by GUI elements, with the location of the other local devices present within the same local environment corresponding to a display location of the corresponding GUI element around the perimeter of the GUI screen. The locations of the other local devices are determined based on sensor data from the local devices, such as NFC radio data or other short-range sensor data, without the need for a dedicated, specially positioned camera or other sensor configured to track the devices within the local environment.

Abstract: There is described a method performed by a computing device having first and second touch-sensitive user interfaces. According to this method, when a user input is applied to one of the first and second user interfaces, the computing device detects the user input and determines a force applied by the user input and a type of the user input. The computing device then determines whether to perform a function such as whether to display a virtual trackpad or a virtual keyboard, based on the force, the type of the user input, and a determination whether the user input is applied to a selected one of the first and second user interfaces.

Abstract: Example methods and electronic devices are provided. An example method is applied to an electronic device, where the electronic device includes a first display and a second display. The first display is electrically connected to the second display. The example method includes determining second display data based on first display data in response to an operation on a display window on the first display. The first display data is displayed in the display window on the first display. Further, the second display data corresponds to a selected control in the first display data. Further still, the second display data is smaller or simpler than the first display data. The example method further includes displaying, on the second display, a window corresponding to the second display data.

Abstract: There is described a method performed by a computing device having first and second touch-sensitive user interfaces. According to this method, when a user input is applied to one of the first and second user interfaces, the computing device detects the user input and determines a force applied by the user input and a type of the user input. The computing device then determines whether to perform a function such as whether to display a virtual trackpad or a virtual keyboard, based on the force, the type of the user input, and a determination whether the user input is applied to a selected one of the first and second user interfaces.

Abstract: Systems and methods of text editing are disclosed. A system may include a touchscreen, a memory, and a processor. A voice input channel is started and one or more alternative word options are presented after a selection of textual content by a preset shape at a location of the touchscreen. An input type is determined and input information is obtained based on the input type. The selected textual content is replaced with the obtained input information.

Abstract: Systems and methods are disclosed for providing a virtual mouse for a computing device have a touchscreen. A first placement region of the touchscreen may be determined. The first placement region may then be determined to contain a first portion of at least one touch target. The first portion of the at least one touch target may then be deactivated. A virtual mouse may then be activated at the first placement region.

Abstract: Systems and methods of text editing are disclosed. A system may include a touchscreen, a memory, and a processor. A method may include receiving, from an electronic pen in communication with the processor, pressure signals indicating a detection of a first amount of pressure at a pen tip. In response to receiving the pressure signals, handwriting recognition may be activated. Touch input representing handwriting a first location of the touchscreen may then be received, and the touch input may then be converted into rendered textual content corresponding to the handwriting.

Abstract: A touch display device (TDD) configured to function with a pointing device (PD), and a method of operating the TDD. The TDD has a processor that automatically determines if the PD is in contact with a touch display (TD) of the TDD or with a surface distinct from the TD. When the PD is in contact with the TD, a toggling signal from the PD may be received at the processor to toggle from a first input mode where a tip of the PD overlaps a visual element displayed on the TD, to a second input mode with the tip of the PD is spaced apart from the displayed visual element. When the PD is in contact with the distinct surface, the processor automatically selects a third input mode where a position of the PD on the distinct surface is reproduced as a position the sign on the TD.

Abstract: An embodiment provides a feedback method, applied to an electronic device provided with a touchscreen. The touchscreen is provided with a plurality of vibration feedback elements. The method includes detecting a first contact operation acting on the touchscreen, and obtaining first location information of a first contact point corresponding to the first contact operation, where the first location information corresponds to a first virtual key on a virtual keyboard. The method also includes if the first virtual key is an anchor point key, obtaining, from the plurality of vibration feedback elements, a first vibration feedback element that matches the first virtual key, and indicating the first vibration feedback element to emit a vibration wave, to prompt that the first virtual key is an anchor point key, so that the user can sense a location of the anchor point key. This can reduce difficulty in implementing touch typing on the touchscreen.

Abstract: This application relates to the field of human-computer interaction, and provides a virtual keyboard processing method. The method is applied to an electronic device, where the electronic device is provided with a display. The method includes: selecting, in response to a detected first gesture operation, a first type of virtual keyboard corresponding to the first gesture operation from a plurality of types of virtual keyboards, where virtual keys included in different types of virtual keyboards in the plurality of types of virtual keyboards are not completely the same; and displaying the first type of virtual keyboard by using the display. More virtual keys are provided for a user by different types of virtual keyboards. This improves flexibility of a process in which the user enables the virtual keyboard, and helps provide more abundant virtual keys, so that an additional physical keyboard does not need to be provided.