Abstract: A method is performed at a computing device coupled with a display. The method includes displaying a graphical user interface that includes a data visualization in a first state, including a plurality of visual marks. Each of the plurality of visual marks is displayed in a corresponding first position. The method includes receiving user input in the graphical user interface to specify an action that triggers an animated transition of the data visualization from the first state to a second state. The data visualization in the second state includes one or more of the plurality of visual marks in corresponding second positions. The method includes, in response to the user input, triggering the animated transition of the data visualization from the first to the second state. The animated transition is configured by three or more visual parameters, including: an animation mode, an animation speed, and an animation emphasis.

Abstract: An electronic device changes the current user interface of a respective type of user interface from a first user interface to a second user interface. An individual uses their personal device to set up and configure a device for another user.

Abstract: One variation of a system includes: a frame; a sensor module; and a controller. The frame includes: a base structure that locates a display defining a front face of a device; and a lateral frame structure extending along and adjacent an edge of the display and supported on a side of the base structure. The base structure and the lateral frame structure cooperate to define a channel arranged behind the display and extending longitudinally between the lateral frame structure and the side of the base structure. The sensor module is arranged in the channel and includes: a substrate; and a linear array of sensors arranged on the substrate and outputting sense signals representing local deflections of the lateral frame structure. The controller detects locations and force magnitudes of side inputs on the device, proximal the edge of the display, based on sense signals output by the linear array of sensors.

Abstract: Systems and methods for linking digital ink instances. One system includes a memory storing instructions and an electronic processor. The electronic processor, through execution of the instructions stored in the memory, is configured to receive detected interactions between a touchscreen and a digital pen representing one or more digital strokes within a canvas and determine whether the one or more digital strokes match a predetermined signifier including a predetermined mark and a line extending from the predetermined mark. The electronic processor is also configured to, in response to determining that the one or more digital strokes match the predetermined signifier, determine a first digital ink instance and a second digital ink instance included in the canvas based on a position of the one or more digital strokes within the canvas, and update metadata of the first digital ink instance to include an identifier of the second digital ink instance.

Abstract: Examples described herein include systems and methods for importing text into a draft email on a user device. In response to a user selecting the first selectable element, the user device can launch a camera interface on the display. The user can capture an image, such as a page of a book or newspaper, and then scale the captured image to the relevant desired portion. The example method can further include recognizing text within the scaled portion of the image and automatically importing the recognized text into the draft email. The user device can utilize a machine learning model to perform text recognition at the device and then insert the recognized text into the draft email automatically. The user device can also display an indication of the accuracy of the imported recognized text within the draft email.

Abstract: An efficient email display is provided. Elements in the email that are determined to be useful or relevant to a particular recipient are displayed and elements that are determined not to be useful or relevant to the recipient are removed from view. A received email is parsed for identifying elements that can be collapsed or expanded when displayed to the recipient. A predetermined value is applied to each element based on the content type. The weight of one or more of the elements is adjusted by applying a weight based on one or more weight factors. A collapsed or expanded display state is assigned to each content element based on the adjusted value. Further, the email message is rendered in the email client application interface to the recipient, where elements having the expanded display state are displayed and elements having the collapsed display state are hidden.

Abstract: A method for handling on a mobile terminal a list of contents each associated to a sub-content, the list of contents and each sub-content being displayable on a touch-sensitive screen of the terminal. The method includes performing by a processing unit of the terminal: displaying on the screen a window containing the sub-content associated to a first content selected by a user from said list of contents; detecting a predetermined touch gesture by the user on the screen; and when a predetermined touch gesture has been detected, displaying on the screen, over the displayed window, a pop-up window containing a sub-list of contents from said list of contents.

Abstract: An operating method of an electronic device for function execution includes receiving an execution signal associated with executing a voice command function performed based on a voice input, confirming a locked state of an electronic device, and providing an entire function execution state in which access to the entire information stored in a memory is allowed or a partial function execution state in which access to a part of the information stored in the memory is allowed, based on the locked state in relation to executing a function corresponding to the voice input or outputting a result corresponding to the voice input.

Abstract: The present disclosure provides a fusion method and terminal for touch messages and a computer readable storage medium. The method includes: pushing touch messages of all touch fingers from at least two different touch screens into different buffer queues for buffering; intercepting head data of each buffer queue to generate a reported data array; and acquiring states of the touch fingers according to the reported data array and packaging the states into multi-finger touch protocol data.

Abstract: The present disclosure describes techniques and systems directed to determining an intended input to a user interface from detected gesture positions. The described techniques and systems include detecting positions associated with a gesture made relative the user interface, associating a timing profile to the detected positions, and determining, from the detected positions and the associated timing profile, the intended input to the user interface.

Abstract: A method for recognizing a posture includes acquiring a depth image of a scene, and obtaining point clouds of an operator based on the depth image of the scene. The method also includes separating point clouds of an arm from the point clouds of the operator and obtaining a characteristic point from the point clouds of the arm. The method further includes determining a location relationship between the characteristic point and the operator and determining a posture of the operator based on the location relationship.

Abstract: A method for augmenting a two-stage hand gesture input comprises receiving hand tracking data for a hand of a user. A gesture recognition machine recognizes that the user has performed a first-stage gesture based on one or more parameters derived from the received hand tracking data satisfying first-stage gesture criteria. An affordance cueing a second-stage gesture is provided to the user responsive to recognizing the first-stage gesture. The gesture recognition machine recognizes that the user has performed the second-stage gesture based on one or more parameters derived from the received hand tracking data satisfying second-stage gesture criteria. A graphical user interface element is displayed responsive to recognizing the second-stage gesture.

Abstract: The disclosed technologies address various technical problems, including improving human-computer interaction, by augmenting the functionality provided by user input devices using a digital glove. For example, a digital glove can be utilized to provide pressure sensitivity for non-pressure sensitive touchscreen devices, attribute input made with a digital pen to a user wearing the digital glove, augment the functionality provided by mice and other types of handheld user input devices, augment the functionality provided gaze tracking systems, improve camera-based motion tracking systems, and to augment the functionality provided by speech recognition systems.

Abstract: This disclosure proposes systems and methods to perform audio based projector control by a projector device to detect that a user is close to a projector and disable the projector when certain conditions are detected. The projector device may detect the user by performing voice activity detection (VAD) and/or breathing activity detection (BAD) on reference audio data generated by a reference microphone by the projector. In some examples, the projector device may determine that the user is located near the projector by performing beamforming on input audio data and/or comparing a first signal strength of the reference audio data to a second signal strength of the input audio data. The projector device may also implement two level device peripheral control architecture to provide additional safeguards to ensure that control mechanisms are in place even if a central processing unit (CPU) stops operating normally.

Abstract: Systems and methods for enhancing trackability of a passive stylus. A six degree of freedom (6DoF) location and orientation of a passive stylus may be tracked by a tracking system via a retroreflector system disposed on the passive stylus. Additionally, characteristic movements of one of a user's finger, hand, and/or wrist may be recognized by the tracking system. The passive stylus may useable to interact with a virtual 3D scene being displayed via a 3D display. A user input via the passive stylus may be determined based on the tracked 6DoF location and orientation of the passive stylus and/or the recognized characteristic movements. The retroreflector system may include multiple patterns of retroreflectors and one of the patterns may be a spiral pattern of retroreflectors disposed along a longitudinal axis of the passive stylus.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for selectively modifying live digital vector glyphs. For example, the disclosed system can use a vector description of a live vector glyph having a plurality of regions defined by a plurality of paths to determine a vector document object model including style information for the paths. The disclosed system can extract a color for a selected region from the style information for the paths (e.g., from a stylesheet) and then change the extracted color to a selected color. After modifying the color, the disclosed system can then generate an updated vector description with the modified region color and render the updated live vector glyph at a client device. The disclosed system thus updates the live vector glyph while maintaining the glyph as a live glyph.

Abstract: In accordance with some embodiments, a method is performed at a device with one or more processors, non-transitory memory, a display, and an input device. The method includes displaying, on the display, a first column and a second column in an application region. The method includes detecting, via the input device, a first user input that starts at a location at a top of the application region and moves toward an edge of the application region. The method includes, in response to detecting the first user input, changing the number of columns displayed in the application region, wherein changing the number of columns displayed in the application region includes, in accordance with a determination that the first user input was in a first direction, displaying a third column in the application region while maintaining display of the first column and the second column in the application region.

Abstract: An information processing apparatus realizing an enlargement function without system-level customization is provided. The information processing apparatus includes an application unit, an enlargement control unit, and a screen control unit. The application unit generates and draws an image in a normal display area. The enlargement control unit enlarges the image drawn in the normal display area, and generates and draws an enlarged image including part of the enlarged image in an expansion display area. The screen control unit displays the image drawn in the normal display area on a display when the enlargement function is invalid, and displays the enlarged image drawn in the expansion display area on the display when the enlargement function is valid.

Abstract: A computer-implemented method for enabling gesture-based interactions between a computer program and a user is disclosed. According to certain embodiments, the method may include initiating the computer program. The method may also include detecting that a condition has occurred. The method may also include activating a gesture-based operation mode of the computer program. The method may also include receiving gesture data generated by a sensor, the gesture data representing a gesture performed by the user. The method may further include performing a task based on the gesture data.

Abstract: Holographic image-guidance can be used to track an interventional device during a non-vascular percutaneous procedure. The holographic image guidance can be provided by a head-mounted device by transforming tracking data and body image data to a common coordinate system and creating a holographic display relative to a patient's body to track the interventional device during the non-vascular percutaneous procedure. The holographic display can also include graphics to provide guidance for the physical interventional device as it travels through the patient's anatomy.

Abstract: An information displaying method for a terminal device, and a terminal device, where the method includes displaying, by the terminal device, prompt information on a screen of the terminal device when the terminal device is in a screen-locked state, collecting, by the terminal device, a user face image using a camera of the terminal device, and displaying, by the terminal device on the screen of the terminal device, content information corresponding to the prompt information when the user face image matches an image template stored in the terminal device. According to the information displaying method, related information is displayed through facial recognition without releasing the screen-locked state of a mobile phone such that convenience of information displaying is improved while information security is ensured.

Abstract: A mobile computing device runs multiple activities concurrently and provides at least two modes for interacting with the activities. The user may toggle between the modes as desired. In a full-screen mode, one activity occupies substantially an entire display screen. In a windowed mode, the activity is visible within a window, and a portion of at least one other window is also visible. In the windowed mode, the user can cause windows to move, thereby changing focus from one activity to another. For example, the window having focus can be moved off the screen, to be replaced by a new window that is then given focus. The windows are ordered in a sequence and move in concert with one another; pushing one window off one edge of the screen causes a new window to appear at the opposite edge. A persistent positional relationship can be established among windows.

Abstract: A processing apparatus includes a chuck table for holding a workpiece thereon, a processing unit for processing the workpiece held on the chuck table, a touch panel for entering processing conditions, and a control unit for controlling the touch panel. The control unit controls the touch panel to display a plurality of input fields corresponding to a plurality of items included in the processing conditions, and controls the touch panel to display a copy processing key and a paste processing key when one of the input fields is selected. The control unit copies information entered in the selected one of the input fields when the copy processing key is selected, and enters information that has been copied in advance into the selected one of the input fields when the paste processing key is selected.

Abstract: An interface performs a flick operation with a button selected from buttons of representative characters for each of the syllabic lines of the Japanese syllabary that are array-displayed on a touch panel so as to specify any one of Japanese characters assigned to the representative character in advance. The interface includes a storage unit that stores association information in which up, down, left, and right directions are set to each of the characters assigned to the representative characters in association with each button and a guide image display processing unit that displays a guide image guiding arrangement directions set to the characters assigned to the representative characters prior to selection of a button of the representative character in an outside of an array display region of the representative character.

Abstract: A handwriting input display apparatus causes display means to display a stroke generated by an input made by using input means to a screen as a handwritten object. The apparatus includes display control means for causing the display means to display character string candidates including a handwriting recognition candidate when the handwritten object does not change for a predetermined time. When the handwriting recognition candidate is selected, the display control means causes the display means to erase a display of the character string candidates and a display of the handwritten object, and causes the display means to display a character string object at a position where the erased handwritten object was displayed. When selection of the handwriting recognition candidate is not performed for a predetermined time and the display of the character string candidates is erased, the display control means causes the handwritten object to be kept displayed.

Abstract: Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.

Abstract: A system and method for providing interactive media streaming is provided. Media and a set of activity data associated with the media may be stored in memory. The set of activity data may include information about the activity and one or more objects shown in the activity. A user selection of the media may be detected. Object information for one or more object images displayed may be retrieved from the associated set of activity data. A list of retrieved object information may be displayed.

Abstract: In one embodiment, a method includes detecting a user input comprising an incomplete gesture performed by one or more hands of a first user by a client system associated with the first user; selecting one or more candidate gestures from a plurality of pre-defined gestures by the client system based on a personalized gesture-recognition model, wherein each of the candidate gestures is associated with a confidence score representing a likelihood the first user intended to input the respective candidate gesture, and presenting one or more suggested inputs corresponding to one or more of the candidate gestures at the client system.

Abstract: Methods, systems, devices, and apparatus, including computer program products, for adjusting a graphical user interface. A motion of a device is detected. A graphical user interface of the device is adjusted in response to the detected motion.

Abstract: A wallpaper system presents a first wallpaper image of a wallpaper video to a user and receives, via a user input device, one or both of: (i) a spatial user input selection, and (ii) a time user input selection from the user to apply to the wallpaper video. In response to detecting one or both of: (i) the spatial user input selection, and (ii) the time user input selection, the wallpaper system determines one or both of: (i) a respective spatial movement parameter within a wallpaper video associated with the spatial user input selection, and (ii) a respective time coordinate within the wallpaper video associated with the time user input selection. Wallpaper system presents, via the image display, a second wallpaper image associated with one or both of: (i) the respective spatial movement parameter, and (ii) the respective time coordinate.

Abstract: One embodiment provides a method, including: receiving, at an information handling device, selection input on a virtual object from a user; identifying, using at least one sensor, a direction that a palm of the user is oriented towards; determining, using a processor, whether movement of the palm is detected toward the direction; and adjusting, responsive to determining that the movement of the palm is detected toward the direction, a position of the virtual object toward the direction. Other aspects are described and claimed.

Abstract: Systems and methods for initiating and/or facilitating a financial transaction in response to detecting and translating a spatial gesture may be provided. A payor transaction device may be capable of detecting, via a motion-detecting device, a payor spatial gesture corresponding to a payment gesture of one or more predetermined spatial gestures and, responsive to detecting the payor spatial gesture, receiving payee account information from a payee transaction device. The payor transaction device may also be capable of transmitting, to a payor computing device, transaction data comprising the payee account information and data indicative of the payor spatial gesture. The payor computing device may be capable of transmitting at least a portion of the transaction data to a financial service provider terminal to enable the financial service provider terminal to facilitate the requested transaction.

Abstract: Methods and apparatus for controlling a computing device using gesture inputs. The gesture inputs may be operative to move screens corresponding to applications executing on the handheld computing device from one display to another. Additionally, a multi portion gesture may be used to target different screens. For example, a first portion of the gesture may maintain or “pin” a screen in a display such that a second portion of the gesture is operative to move a different screen behind the pinned application.

Abstract: The present disclosure discloses a method for executing an operation action on a display screen and a device for executing an operation action. Firstly, a gazing position of an operator's eyes on the display screen and a corresponding operation position of the operator's operating portion on the display screen are determined, then a corresponding operation is executed for content displayed on the display screen according to the operation action of the operating portion, when it is determined that the gazing position of the operator's eyes on the display screen is consistent with the corresponding operation position of the operator's operating portion on the display screen.

Abstract: Various embodiments of the present invention provide an apparatus and a method for adaptively configuring a user interface in an electronic device. According to various embodiments, an electronic device may comprise: a memory for storing instructions; a communication interface; and at least one processor connected to the communication interface and the memory, wherein the at least one processor is configured to: receive at least one signal which is transmitted by an external electronic device and is used to determine a user's characteristic related to the electronic device and the external electronic device, in response to detection of the user's input in the external electronic device; determine a field of view (FOV) for the user on the basis of the at least one signal; and execute the stored instructions in order to display a content for virtual reality (VR) on the basis of the determined FOV.

Abstract: One embodiment provides an information handling device, including: a processor; a memory device that stores instructions executable by the processor to: receive, at an electronic device, a drawing input; receive, at the electronic device, secondary user input; and modify, the drawing input based on the secondary user input; wherein the secondary input is voice input. Other aspects are described and claimed.

Abstract: Systems, interfaces, and methods for implementing the systems and interfaces include a dynamic environment generation subsystem that changes objects and subobjects based on locations of the motion sensors and/or the nature, time and/or location of sensed motion and include selection attractive movement as the selection protocol, where a selection object is used to discriminate between selectable objects and attract a target object toward the selection objects, where the direction and speed of the motion controls, discriminates, attracts, and activates the selected objects.

Abstract: A method includes obtaining, by a mobile terminal, a motion parameter of the mobile terminal, determining whether the motion parameter meets a pick-up parameter threshold or a put-down parameter threshold, determining that the mobile terminal is picked up when the motion parameter meets the pick-up parameter threshold, obtaining a sight line parameter of a user, and switching the screen to an on state when a visual center of the user is on a screen of the mobile terminal and the screen is in an off state.

Abstract: A set of gesture commands are learned. Each gesture in the set of gesture commands controls a function of one or more computing devices. A first gesture received from a user is identified. A determination is made whether at least one computing device associated with the identified gesture is active. In response to determining that at least one computing device associated with the identified gesture is active, a determination is made whether the user associated with the identified gesture is recognized. In response to determining that the user associated with the identified gesture is recognized, an action to perform on at least one computing device associated with the identified gesture is determined. The determined action is implemented.

Abstract: In accordance with some embodiments, a computing device is described. In response to receiving an input corresponding to a first gesture, the device determines an updated location for an object selection indicator within a user interface in accordance with the first gesture. In accordance with a determination that the updated location is within a portion of the user interface that corresponds to a predefined region of the display, the device sends instructions to the display for moving the object selection indicator to the updated location without scrolling the user interface. In accordance with a determination that the updated location is outside of the portion of the user interface, the device sends instructions to the display for moving the object selection indicator to the updated location and scrolling the user interface so as to display the updated location within the predefined region.

Abstract: This application provides a touch control method and an apparatus, and relates to the field of communications technologies. The method includes: (S601) obtaining, by a terminal, a first touch operation entered by a user on a touchscreen; (S602, S603, and S604) and mapping, by the terminal when the first touch operation is performed on a first preset area in a target interface, the first touch operation to a second touch operation, so that a target application responds to the second touch operation, where the target interface is any interface that is presented by the target application and that covers the first preset area, and the target application is running in the foreground.

Abstract: A first electronic device is configured to operate in a restricted mode of operation, which restricted mode may be terminated or continued by one or more remotely located authorization devices, according to predetermined criteria. In a restricted mode, a first set of permitted applications stored on the first electronic device are executable, and a first set of data is accessible. While operating in the restricted mode, the first device detects a termination condition of the restricted mode and transmits an indication of the termination condition to one or more authorization devices. After transmitting the request, the first electronic devices receives an indication that the restricted mode of the operation has been continued according to predetermined criteria. Responsive to receiving the indication, the first electronic device continues to operate in the restricted mode according to the predetermined criteria.

Abstract: According to one or more aspects, systems and methods for human-vehicle interaction are described herein. A touchpad may include a first touchpad zone and a second touchpad zone. A display may include a first display zone and a second display zone, which correspond to the first touchpad zone and the second touchpad zone, respectively. A processor may execute instructions stored on a memory to perform rendering a first application in a first mode within the first display zone of the display and rendering a second application in a second mode within the second display zone of the display. The processor, in response to an input from the touchpad, may render the already running second application in a first mode within the first display zone of the display and render the first application in a second mode within the second display zone of the display.

Abstract: The present disclosure provides drawing content processing method and device for a terminal apparatus. The method includes positioning a drawing focus of a user based on a drawing operation of the user and processing drawing content displayed on a screen of the terminal apparatus based on the positioned drawing focus.

Abstract: In some embodiments, a first device performs ranging operations to allow a user to access the first device under one of several user accounts without providing device-access credentials. For example, when a second device is within a first distance of the first device, the first device determines that the second device is associated with a first user account under which a user can access (e.g., can log into) the first device. In response to the determination, the first device enables at least one substitute interaction (e.g., a password-less UI interaction) to allow the first device to be accessed without receiving access credentials through a user interface. In response to detecting an occurrence of the substitute interaction, the user is allowed to access the first device under the first user account. In some embodiments, the substitute interaction occurs while the first device is logged into under a second user account.

Abstract: System, method, and non-transitory computer readable medium for presenting images on a mobile device. Images are presented by monitoring the location and the orientation of the mobile device, requesting previously captured images corresponding to where the previously captured images were captured in relation to the location from a server, receiving the requested previously captured images from the server, selecting images from the requested previously captured images responsive to the location and the orientation of the mobile device, generating overlay images from the selected images including image icons associated with the selected images, presenting the overlay images on an optical assembly, receiving an image selection identifying one of the image icons in the presented overlay images, and display the selected image associated with the identified image icon on the viewing area of the optical assembly.

Abstract: Embodiments of the present invention relate to the field of terminal application technologies, and provide a method, an apparatus, and a terminal for processing notification information. Therefore, an efficient operation manner for processing notification information is provided, which can simplify operation steps and improve usability and controllability of a device. The method is: after a user display operation is detected, and a display instruction corresponding to the user display operation is triggered, determining a target application program corresponding to notification information; and when it is determined that a screen display status meets a condition, adjusting, according to a preset adjustment policy corresponding to the display instruction, a window corresponding to the target application program. The embodiments of the present invention are used to process notification information of an intelligent terminal device.

Abstract: An apparatus configured to: present a virtual reality space having at least one defined and non-defined region; control a point-of-view location and a direction-of-view orientation based on sensors configured to sense the user in a real-world play space; receive input to move by means other than said sensors; determine if the requested point-of-view location is allowed or not allowed wherein a location is not allowed if any physical locations in the play space correspond to point-of-view locations in the virtual reality space that lie within a non-defined region and if the requested point-of-view location is not allowed, determine at least one of: (i) a compromise point-of-view location; (ii) a compromise direction-of-view orientation; (iii) a compromise point-of-view location and direction-of-view orientation; (iv) a compromise physical position of the user in the real-world play space; and present the virtual reality space from/with the at least one of (i), (ii), (iii) and (iv).

Abstract: A gesture control system includes a processor, the processor in communication with a plurality of sensors. The processor is configured to perform the steps of detecting, using the plurality of sensors, a gesture in a volume occupied by a plurality of occupants, analyzing a prior knowledge to associate the gesture with one of the plurality of occupants, and generating an output, the output being determined by the gesture and the one of the plurality of occupants.

Abstract: A folder management method and device. The method includes: displaying a folder icon comprising a set of icons of at least two applications, and the set of icons is displayed as a thumbnail icon, and, in the thumbnail icon, each of the icons of the at least two applications is displayed in a shrunk size, and the folder icon further comprising an enlarged first icon associated with a first application, wherein the enlarged first icon is displayed adjacent to the thumbnail icon without the first icon, and wherein a size of the enlarged first icon is a same size as the thumbnail icon. The first application is determined according to a use time sequence or other factors. In this way, icons, of some applications, in the folder icon can be enlarged for display, which facilitates management of applications in the folder.