Abstract: An information processing device includes an operating unit, and a control unit for switching, when dragging is performed which is an operation to change a predetermined value via the operating unit, between changing the value by an amount equivalent to the amount of dragging, and setting a change speed of the value according to the dragging and continue to change the value at the change speed, according to the position of an ending point as to a starting point of the dragging.

Abstract: Provided is an information processing device including a detection unit configured to detect a user operation, and a display control unit configured to display a list including list items, and perform display of, in response to a detected user operation, causing new list items to gradually appear in the list.

Abstract: In implementations of collecting multimodal image editing requests (IERs), a user interface is generated that exposes an image pair including a first image and a second image including at least one edit to the first image. A user simultaneously speaks a voice command and performs a user gesture that describe an edit of the first image used to generate the second image. The user gesture and the voice command are simultaneously recorded and synchronized with timestamps. The voice command is played back, and the user transcribes their voice command based on the play back, creating an exact transcription of their voice command. Audio samples of the voice command with respective timestamps, coordinates of the user gesture with respective timestamps, and a transcription are packaged as a structured data object for use as training data to train a neural network to recognize multimodal IERs in an image editing application.

Abstract: In some embodiments, a device displays content on a touch screen display and detects input by finger gestures. In response to the finger gestures, the device selects content, visually distinguishes the selected content, and/or updates the selected content based on detected input. In some embodiments, the device displays a command display area that includes one or more command icons; detects activation of a command icon in the command display area; and, in response to detecting activation of the command icon in the command display area, performs a corresponding action with respect to the selected content. Exemplary actions include cutting, copying, and pasting content.

Abstract: Methods, apparatus, and computer readable media are described for tailoring instructions for configuring a smart device based on feedback received from the smart device and/or based on feedback received from a device that is separate from the smart device. Some implementations additionally or alternatively relate to utilization of data corresponding to previous installations of similar smart devices to tailor provided instructions in order to mitigate the reoccurrence of past issues during configuration of smart devices. Some implementations additionally or alternatively relate to proactively suggesting and/or providing, to a user, guidance related to a smart device in response to determining the smart device is to be configured by the user and/or in response to determining a complete configuration of the smart device has not occurred.

Abstract: Focus-assisted intelligent personal assistant query response determination is provided. A query submitted by an individual to an intelligent personal assistant is obtained and a direction of focus of the individual at a time the individual submits the query to the intelligent personal assistant is identified. Image(s) of an environment in the direction of focus of the individual are obtained and, based at least in part on the direction of focus, a geographic area to which the query applies is determined. A response to the query is determined at least in part by searching user-generated content associated with the geographic area. The response is validated against the captured image(s) of the environment, and the query is responded to by providing the determined response.

Abstract: Systems and methods for digitally drawing on virtual 3D object surfaces using a 3D display system. A 3D drawing mode may be enabled and a display screen of the system may correspond to a zero parallax plane of a 3D scene that may present a plurality of surfaces at non-zero parallax planes. User input may be received at a location on the display screen, and in response, a surface may be specified, rendered, and displayed at the zero parallax plane. Further, additional user input on the display screen may be received specifying drawing motion across the rendered and displayed surface. The drawing motion may start at the location and continue across a boundary between the surface and another contiguous surface. Accordingly, in response to the drawing motion crossing the boundary, the contiguous surface may be rendered and displayed at the zero parallax plane along with results of the drawing motion.

Abstract: A first image of a mobile device screen is recorded into memory of the mobile device. The first image includes at least one icon that represents an application installed on the mobile device. A second image of the mobile device screen is recorded into the memory of the mobile device. A graphical change in an area of the mobile device screen corresponding to a position of the icon is detected by comparing at least a portion of the second image to the first image. The graphical change results from a user selection of the icon to activate the application represented by the icon. In response to detecting the graphical change, determine an identifier of the application represented by the icon. Send a record of the user selection of the icon to a collection server. The record includes at least the identifier of the application.

Abstract: A method for operating an electronic device including a touch sensitive display is provided. The method includes displaying at least two application execution screens on the touch sensitive display not to be superposed on one another, receiving a touch input or a hovering input through the touch sensitive display, selecting at least one application execution screen among the at least two application execution screens at least partially in response to the reception of the touch input or the hovering input, and displaying the selected application execution screen to be superposed on at least a portion of a non-selected application execution screen among the at least two application execution screens.

Abstract: Techniques for configuring context-specific user interfaces for use with a portable multifunction device are disclosed. The context-specific user interfaces provide indications of time and, optionally, a variety of additional information. The methods provided herein allow for configuring such user interfaces, e.g., at a first electronic device coupled via wireless communication to a second electronic device. Further disclosed are non-transitory computer-readable storage media, systems, and devices configured to perform the methods described herein.

Abstract: A mobile terminal including a terminal body; a touch screen; a plurality of magnetic sensors configured to detect a spatial position of an input device having a magnetic field generating unit; and a controller configured to display a first graphic object notifying an area corresponding to the detected spatial position on the touch screen when the spatial position of the input device is detected adjacent to an edge of the terminal body at an outside of the touch screen without contacting the touch screen, and display a second graphic object notifying a hidden function with respect to a displayed area of the first graphic object on the touch screen when the detected spatial position of the input device is fixed for a predetermined time.

Abstract: The present disclosure discloses a method and a mobile terminal for quickly opening an application based on a lock screen. The method includes: displaying a touch position on an area of a lock screen interface when a mobile terminal enters the lock screen; displaying a recently used application list after the touch position is detected to have been touched; and opening an application corresponding to an application icon of the application list after the application icon is selected.

Abstract: This invention relates to a method for inputting text by consecutive slide, comprising: detecting whether a consecutive slide input mode is triggered in response to an input of a user; detecting and recording a sliding trajectory of a user on a touch-screen and inputting a corresponding word; and predicting a possible word based on a context and another input of the user and updating the layout of a keyboard according to at least one of the results of the prediction. The invention also relates to a system that implements the method, as well as a corresponding device. The method, system and device increase input efficiency and achieve smart prediction and smart arrangement of candidate words in an area of the keyboard.

Abstract: Techniques for providing an in-place contextual menu and user interface for email and other information management system triage are provided in which a contextual menu can be overlaid or replace an item on a view screen. The contextual menu can provide action commands specific to the type and state of the items selected in the feature view of the email or other information management system. A single recognized selection input, such as a swipe gesture, selects an item and invokes an in-place contextual menu presenting actions that can be asserted on the selected item. Multiple item selection is available through the same invocation of presenting the in-place contextual menu.

Abstract: An information processing apparatus is provided that is configured to facilitate the avoidance of a state in which the browsing of a web page displayed in a main display area is hindered by the displaying of a sub display area. When a web page scrollable in a predetermined scroll direction is displayed in a main display area, the information processing apparatus acquires an arrangement position of a display element displayed in the web page, the arrangement position being a position in a crossing direction crossing the scroll direction, and determines an arrangement position in the crossing direction of the sub display area arranged at a position overlapping the main display area in accordance with the acquired arrangement position of the display element.

Abstract: A virtual image generation system for use by an end user comprises memory, a display subsystem, an object selection device configured for receiving input from the end user and persistently selecting at least one object in response to the end user input, and a control subsystem configured for rendering a plurality of image frames of a three-dimensional scene, conveying the image frames to the display subsystem, generating audio data originating from the at least one selected object, and for storing the audio data within the memory.

Abstract: A touch panel of a portable operation panel for manually operating machinery normally operated automatically, in particular, various types of material handling equipment operated in an emergency, machinery has an operation screen for making the machinery perform a specific operation. A swipe operation button image can be moved on to the operation screen by a swipe operation and a continuation operation button image is displayed in a place from which the swipe operation button image is moved. By performing a tap operation on the continuation operation button image, the machinery is made to perform the specific operation.

Abstract: The present disclosure relates to an information processing method and information processing apparatus applicable to a first electronic device comprising a first application. The information processing method comprises receiving a first information sent from a second electronic device and associated with the first application in a process of the first electronic device being in communication with the second electronic device through the first application; receiving a second information sent from the second electronic device; and displaying the first information and the second information; wherein the first information is different from the second information, the first information includes communication information, and the second information includes information acquired by the second electronic device being in response to a detection of a predetermined operation or state on the second electronic device.

Abstract: Disclosed are information presentation methods, devices, and systems. A client receives an information presentation request from an application, acquires presentation information resources according to the information presentation request, and sends the acquired presentation information resources to the application for the application to make a presentation. The client is configured to provide presentation information resources to applications.

Abstract: Disclosed are various approaches for providing contextual or cognitive cues that link browser tabs together within a browser application. Browser tabs that are determined to be related to one another can be colored with a similar color. A similar color can be one in which a color property is modified so that the colors appear similar to a user. Relationships between browser tabs can be determined based upon whether a browser tab was created in response to following a link within a parent browser tab.