Abstract: In one implementation, a computer-implemented method includes detecting a current context associated with a mobile computing device and determining, based on the current context, whether to switch the mobile computing device from a current mode of operation to a second mode of operation during which the mobile computing device monitors ambient sounds for voice input that indicates a request to perform an operation. The method can further include, in response to determining whether to switch to the second mode of operation, activating one or more microphones and a speech analysis subsystem associated with the mobile computing device so that the mobile computing device receives a stream of audio data. The method can also include providing output on the mobile computing device that is responsive to voice input that is detected in the stream of audio data and that indicates a request to perform an operation.

Abstract: A computer-implemented method of multisensory speech detection is disclosed. The method comprises determining an orientation of a mobile device and determining an operating mode of the mobile device based on the orientation of the mobile device. The method further includes identifying speech detection parameters that specify when speech detection begins or ends based on the determined operating mode and detecting speech from a user of the mobile device based on the speech detection parameters.

Abstract: The subject matter of this specification can be implemented in, among other things, a computer-implemented method for correcting words in transcribed text including receiving speech audio data from a microphone. The method further includes sending the speech audio data to a transcription system. The method further includes receiving a word lattice transcribed from the speech audio data by the transcription system. The method further includes presenting one or more transcribed words from the word lattice. The method further includes receiving a user selection of at least one of the presented transcribed words. The method further includes presenting one or more alternate words from the word lattice for the selected transcribed word. The method further includes receiving a user selection of at least one of the alternate words. The method further includes replacing the selected transcribed word in the presented transcribed words with the selected alternate word.

Abstract: A computer-implemented method of multisensory speech detection is disclosed. The method comprises determining an orientation of a mobile device and determining an operating mode of the mobile device based on the orientation of the mobile device. The method further includes identifying speech detection parameters that specify when speech detection begins or ends based on the determined operating mode and detecting speech from a user of the mobile device based on the speech detection parameters.

Abstract: Systems and methods for registering key inputs are provided. A system includes an input module configured to detect a first key input by a user at a point on a layout of primary keys. The system includes a correction module configured to determine whether the first key input is associated with a single one of the primary keys or a plurality of the primary keys. The input module is configured to detect a second key input if the first key input is determined to be associated with the plurality of the primary keys. The second key input includes a swipe gesture by the user from the point at which the first key input is detected on the layout towards a particular one of the plurality of the primary keys. The system includes a selection module configured to register the first or second key input as an actual key input.

Abstract: In one implementation, a computer-implemented method includes receiving, at a mobile computing device, ambiguous user input that indicates more than one of a plurality of commands; and determining a current context associated with the mobile computing device that indicates where the mobile computing device is currently located. The method can further include disambiguating the ambiguous user input by selecting a command from the plurality of commands based on the current context associated with the mobile computing device; and causing output associated with performance of the selected command to be provided by the mobile computing device.

Abstract: A machine-implemented method for processing touch elements of an application of a device is provided. The method includes receiving application data associated with the application, the application data providing for the touch elements, each of the touch elements comprising an activation area configured to receive a user input and to trigger at least one function of the application upon receiving the user input. The method further includes determining, from the application data, that plural ones of the touch elements are for display in a group in the application; and classifying, in response to the determining, each of the touch elements of the group into two or more categories based on the application function of the touch element. The method further includes defining a size of the activation area for at least one of the touch elements based on the classification.

Abstract: Tabs of online content can be positioned according to the relative importance of each tab to a user. A user's interaction with a plurality of online content is monitored, and user activity metadata generated by, and associated with, the user's interaction with the online content is collected. A plurality of tabs of the online content is opened in a graphical user interface, and a relative importance of each of the plurality of tabs to the user is determined based on the user activity metadata associated with the online content in the tab. At least a subset of the tabs are positioned relative to each other within the graphical user interface based at least on the relative importance of each tab.

Abstract: A computer-implemented method of generating a voice command to perform an action includes receiving a voice request to perform the action, wherein the voice request comprises first audio information for one or more first data fields associated with the action; generating a GUI that when rendered on a display device comprises a prompt message prompting a user to speak second audio information for one or more second data fields associated with the action; and inserting into the one or more second data fields data indicative of one or more of (i) the first audio information, and (ii) the second audio information.

Abstract: In one implementation, a computer-implemented method includes detecting a current context associated with a mobile computing device and determining, based on the current context, whether to switch the mobile computing device from a current mode of operation to a second mode of operation during which the mobile computing device monitors ambient sounds for voice input that indicates a request to perform an operation. The method can further include, in response to determining whether to switch to the second mode of operation, activating one or more microphones and a speech analysis subsystem associated with the mobile computing device so that the mobile computing device receives a stream of audio data. The method can also include providing output on the mobile computing device that is responsive to voice input that is detected in the stream of audio data and that indicates a request to perform an operation.

Abstract: A system and machine-implemented method for automatically changing between input modes based on user input includes receiving user input in association with a user interface element, the user input comprising an input type and an input gesture. A determination is made whether the input type is a first input type or a second input type. In a case where the input type is the first input type, a determination is made that the input gesture is a first predetermined gesture, and the user interface is switched from a second input mode to a first input mode. In a case where the input type is the second input type, a determination is made that the input gesture is a second predetermined gesture, and the user interface is switched from the first mode to the second mode.

Abstract: Configurations for providing a highly customizable new tab page are disclosed. The new tab page can include one or more panes for including different content. For instance, each pane can include a group of items such as applications, bookmarks, most visited sites, etc. In one example, the subject technology can provide one pane of automatically generated content, which is then followed by one or more panes with user-selectable content for a given new tab page. The user, for example, can choose to include all game applications in a first pane, all utility applications in a second pane, and all news applications in a third pane. Further, the user can include other types of content such as bookmarks in any pane with user-selectable content. Thus, each pane with user-selectable content can include one or more types of content. The user can also add or remove panes and rename the panes.

Abstract: An apparatus includes a processor and a keyboard having multiple, separately moveable keys. The keyboard is configured to function as both a keyboard and a trackpad.

Abstract: A system and method for processing touch actions are provided. A plurality of sequentially performed touch actions including a first touch action and a second touch action are determined on a touch interface of an electronic device. An initiation location and a completion location of each of the first and second touch actions are determined on the touch interface. A command is selected based on the determined completion location of the first touch action, the second touch action, and the determined initiation location of the second touch action. The selected command is executed on the electronic device.

Abstract: Systems and methods for enabling access to a web application are provided. In some aspects, a method includes determining a first profile to be used for accessing the web application, generating a first access point based on the first profile, enabling automatic access to the web application under the first profile via the first access point, and determining a second profile to be used for accessing the web application. The second profile is different from the first profile. The method also includes generating a second access point based on the second profile, and enabling automatic access to the web application under the second profile via the second access point.

Abstract: A computer-implemented method for tiling a window, the method comprising presenting a window of a first size in a display area of a touch-based display and receiving, via the touch-based display, a first user input indicating a selection of the window, wherein the first user input comprises an indication that the user has initiated contact with the touch-based display at a plurality of contact points. In certain aspects, the method further comprises steps for receiving, via the touch-based display, a second user input indicating a first movement of the window in a direction of a first edge of the display area and in response to the second user input and resizing a first edge of the window. Systems and computer-readable media are also provided.

Abstract: Systems and methods for visually scrolling through a stack of items displayed on a device are provided. In some aspects, a system includes a detection module configured to determine a motion of the device relative to a neutral position of the device. The system also includes a display module configured to visually scroll through the stack of items in response to the motion of the device.

Abstract: Tabs of online content can be positioned according to the relative importance of each tab to a user. A user's interaction with a plurality of online content is monitored, and user activity metadata generated by, and associated with, the user's interaction with the online content is collected. A plurality of tabs of the online content is opened in a graphical user interface, and a relative importance of each of the plurality of tabs to the user is determined based on the user activity metadata associated with the online content in the tab. At least a subset of the tabs are positioned relative to each other within the graphical user interface based at least on the relative importance of each tab.

Abstract: Methods for providing visual feedback when an end area of content is reached are provided. In one aspect, a method includes receiving an input in a first direction to at least one of scroll, rotate, or scale a portion of content provided for display, and determining whether an edge of the content in the first direction is reached in response to the input. The method also includes applying a stretch effect to the displayed portion of content when the determination indicates an edge of the content in the first direction is reached. Systems and machine-readable media are also provided.

Abstract: The disclosed methods and systems for performing a paste operation based on clipboard data from a first device and a second device include receiving, at a second device, a request to paste a last copied data item at the second device, accessing, from a server, a first timestamp for first data stored on the server and associated with a clipboard of a first device, accessing, at the second device, a second timestamp for second data copied to a clipboard of the second device, and determining whether the last copied data item corresponds to the first data or the second data, by comparing the first timestamp and the second timestamp. When the last copied data item corresponds to the first data, downloading the first data from the server, when the last copied data item corresponds to the second data, pasting the second data from the second device.