Abstract: Methods and systems described herein are directed to a virtual web browser for providing access to multiple virtual worlds interchangeably. Browser tabs for corresponding website and virtual world pairs can be displayed along with associated controls, the selection of such controls effecting the instantiation of 3D content for the virtual worlds. One or more of the tabs can be automatically generated as a result of interactions with objects in the virtual worlds, such that travel to a world, corresponding to an object to which an interaction was directed, is facilitated.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for providing search results automatically to a user of a computing device. A spoken input provided by a user to a computing device is received. The spoken input is transmitted to a computer server system that is remote from the computing device. Search result information that is responsive to the spoken input is receiving by the computing device and in response to the transmitted spoken input. An alert is provided to the user that the device will connect the user to a target of the search result information if the user does not intervene to stop the connecting of the user. The user is connected to the target of the search result information based on a determination that the user has not intervened to stop the connecting of the user.

Abstract: According to one general aspect, a computing device may include an application configured to create a tab in a context of a window, and a window manager configured to register the tab with a first UI element registry. The window manager may be configured to receive, over a network, at least a portion of a second UI element registry from a secondary window manager of a secondary computing device. The portion of the second UI element registry may identify a remote tab previously registered with the secondary window manager. The window manager may be configured to cause a display to provide a graphical arrangement of the tab and the remote tab.

Abstract: Methods and systems described herein are directed to a virtual web browser for providing access to multiple virtual worlds interchangeably. Browser tabs for corresponding website and virtual world pairs can be displayed along with associated controls, the selection of such controls effecting the instantiation of 3D content for the virtual worlds. One or more of the tabs can be automatically generated as a result of interactions with objects in the virtual worlds, such that travel to a world, corresponding to an object to which an interaction was directed, is facilitated.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for providing search results automatically to a user of a computing device. A spoken input provided by a user to a computing device is received. The spoken input is transmitted to a computer server system that is remote from the computing device. Search result information that is responsive to the spoken input is receiving by the computing device and in response to the transmitted spoken input. An alert is provided to the user that the device will connect the user to a target of the search result information if the user does not intervene to stop the connecting of the user. The user is connected to the target of the search result information based on a determination that the user has not intervened to stop the connecting of the user.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for linking artificial reality content to a shared artificial reality environment. Various aspects may include receiving a selection of a user representation and a virtual area, such as from a user device. Aspects may include providing the user representation for display in the virtual area. Aspects may also include determining a selected artificial reality application from a plurality of artificial reality applications for use by the user representation in the virtual area. Aspects may also include embedding visual content from the selected artificial reality application into the virtual area, which may be associated with a deep link to the selected artificial reality application. Aspects may include transitioning the user representation between virtual areas while providing an audio element to the user device indicative of other user devices associated with another virtual area.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for providing and activating a link to artificial reality content in a shared artificial reality environment. Various aspects may include receiving a request to generate a visual navigation element for an artificial reality application configured to operate in the shared artificial reality environment, such as via a user representation. Aspects may include generating the visual navigation element and generating an audio element indicative of another user representation engaged in the artificial reality application for the user representation. Aspects may also include receiving an indication of activation of the visual navigation element and loading the artificial reality application for the user representation upon activation and while providing the audio element. Aspects may also include providing instructions to display the user representation in the artificial reality application upon completion of the loading.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for providing search results automatically to a user of a computing device. A spoken input provided by a user to a computing device is received. The spoken input is transmitted to a computer server system that is remote from the computing device. Search result information that is responsive to the spoken input is receiving by the computing device and in response to the transmitted spoken input. An alert is provided to the user that the device will connect the user to a target of the search result information if the user does not intervene to stop the connecting of the user. The user is connected to the target of the search result information based on a determination that the user has not intervened to stop the connecting of the user.

Abstract: According to one general aspect, a computing device may include an application configured to create a tab in a context of a window, and a window manager configured to register the tab with a first UI element registry. The window manager may be configured to receive, over a network, at least a portion of a second UI element registry from a secondary window manager of a secondary computing device. The portion of the second UI element registry may identify a remote tab previously registered with the secondary window manager. The window manager may be configured to cause a display to provide a graphical arrangement of the tab and the remote tab.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for receiving a voice query at a mobile computing device and generating data that represents content of the voice query. The data is provided to a server system. A textual query that has been determined by a speech recognizer at the server system to be a textual form of at least part of the data is received at the mobile computing device. The textual query is determined to include a carrier phrase of one or more words that is reserved by a first third-party application program installed on the computing device. The first third-party application is selected, from a group of one or more third-party applications, to receive all or a part of the textual query. All or a part of the textual query is provided to the selected first application program.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for providing search results automatically to a user of a computing device. A spoken input provided by a user to a computing device is received. The spoken input is transmitted to a computer server system that is remote from the computing device. Search result information that is responsive to the spoken input is receiving by the computing device and in response to the transmitted spoken input. An alert is provided to the user that the device will connect the user to a target of the search result information if the user does not intervene to stop the connecting of the user. The user is connected to the target of the search result information based on a determination that the user has not intervened to stop the connecting of the user.

Abstract: The subject matter of this specification can be implemented in, among other things, a computer-implemented user interface method.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for receiving s voice query at a mobile computing device and generating data that represents content of the voice query. The data is provided to a server system. A textual query that has been determined by a speech recognizer at the server system to be a textual form of at least part of the data is received at the mobile computing device. The textual query is determined to include a carrier phrase of one or more words that is reserved by a first third-party application program installed on the computing device. The first third-party application is selected, from a group of one or more third-party applications, to receive all or a part of the textual query. All or a part of the textual query is provided to the selected first application program.

Abstract: Aspects of the present disclosure are directed to virtual interaction modes for social and group communication. Additional aspects of the present disclosure are directed to automated controls for connecting a trigger performed in an artificial reality environment to an action on a personal computing device. Further aspects of the present disclosure are directed to providing versions of person virtual objects in an artificial reality environment and contextual breakpoints to switch between them. Yet further aspects of the present disclosure are directed to extending a mouse for artificial reality environment input.

Abstract: Systems and methods for providing partial passthrough video to a user of a virtual reality device are disclosed herein. Providing the partial passthrough video can include detecting a hand passthrough trigger event and identifying a hand passthrough video feed. Providing partial passthrough video can further include aligning the hand passthrough video feed with a virtual environment presented to a user by the virtual environment and, based on the aligning of the hand passthrough video feed with the virtual environment, overlaying the hand passthrough video feed on the virtual environment.

Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes receiving at a computing device that is in a locked state, one or more user inputs to unlock the device and to execute at least one command that is different from a command for unlocking the device. The method further includes executing in response to the user inputs to unlock the device an unlocking operation by the device to convert the device from a locked state to an unlocked state. The method further includes executing the at least one command in response to receiving the user inputs to execute the at least one command. The at least one command executes so that results of executing the at least one command are first displayed on the device to a user automatically after the device changes from the locked state to the unlocked state.

Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for receiving user input that defines a search query, and providing the search query to a server system. Information that a search engine system determined was responsive to the search query is received at a computing device. The computing device is identified as in a first state, and a first output mode for audibly outputting at least a portion of the information is selected. The first output mode is selected from a collection of the first output mode and a second output mode. The second output mode is selected in response to the computing device being in a second state and is for visually outputting at least the portion of the information and not audibly outputting the at least portion of the information. At least the portion of information is audibly output.

Abstract: The present technology addresses a need for a task service that can aggregate tasks assigned to a user on different services so that all tasks that the user needs to perform can be found in one location. The present technology can utilize credentials to a user account associated with a user of a service to automatically identify tasks that are relevant to the user and can create those tasks in a task service. The task service can maintain a link back to the source of the task so that the user can mark the task as complete in the task service, and the task service can automatically update the task in the service in which the task was created. The present technology can also provide integrations with some services to a user to create new tasks from services that are not task based, such as email.

Abstract: The subject matter of this specification can be implemented in, among other things, a computer-implemented method for correcting words in transcribed text including receiving speech audio data from a microphone. The method further includes sending the speech audio data to a transcription system. The method further includes receiving a word lattice transcribed from the speech audio data by the transcription system. The method further includes presenting one or more transcribed words from the word lattice. The method further includes receiving a user selection of at least one of the presented transcribed words. The method further includes presenting one or more alternate words from the word lattice for the selected transcribed word. The method further includes receiving a user selection of at least one of the alternate words. The method further includes replacing the selected transcribed word in the presented transcribed words with the selected alternate word.

Abstract: Various techniques described provide mechanisms for more intuitive user interaction with a device For example, a computer-implemented user interface method includes detecting an application executing on the computing device, the computing device including a display and a touch bar separate from the display, the touch bar being a touch sensitive device with a plurality of zones, wherein the application executing on the computing device is associated with a user interface presented on the display, and configuring a zone of the plurality of zones to implement an operation performed by the application. Configuring the zone can include changing an appearance of the zone to display a graphical element associated with the operation.