Abstract: Methods, systems, and media for navigating a user interface are provided. In some embodiments, methods for navigating a user interface is provided, the method comprising: causing a user interface to be presented including media identifiers that correspond media assets; causing the media identifiers to be arranged along a first direction; causing a first media identifier at a first position to be highlighted; causing a menu element to be presented at a first menu position associated with the first media identifier; receiving an instruction from a user input device to navigate to a next element along the first direction; causing a second media identifier next to the first position to be highlighted in response to receiving the instruction; causing the menu element to be presented at a second menu position associated with the second media identifier; and inhibiting presentation of the menu element at the first menu position.

Abstract: A route from a current location of a portable device to a destination is determined, where the route includes a sequence of directed sections. Navigation instructions to guide a user of the portable device along the route to the destination are generated. To this end, candidate navigation landmarks perceptible within a 360-degree range of the current location of the portable device are identified, a navigation landmark disposed in a direction substantially opposite to the direction of the first one in the sequence of directed sections is selected from among the candidate navigation landmarks, and an initial instruction in the navigation instructions is generated and provided via a user interface of the portable device. The initial instruction references the selected navigation landmark.

Abstract: Various arrangements for monitoring and controlling operation of a HVAC system are provided. Battery-operated temperature monitoring devices may be situated within the structure and connected with a network. A user command may be received that includes a selection of at least one of the battery-operated temperature monitoring devices. An offset may be calculated based on an evaluation of a first temperature reading of the selected battery-operated temperature monitoring device relative to a second temperature reading of the thermostat. The offset may be overridden when an override condition is present.

Abstract: A method includes providing, via a computing device, a graphical development environment depicting, via a user interface, a representation of one or more pages and widgets, each of the widgets including characteristics. The method also includes receiving, via the computing device, a selection in the user interface of at least two of the widgets to include in a compound widget. The method also includes, responsive to receiving a first instruction to create the compound widget, creating, by the computing device, the compound widget using the selected at least two of the widget. The compound widget includes the characteristics of each of the selected at least two of the widgets. The method also includes, responsive to receiving a second instruction to instantiate the compound widget at least once in the representation of the one or more pages, instantiating the compound widget in the representation of the one or more pages.

Abstract: Implementations provide an improved drag-and-drop operation on a mobile device. For example, a method includes identifying a drag area in a user interface of a first mobile application in response to a drag command and receiving a drop location in a second mobile application that differs from the first mobile application. The method may also include determining that a drop location is a text input control and the drag area is not text-based, performing a search for a text description of the drag area, and pasting the text description into the text input control. The method may also include determining that a drop location is an image input control and that the drag area is text based, performing a search using the drag area for a responsive image, and pasting the responsive image into the image input control.

Abstract: Methods, systems, and apparatus, including an apparatus for using probabilistic techniques to provide reformatted versions of digital components. In one aspect, a process includes obtaining data specifying a distribution parameter limit for a given reformattable digital component that is eligible for reformatting using a set of digital component extensions. For each of multiple digital component requests, a determination is made that a given digital component extension has an additional selection requirement that, when combined with a base selection requirement for the given reformattable digital component, would exceed the distribution parameter limit.

Abstract: Implementations of the present disclosure include actions of receiving search results that are responsive to the search query, the search results being respectively representative of resources, processing one or more triggering rules based on at least one of the search query and the search results, determining, based on processing the one or more triggering rules, that a set of data records is to be displayed in a search results page with the search results, the set of data records including data records that are specific to the user, determining a display prominence of at least one data record in the set of data records, the display prominence indicating a prominence of the at least one data record when displayed in the search results page, and providing the search results and the set of data records for display, the at least one data record being displayed based on the display prominence.

Abstract: A method and system for embedded personalized communication have been disclosed. According to one embodiment, a computer-implemented method comprises providing software code to be embedded in a webpage. The webpage is loaded including the software code. A configuration file is fetched from a configuration server in response to the software code. A first instant messaging user interface is rendered on the webpage. A request is sent to a web-based instant messaging server, the request initiating an instant messaging session with a second instant messaging user interface.

Abstract: A method of generating search suggestions includes receiving an indication of a current location of the user device. After a user accesses a search function on the user device and before the user submits a search request, the method includes determining search results associated with locations in proximity to the current location of the user device, using query log data indicating selections of past search results by users after presentation of the past search results in response to respective past queries. The method also includes determining relative positioning of the search results based on the number of users that selected each search result, determining categories associated with the search results, grouping the search results by the determined categories; and sending the grouped search results and the one or more categories associated with the search results to the user device for display according to the determined relative positioning.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a sequence to sequence model that is recurrent in depth while employing self-attention to combine information from different parts of sequences.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for analyzing images for generating query responses. One of the methods includes determining, using a textual query, an image category for images responsive to the textual query, and an output type that identifies a type of requested content; selecting, using data that associates a plurality of images with a corresponding category, a subset of the images that each belong to the image category, each image in the plurality of images belonging to one of the two or more categories; analyzing, using the textual query, data for the images in the subset of the images to determine images responsive to the textual query; determining a response to the textual query using the images responsive to the textual query; and providing, using the output type, the response to the textual query for presentation.

Abstract: Methods and apparatus are described herein emulating, by one or more servers on behalf of a mobile computing device, a cloud-based virtual machine. The cloud-based virtual machine may include a virtualized hardware component that provides, as virtual hardware input for a software application executing on the cloud-based virtual machine, either “genuine” virtual hardware input or “simulated” virtual hardware input. Genuine virtual hardware input may be based on an actual hardware signal received from a hardware component of the mobile computing device that corresponds to the virtualized hardware component. Simulated virtual hardware input may be generated independently of any hardware signal associated with the hardware component. Output of the software application may be interactively streamed to the mobile computing device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating network outputs using insertion operations.

Abstract: A plurality of objects associated with respective footnote reference information within a document are generated. An overflow object associated with overflow footnote reference information corresponding to a previous footnote marker appearing on a previous page is invoked to lay out the overflow footnote reference information, generating overflow layout data. A current page object associated with current page footnote reference information that corresponds to a current page footnote marker appearing on the page is invoked to lay out the current page footnote reference information, generating current page footnote reference information layout data, if an available footnote height is sufficient to lay out the current page footnote reference information. The page is displayed based on the overflow layout data and the current page footnote reference information layout data.

Abstract: The present disclosure describes use of two security processors for a mobile device. In some aspects, a first security processor device embodied in a security component of an apparatus receives a user input via an input device and transmits a security condition signal to a second security processor device embodied in a System on Chip (SoC) component of the apparatus, causing the SoC component to perform a security operation. In other aspects, the first security processor receives a signal via a sensor device sensing environmental conditions surrounding the apparatus and, in response, transmits a security condition signal to the second security processor, causing the SoC component to perform a security operation. The security operation is directly controlled, maintained, and implemented by the second security processor embodied in the SoC component.

Abstract: A system, method and various software tools enable a video hosting website to automatically identified unlicensed audio content in video files uploaded by users, and initiate a process by which the user can replace the unlicensed content with licensed audio content. An audio replacement tool is provided that enables the user to permanently mute the original, unlicensed audio content of a video file, or select a licensed audio file from a collection of licensed audio, and insert the selected in place of the original audio. Where a video file includes unlicensed audio, the video hosting website provides access to video files to a client device, along with an indication to the client device to mute the audio during playback of the video.

Abstract: Methods, apparatus, and computer readable media related to receiving textual input of a user during a dialog between the user and an automated assistant (and optionally one or more additional users), and generating responsive reply content based on the textual input and based on user state information. The reply content is provided for inclusion in the dialog. In some implementations, the reply content is provided as a reply, by the automated assistant, to the user's textual input and may optionally be automatically incorporated in the dialog between the user and the automated assistant. In some implementations, the reply content is suggested by the automated assistant for inclusion in the dialog and is only included in the dialog in response to further user interface input.

Abstract: Aspects of the technology evaluate places that are familiar to a given user in order to provide contextualized location information about other places of interest. This may include evaluating the actual number of visits by the given user to one or more locations in a given geographical area. For instance, places that have been visited a sufficient number of times within a particular timeframe are identified as personal landmarks for that user. Thus, when the user searches for a specific place or otherwise requests results that fit a query, the system can use the personalized landmark information to help rank search results and to provide location cues to aid the user to quickly and efficiently arrive at the location of the search result. Personal landmarks are necessarily familiar to the user, and thus can reduce the number of turn-by-turn directions or simplify the graphical interface of the client device.

Abstract: Aspects of the disclosure provide a hybrid smartwatch that incorporates digital technology with an analog timepiece in a wristwatch form factor. A digital display layer of a non-emissive material is configured to present notices, data, content and other information. An analog display layer includes one or more hands of the timepiece, and overlies the digital display layer. The hands may be controlled by a processor through micro-stepper motors or other actuators. Physical motion of the hands is simultaneously coupled with arrangement of content or other elements on the display layer, which results in numerous types of hybrid visualizations. This includes temporal presentations using hourly, daily, monthly or other time scales. Shape-shifting of the watch hands between 2D and 1D arrangements can linearly focus on certain information. And various content-aware layouts can highlight, bracket, occlude or otherwise emphasize or deemphasize displayed information.

Abstract: The subject matter of this specification can be implemented in, among other things, a computer-implemented method for correcting words in transcribed text including receiving speech audio data from a microphone. The method further includes sending the speech audio data to a transcription system. The method further includes receiving a word lattice transcribed from the speech audio data by the transcription system. The method further includes presenting one or more transcribed words from the word lattice. The method further includes receiving a user selection of at least one of the presented transcribed words. The method further includes presenting one or more alternate words from the word lattice for the selected transcribed word. The method further includes receiving a user selection of at least one of the alternate words. The method further includes replacing the selected transcribed word in the presented transcribed words with the selected alternate word.