Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant by, for example, obviating the need to provide an explicit invocation to the automated assistant, such as by saying a hot-word/phrase or performing a specific user input, prior to speaking a command or query. In addition, the automated assistant can optionally receive, understand, and/or respond to the command or query without communicating with a server, thereby further reducing the time in which a response can be provided. Implementations only selectively initiate on-device speech recognition responsive to determining one or more condition(s) are satisfied. Further, in some implementations, on-device NLU, on-device fulfillment, and/or resulting execution occur only responsive to determining, based on recognized text form the on-device speech recognition, that such further processing should occur.

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant.

Abstract: A system and computer implemented method for detecting the location of a mobile device using semantic indicators is provided. The method includes receiving, using one or more processors, a plurality of images captured by a mobile device at an area. The area is associated with a set of candidate locations. Using the one or more processors, one or more feature indicators associated with the plurality of images are detected. These feature indicators include semantic features related to the area. The semantic features are compared with a plurality of stored location features for the set of candidate locations. In accordance with the comparison, a location from the set of candidate locations is selected to identify an estimated position of the mobile device.

Abstract: Methods, systems, and computer program products for transitioning an interface to a related image are provided. A method for transitioning an interface to a related image may include receiving information describing a homography between a first image and a second image, and adjusting the interface to present the second image at one or more transition intervals in a transition period until the second image is fully displayed and the first image is no longer visible. The interface may be adjusted by determining, based on the homography, a region of the second image to overlay onto a corresponding area of the first image, blending the determined region with the corresponding area to reduce visible seams occurring between the first image and the second image, and updating the interface by gradually decreasing visual intensity of the first image while gradually and proportionally increasing visual intensity of the second image.

Abstract: A system and machine-implemented method for providing image content corresponding to a business establishment is provided. Several webpages corresponding to a business establishment are received, and one or more webpages are selected from the several webpages, based on the content of each of the several webpages. At least one webpage related to the selected one or more webpages is retrieved. Image content is extracted from the retrieved at least one webpage. At least one annotation is generated for the extracted image content based on at least one characteristic of the extracted image content. The image content is filtered based on the generated at least one annotation for the extracted image content. The filtered image content is provided for display.

Abstract: A system and computer implemented method for detecting the location of a mobile device using semantic indicators is provided. The method includes receiving, using one or more processors, a plurality of images captured by a mobile device at an area. The area is associated with a set of candidate locations. Using the one or more processors, one or more feature indicators associated with the plurality of images are detected. These feature indicators include semantic features related to the area. The semantic features are compared with a plurality of stored location features for the set of candidate locations. In accordance with the comparison, a location from the set of candidate locations is selected to identify an estimated position of the mobile device.

Abstract: Systems and methods for determining a geocode for an image based on user-provided search queries and corresponding user selections are provided. One example method includes determining a selection value for each of a plurality of search strings associated with an image based at least in part on user selection data. The method includes generating a textual document for the image based at least in part on the selection values. The textual document includes one or more of the plurality of search strings. The method includes identifying a plurality of geographic entities by analyzing the textual document using a textual processor. The method includes selecting one of the plurality of geographic entities as a primary geographic entity and associating, by the one or more computing devices, a geocode associated with the primary geographic entity with the image.

Abstract: A system and computer implemented method for detecting the location of a mobile device using semantic indicators is provided. The method includes receiving, using one or more processors, a plurality of images captured by a mobile device at an area. The area is associated with a set of candidate locations. Using the one or more processors, one or more feature indicators associated with the plurality of images are detected. These feature indicators include semantic features related to the area. The semantic features are compared with a plurality of stored location features for the set of candidate locations. In accordance with the comparison, a location from the set of candidate locations is selected to identify an estimated position of the mobile device.

Abstract: A system and computer implemented method for detecting the location of a mobile device using semantic indicators is provided. The method includes receiving, using one or more processors, a plurality of images captured by a mobile device at an area. The area is associated with a set of candidate locations. Using the one or more processors, one or more feature indicators associated with the plurality of images are detected. These feature indicators include semantic features related to the area. The semantic features are compared with a plurality of stored location features for the set of candidate locations. In accordance with the comparison, a location from the set of candidate locations is selected to identify an estimated position of the mobile device.

Abstract: Aspects of the disclosure relate generally to systems and methods for geographically locating images. For example, images from different sources may be associated with different types of location information or simply none at all. In order to reduce inconsistency among images, location information may be gathered for an image using bitmap processing, metadata processing, and information retrieved from where the image was found. This location information can be filtered to remove less reliable or conflicting information. Images may be clustered based on their appearance on an interactive online resource that corresponds to a user-defined event, based on image similarity, and by their appearance in a user photo album. The location information of the images of a cluster is then copied to all of the other images of that cluster.

Abstract: Systems and methods for the processing of images are provided. In particular, a candidate image can be obtained for processing. The candidate image can have one or more associated image categorization parameters. One or more pixel groups can then be detected in the candidate image and the one or more pixel groups can be associated with semantic data. At least one reference image can then be identified based at least in part on the semantic data of the one or more pixel groups. Once the at least one reference image has been identified, a plurality of adjustment parameters can be determined. One or more pixel groups from the candidate image can then be processed to generate a processed image based at least in part on the plurality of adjustment parameters.

Abstract: Systems and methods for determining a geocode for an image based on user-provided search queries and corresponding user selections are provided. One example method includes determining a selection value for each of a plurality of search strings associated with an image based at least in part on user selection data. The method includes generating a textual document for the image based at least in part on the selection values. The textual document includes one or more of the plurality of search strings. The method includes identifying a plurality of geographic entities by analyzing the textual document using a textual processor. The method includes selecting one of the plurality of geographic entities as a primary geographic entity and associating, by the one or more computing devices, a geocode associated with the primary geographic entity with the image.

Abstract: Methods and systems for presenting imagery associated with a geographic location to a user include providing at least one geographic map or panoramic imagery to a client for display in an interface configured for interactive navigation of the at least one geographic map or panoramic imagery, receiving a user selection collected by the interface indicating a location corresponding to the at least one geographic map or panoramic imagery, identifying a plurality of images associated with the received user selection, obtaining at least one user preference associated with the identified images, ranking the identified images based on at least one of the retrieved user preferences, and providing at least one ranked image for display in the interface, in accordance with the ranking.

Abstract: Systems and methods are disclosed for transferring information metadata from a first digital image to a second digital image. In one embodiment, an assignment module is configured to assign a corresponding portion of the first image to the second image using geolocation data. An extraction module is configured to extract a collection of features associated with the second image and the corresponding portion of the first image. An alignment module is configured to align the second image with a portion of the first image by transforming the second image so that features associated with the second image are geometrically aligned with the corresponding features of the portion of the first image. A metadata module is configured to associate metadata from the portion of the first image with the transformed second image. An annotation module is configured to annotate the second image with the associated metadata to generate an annotated image.

Abstract: Methods, systems, and articles of manufacture for presenting similar images are disclosed. A method for presenting similar images on a display device is disclosed. The method includes displaying a first image on the display device; determining one or more homographic relationships between the first image and a plurality of images; identifying, using the determined one or more homographic relationships, at least one image having a scene and a perspective which are similar to that of the first image; and displaying the identified image. Corresponding system and computer readable media embodiments are also disclosed.