Abstract: Systems and methods for video query contextualization can include a router model that determines how to process and respond to the query associated with the video. The systems and methods can include obtaining an input query and video data, processing the input query and the video data with the router model to generate a video clip and routing data, and the routing data can then be utilized to determine which processing system to utilize to process the video clip and the input query. The video clip can then be processed with the determined processing system to generate a query response that may be provided to the user.

Abstract: Systems and methods for video query contextualization can include a router model that determines how to process and respond to the query associated with the video. The systems and methods can include obtaining an input query and video data, processing the input query and the video data with the router model to generate a video clip and routing data, and the routing data can then be utilized to determine which processing system to utilize to process the video clip and the input query. The video clip can then be processed with the determined processing system to generate a query response that may be provided to the user.

Abstract: Methods and apparatus related to determining an inquiry to provide to a user based on deficient information related to a plan of the user. Deficient information may be determined based on an insufficient association between a desired information item of the plan and a set of information items that are determined from one or more sources associated with the user. In some implementations, the user may provide, responsive to the inquiry, additional information related to the deficient information and a suggestion may be provided to the user based on the additional information.

Abstract: Methods and apparatus for providing travel-related information for a location to a user based on activity indications of the user that are related to the location. The location may be determined based on a set of one or more related activity indications and a travel-related score may be determined for the location that is indicative of likelihood that the user has interest in travelling to the location. The user may be provided the travel-related information for the location based on the travel-related score.

Abstract: A system is described that, after executing a parameterless search query to identify results that are determined to be relevant to a user of a device, determines a respective target property, for each of the results, that indicates whether a result is associated with audio content, visual content, audio and visual content, haptic content, or textual content. The system also determines one or more dynamic properties, of the device, that indicate one or more of a network connection strength, connection status to an audio output device, battery level, or connection status to a multimedia streaming device. Based on the one or more dynamic properties of the computing device and the respective target property of each of the results, the system determines a dynamic ranking of the results and transmits the results and the dynamic ranking to the device.

Abstract: A computing system is described that predicts a future action to be taken by a user of a computing device and determines, based on contextual information associated with the computing device, a current action being taken by the user. The computing system determines, based on the current action, a degree of likelihood of whether the user will be able to take the future action and predicts, based on the degree of likelihood, that the user will not be able to take the future action. The computing system sends information to the computing device indicating that the current action being taken by the user will lead to the user not being able to take the future action.

Abstract: A system is described that, after executing a parameterless search query to identify results that are determined to be relevant to a user of a device, determines a respective target property, for each of the results, that indicates whether a result is associated with audio content, visual content, audio and visual content, haptic content, or textual content. The system also determines one or more dynamic properties, of the device, that indicate one or more of a network connection strength, connection status to an audio output device, battery level, or connection status to a multimedia streaming device. Based on the one or more dynamic properties of the computing device and the respective target property of each of the results, the system determines a dynamic ranking of the results and transmits the results and the dynamic ranking to the device.

Abstract: Methods and apparatus for providing travel-related information for a location to a user based on activity indications of the user that are related to the location. The location may be determined based on a set of one or more related activity indications and a travel-related score may be determined for the location that is indicative of likelihood that the user has interest in travelling to the location. The user may be provided the travel-related information for the location based on the travel-related score.

Abstract: A computing system is described that predicts a future action to be taken by a user of a computing device and determines, based on contextual information associated with the computing device, a current action being taken by the user. The computing system determines, based on the current action, a degree of likelihood of whether the user will be able to take the future action and predicts, based on the degree of likelihood, that the user will not be able to take the future action. The computing system sends information to the computing device indicating that the current action being taken by the user will lead to the user not being able to take the future action.

Abstract: Methods, apparatus and computer-readable media (transitory and non-transitory) are disclosed for identifying a good or service of potential interest to the user and a context in which the good or service would be consumed, determining, based on historical data, a statistic about resources expended by other users to consume goods or services of a same class as the good or service of potential interest to the user in contexts that correspond to the predicted context, and providing an indication of the statistic. In some implementations, the good or service of potential interest to the user may be predicted, e.g., based on one or more signals associated with the user.

Abstract: Travel preferences are received from a user for a trip including a starting location, starting travel date, destination and arrival date. At least one month is presented in a calendar via a graphical user interface, including a month associated with the starting travel date. For one or more days from the starting travel date, a value of a feature is determined that is associated with originating travel on a respective day. A lowest value of the feature is determined of a ticket to travel on a trip starting on the respective day that lasts a projected number of days equal to a proposed trip length plus or minus a predetermined number of days. The lowest value of the feature for each day is presented in the calendar and in a graph that includes axes representing value of the feature and days.

Abstract: Methods and apparatus for providing travel-related information for a location to a user based on activity indications of the user that are related to the location. The location may be determined based on a set of one or more related activity indications and a travel-related score may be determined for the location that is indicative of likelihood that the user has interest in travelling to the location. The user may be provided the travel-related information for the location based on the travel-related score.

Abstract: Methods and apparatus related to determining an inquiry to provide to a user based on deficient information related to a plan of the user. Deficient information may be determined based on an insufficient association between a desired information item of the plan and a set of information items that are determined from one or more sources associated with the user. In some implementations, the user may provide, responsive to the inquiry, additional information related to the deficient information and a suggestion may be provided to the user based on the additional information.

Abstract: Methods and apparatus are disclosed for determining supervised training data, such as travel-related supervised training data, for training a machine learning system. In some implementations, supervised training data may be determined that includes input features based on information items of users and desired output features based on one or more physical locations visited by users.

Abstract: A system is described that, after executing a parameterless search query to identify results that are determined to be relevant to a user of a device, determines a respective target property, for each of the results, that indicates whether a result is associated with audio content, visual content, audio and visual content, haptic content, or textual content. The system also determines one or more dynamic properties, of the device, that indicate one or more of a network connection strength, connection status to an audio output device, battery level, or connection status to a multimedia streaming device.

Abstract: A computing system is described that predicts a future action to be taken by a user of a computing device and determines, based on contextual information associated with the computing device, a current action being taken by the user. The computing system determines, based on the current action, a degree of likelihood of whether the user will be able to take the future action and predicts, based on the degree of likelihood, that the user will not be able to take the future action. The computing system sends information to the computing device indicating that the current action being taken by the user will lead to the user not being able to take the future action.

Abstract: An exemplary method includes determining whether real-time vehicle location information deviates from at least one of historical real-time vehicle location information or scheduled vehicle location information. The exemplary method further includes generating scheduling information for a user based on user data and the public transportation data, determining that the real-time vehicle location information deviates from at least one of the historical real-time vehicle location information or the scheduled vehicle location information by more than a threshold deviation, and updating the scheduling information for the user based on the user data, the public transportation data, and the determined deviation.

Abstract: Methods and apparatus for providing travel-related information for a location to a user based on activity indications of the user that are related to the location. The location may be determined based on a set of one or more related activity indications and a travel-related score may be determined for the location that is indicative of likelihood that the user has interest in travelling to the location. The user may be provided the travel-related information for the location based on the travel-related score.

Abstract: Methods and apparatus for providing travel-related information for a location to a user based on activity indications of the user that are related to the location. The location may be determined based on a set of one or more related activity indications and a travel-related score may be determined for the location that is indicative of likelihood that the user has interest in travelling to the location. The user may be provided the travel-related information for the location based on the travel-related score.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing price information. Travel preferences are received from a user for a trip including a starting location, starting travel date, destination and arrival date. At least two months are presented in a calendar, including a month associated with the starting travel date. For one or more days from the starting travel date, a price is determined that is associated with a cost of originating travel on a respective day. A lowest price is determined of a ticket to travel on a trip starting on the respective day that lasts a projected number of days equal to a proposed trip length plus or minus a predetermined delta number of days. The lowest price for each day is presented in the calendar and in a graph that includes axes representing price and days.