Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user at a virtual-reality (VR) headset, determining intents corresponding to the initial input by an intent-understanding module, generating candidate continuation-inputs in respective candidate modalities based on the intents, wherein the candidate modalities are different from the first modality, and presenting suggested inputs corresponding to one or more of the candidate continuation-inputs at the VR headset.

Abstract: A method includes detecting a user input comprising an incomplete three-dimensional (3D) gesture performed by one or more hands of a first user by a virtual-reality (VR) headset, selecting candidate 3D gestures from pre-defined 3D gestures based on a personalized gesture-recognition model, wherein each of the candidate 3D gestures is associated with a confidence score representing a likelihood the first user intended to input the respective candidate 3D gesture, and presenting one or more suggested inputs corresponding to one or more of the candidate 3D gestures at the VR headset.

Abstract: In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and sending instructions for presenting execution results of the one or more tasks to the client system responsive the user request.

Abstract: In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and sending instructions for presenting execution results of the one or more tasks to the client system responsive the user request.

Abstract: In one embodiment, a method includes receiving initial sensory data of visual data captured by cameras of a head-mounted client device at the head-mounted client device, proactively generating a reminder associated with a first entity responsive to proactively identifying the first entity based on a visual analysis of the visual data and correlating the first entity with knowledge about the user, wherein the knowledge about the user comprises one or more of a routine of the user related to the first entity or an episodic memory of the user referencing the first entity, determining an activation condition associated with the reminder, which is based on one or more of a time or a location, wherein the time and/or location are determined based on the analysis of the visual data and the knowledge about the user, and presenting the reminder when the activation condition is satisfied at the head-mounted client device.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.

Abstract: In one embodiment, a method includes maintaining a reminder store comprising one or more reminders for a first user, wherein each reminder is associated with an initial activation-condition, determining a context associated with the first user based on signals from a client system associated with the first user, determining a suppression-condition associated with at least one of the reminders is met based on the context, and suppressing the at least one reminder for the first user.

Abstract: In accordance with one or more aspects of selecting between client-side and server-side market detection, a determination is made at a device as to which of a client-side detected market and a server-side detected market is to have priority for a service. An application of the device is configured in accordance with a client-side market configuration setting if the client-side detected market has priority, and is configured in accordance with a server-side market configuration setting if the server-side detected market has priority.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.

Abstract: In one embodiment, a method includes detecting a user input comprising an incomplete three-dimensional (3D) gesture performed by one or more hands of a first user by a virtual-reality (VR) headset, selecting candidate 3D gestures from pre-defined 3D gestures based on a personalized gesture-recognition model, wherein each of the candidate 3D gestures is associated with a confidence score representing a likelihood the first user intended to input the respective candidate 3D gesture, and presenting one or more suggested inputs corresponding to one or more of the candidate 3D gestures at the VR headset.

Abstract: In one embodiment, a method includes maintaining a reminder store comprising one or more reminders for a first user, wherein each reminder is associated with an initial activation-condition, determining a context associated with the first user based on signals from a client system associated with the first user, determining a suppression-condition associated with at least one of the reminders is met based on the context, and suppressing the at least one reminder for the first user.

Abstract: In one embodiment, a method includes receiving a user request including an ambiguous mention to create a reminder from a client system associated with a user, disambiguating the mention to identify a first entity referenced in the mention, wherein the first entity is identified based on user profile data associated with the user, determining an activation condition associated with the user request, wherein the activation condition is based on one or more of a time or a location referenced in the user request, wherein the time and/or location are determined based on contextual information associated with the user request, generating the reminder based on the first entity and the activation condition, and sending instructions to the client system for presenting the reminder when the activation condition is satisfied.

Abstract: In one embodiment, a method includes maintaining a reminder store comprising one or more reminders for a first user, wherein each reminder is associated with an initial activation-condition, determining a context associated with the first user based on signals from a client system associated with the first user, determining a suppression-condition associated with at least one of the reminders is met based on the context, and suppressing the at least one reminder for the first user.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.

Abstract: In one embodiment, a method includes receiving a media content for delivery to a first user, wherein the media content is associated with a priority level, accessing context information associated with the first user, wherein the context information is determined based on one or more multimodal signals from a client device associated with the first user, determining a delivery level for the media content based on the priority level of the media content and the context information, and instructing the client device to present a notification associated with the media content to the first user, wherein the notification is rendered in one or more modalities determined based on the delivery level for the media content.

Abstract: The present disclosure is directed towards systems and method for determining whether a scannable code displayed on a client device has been scanned. In particular, the systems and methods described herein involve activating one or more on-board sensors of the client device to capture output signals. Based on the output signals, the systems and methods include identifying discrete signals that indicate whether the scannable code has been scanned by a scanning device. Further, based on an analysis of the identified discrete signals, the systems and methods include determining whether the scannable code has been scanned by the scanning device.

Abstract: In one embodiment, a method includes receiving a media content for delivery to a first user, wherein the media content is associated with a priority level, accessing context information associated with the first user, wherein the context information is determined based on one or more multimodal signals from a client device associated with the first user, determining a delivery level for the media content based on the priority level of the media content and the context information, and instructing the client device to present a notification associated with the media content to the first user, wherein the notification is rendered in one or more modalities determined based on the delivery level for the media content.

Abstract: In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and sending instructions for presenting execution results of the one or more tasks to the client system responsive the user request.

Abstract: The present disclosure is directed towards systems and method for determining whether a scannable code displayed on a client device has been scanned. In particular, the systems and methods described herein involve activating one or more on-board sensors of the client device to capture output signals. Based on the output signals, the systems and methods include identifying discrete signals that indicate whether the scannable code has been scanned by a scanning device. Further, based on an analysis of the identified discrete signals, the systems and methods include determining whether the scannable code has been scanned by the scanning device.

Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.