Abstract: Systems and methods for configuration for contextual response to motion-based events are disclosed. For example, a predefined event may be detected. The system may determine that a subject associated with the event is of a given type of subjects and may determine whether another person is present in the environment associated with the event to assist in providing aid. The presence of the other person may be detected, a type of the other person may be performed, and a notification may be output on a second device associated with the other person based on the type. The system may track when the other person reach an area associated with the event and may cause the first device to perform an action to assist the other person in providing aid.

Abstract: Systems and methods for configuration for contextual response to motion-based events are disclosed. For example, a predefined event may be detected. The system may determine that a subject associated with the event is of a given type of subjects and may determine whether another person is present in the environment associated with the event to assist in providing aid. The presence of the other person may be detected, a type of the other person may be performed, and a notification may be output on a second device associated with the other person based on the type. The system may track when the other person reach an area associated with the event and may cause the first device to perform an action to assist the other person in providing aid.

Abstract: Systems and methods for event-detection confirmation are disclosed. For example, a sensing device may generate sensor data, such as from radar, and the sensor data may be utilized to determine if a predefined event as occurred. Event-confirmation operations may then be performed, such as by utilizing acoustic-event detection techniques and/or natural language understanding techniques. When occurrence of an event is confirmed, such as to a certain confidence level, one or more actions may be taken, such as sending a notification to another device and/or establishing a communication channel with another device, such as a device associated with emergency services, family members, friends, and/or neighbors.

Abstract: The present disclosure contemplates a variety of improved methods and systems for creating a unique user experience using an ambient operating system connected to a variety of disparate IoT devices. The described solution includes a curated scene or set of actions initiated by an assistant device. For example, the assistant device detects it is a weekday morning and initiates actions associated with the wakeup routine such as opening the blinds, making coffee and notifying the user of the current traffic report.

Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.

Abstract: A contextual user interface based on environment is described. An assistant device can determine that speech has been spoken and determine the context of an environment of that speech. A user interface can then be generated based on the context of the environment and the content of the speech. Different context can result in different user interfaces being generated.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling set up of a variety of disparate IoT devices coupled to the framework and/or ambient operating system of an assistant device. The described solution includes a voice-driven assistant device setup process. An assistant device can determine the IoT devices in its physical environment and provide setup instructions to the user. The setup including determining voice activatable commands, device information and the adapter to allow the assistant device to operate the one or more IoT devices in response to user instructions.

Abstract: A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.

Abstract: Providing audio and/or video content from one user to a second user within an environment are described. An electronic device can receive conversational content from one user and determine that it is directed to a second user. The second user can be determined to be within another location of the environment (e.g., a different room of a house) and identify the capabilities of devices within the other location. Play back of the conversational content can then be performed using the identified devices within the other location.

Abstract: Ambient assistance is described. An assistant device can detect speech in its environment and determine that the speech includes words or phrases of a local dictionary of the assistant device. The assistant device can then generate an interaction opportunity based on the words or phrases of the speech.

Abstract: A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.

Abstract: Privacy control in a connected environment is described. An assistant device can detect speech spoken by a user. The speech can include a hardware activation phrase that indicates whether the user intends for at least a portion of the speech to be provided to local resources or cloud resources. The speech can then be provided to the appropriate resource based on the hardware activation phrase.

Abstract: A home assistant device assisting with the setup of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined to include a step requesting information related to the setup of another device. The setup of the devices can be ordered based on that determination. The setup instructions can then be provided.

Abstract: A contextual user interface based on video game playback is described. An assistant device can receive video game state information indicating a state of a playback of a video game on a video game console. Using that information, the assistant device can determine characteristics of the playback and generate a button on a graphical user interface (GUI) based on the characteristics. A user can then select the button and cause the assistant device to instruct the video game console to perform a corresponding action.

Abstract: Switching the providing of a conversation among communication links is described. An electronic device can determine that a mobile device is being used to provide a conversation (e.g., a phone call) using a first communication link. The mobile device can enter an environment that includes a second communication link. The conversation can be switched to the second communication link that provides more content than the first communication link (e.g., audio and visual content rather than just audio content).

Abstract: The present disclosure contemplates a variety of improved methods and systems for initializing a curated scene. The described solution includes a method comprising receiving a user instruction including a user intention to initialize a scene controlling the functionality of one or more devices within an environment, determining the scene associated with the user instruction, and performing the functionalities of the scene using an assistant device and the one or more devices within the environment that are capable of performing the activities.

Abstract: The present disclosure contemplates a variety of improved methods and systems for initializing a curated scene. The described solution includes a method comprising receiving an instruction including a user intention to initialize a scene controlling the functionality of one or more devices within an environment, determining the scene associated with the instruction, and performing the functionalities of the scene using an assistant device and the one or more devices within the environment that are capable of performing the activities.

Abstract: A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.

Abstract: A home assistant device assisting with the setup of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined to include a step requesting information related to the setup of another device. The setup of the devices can be ordered based on that determination. The setup instructions can then be provided.