Abstract: Presented here are devices and methods to correct ambient light measurements made in the presence of optical elements, such as the curved edge of the cover glass associated with the mobile device. In one embodiment, a film with optical properties is placed within the ambient light sensor to diffuse the high-intensity light beam coming from the optical element. In another embodiment, an aperture associated with the ambient light sensor is disposed to prevent the high-intensity light beam from entering the ambient light sensor. In another embodiment, a processor coupled to the ambient light sensor smooths the peak associated with the high intensity light beam produced by the optical element.

Abstract: The disclosed embodiments include a handheld mobile device (HMD) operable to cause a subsystem of a vehicle to perform a vehicular operation associated with an existing capability of the subsystem. The HMD includes a processor, a port operable to communicatively couple the HMD to an existing on-board computer of a vehicle via an existing data link connector of the vehicle, and a wireless interface operable to communicatively couple the HMD to at least one of the vehicle or a remote service. The HMD further includes a memory storing a software application that, when executed by the processor, causes the HMD to communicate a command to the on-board computer via the data link connector to perform the vehicular operation associated with the existing capability of the subsystem.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.

Abstract: Presented here are manufacturing techniques to create an irregularly shaped electronic display, including a hollow within which a sensor, such as a camera, can be placed. The manufacturing techniques enable the creation of the hollow anytime during the manufacturing process. The resulting electronic display occupies the full side of the mobile device, with the sensors placed within and surrounded by the display.

Abstract: The technology disclosed here maximizes the size of the display area associated with the mobile device by various camera placement. In one embodiment, the camera is placed inside the mobile device, and can pop outside the mobile device when the camera is activated. When the camera is inactive the camera retracts inside the mobile device, and becomes unnoticeable to the user. In another embodiment, the camera is integrated into the mobile device display as a camera icon. The integrated camera serves two purposes: to record pictures, and to act as a camera icon, that when selected activates the camera. By removing the camera from the front side of the mobile device, or by integrating the camera into the display screen of the mobile device, the size of the mobile device display screen can be increased.

Abstract: Management of devices on a wireless network is described. An assistant device can determine that another device is missing configuration settings to use a wireless network. Using another wireless network employing a different protocol, the missing configuration settings can be provided.

Abstract: The technology disclosed here integrates a light sensor with a dual-mode display, thus increasing the size of the dual-mode display. The light sensor can be a camera, an ambient sensor, a proximity sensor, etc. The light sensor is placed beneath the dual-mode display and can detect incoming light while the dual-mode display is displaying a display image. The dual-mode display and the light sensor can operate at the same time. For example, a camera placed beneath the dual-mode display can record an image of the environment, while at the same time the dual-mode display is showing the display image. Further, multiple light sensors can be placed at various locations beneath the dual-mode display.

Abstract: The disclosed embodiments include a light detection and ranging (LIDAR) system. The LIDAR system includes a modular LIDAR device, which includes a scanner component and a structurally separate base component. The scanner component is mountable on an external surface of a vehicle, and includes a light source and detector to capture LIDAR data including a measure of a distance to an object relative to the vehicle. The scanner component also includes a communications transmitter to transmit LIDAR data indicative of the distance, and a power receiver to wirelessly power the scanner component. The base component is at least partially mountable on an interior surface of the vehicle, and includes a power transmitter to wirelessly power the scanner component, a communications receiver to wirelessly receive the LIDAR data, and a processor to enable autonomous or semi-autonomous navigation of the vehicle based on processed LIDAR data.

Abstract: Management of devices on a wireless network is described. An assistant device can determine how a user used resources and/or devices outside of an environment. Based on how the user used those resources and/or devices, configuration settings of local devices within the environment can be updated to provide new resources or settings.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling users to set up and manage a variety of disparate IoT devices coupled to the framework and/or ambient operating system of an assistant device. The described solution includes a voice-driven assistant device setup process. An assistant device can determine the IoT devices in its physical environment and provide setup instructions to the user. The assistant device can further capture user responses and use the captured responses to connect to and manage/troubleshoot/control the IoT devices.

Abstract: Management of devices on a wireless network is described. An assistant device can determine that a device is missing configuration settings to access resources within a connected environment. Characteristics of that device can be determined and configuration settings to a selection of the resources can be provided based on the characteristics.

Abstract: Providing audio and/or video content from one user to a second user within an environment are described. An electronic device can receive conversational content from one user and determine that it is directed to a second user. The second user can be determined to be within another location of the environment (e.g., a different room of a house) and identify the capabilities of devices within the other location. Play back of the conversational content can then be performed using the identified devices within the other location.

Abstract: Ambient assistance is described. An assistant device can detect speech in its environment and determine that the speech includes words or phrases of a local dictionary of the assistant device. The assistant device can then generate an interaction opportunity based on the words or phrases of the speech.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.

Abstract: Privacy control for a contextual user interface based on environment is described. An assistant device can determine the context of its environment and, based on the context, determine a privacy expectation for a user. The assistant device can then generate a graphical user interface (GUI) based on the context and privacy expectation.

Abstract: Switching the providing of a conversation among communication links is described. An electronic device can determine that a mobile device is being used to provide a conversation (e.g., a phone call) using a first communication link. The mobile device can enter an environment that includes a second communication link. The conversation can be switched to the second communication link that provides more content than the first communication link (e.g., audio and visual content rather than just audio content).

Abstract: Privacy control in a connected environment is described. An assistant device can detect speech spoken within its environment. The assistant device can determine characteristics of that speech and determine privacy expectations regarding the first speech based on the characteristics. Based on the privacy expectations, the speech can be provided one or both of local resources of the assistant device or a cloud server to receive a response regarding the speech.

Abstract: A contextual user interface based on shared activities is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content via a channel watched by a user. The channel being watched can be provided to a server, which can provide back information regarding the media content being played back on that channel. Additionally, another user of another assistant device can be determined to be watching the same or a similar channel. The assistant device can then be provided video content for a video chat with the other user.

Abstract: A contextual user interface based on video game playback is described. An assistant device can receive video game state information indicating a state of a playback of a video game on a video game console. Using that information, the assistant device can determine characteristics of the playback and generate a button on a graphical user interface (GUI) based on the characteristics. A user can then select the button and cause the assistant device to instruct the video game console to perform a corresponding action.

Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.