Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.

Abstract: Implementing functionality corresponding to an intent of speech is described. An assistant device can detect speech spoken within its environment. The assistant device can determine that the speech includes verbal content representing an intention regarding functionality within the environment. Devices capable of providing the functionality can be identified and used to provide that functionality.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.

Abstract: A contextual user interface based on playback of media content is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content on different channels. The channels being switched among can be provided to a server, which can provide back information regarding the media content being played back on those channels. The assistant device can then generate buttons on the user interface providing the information regarding the media content and also causing the display device to switch channels upon their selection.

Abstract: Facilitating communication between assistant devices is described. A method or an electronic device can determine an assistant device closest to the user can allow other users to contact said user via that assistant device. In one example, a user can use a an assistant device to have a conversation with others by communicating over a communication link established with a network outside of the user's environment.

Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.

Abstract: A contextual user interface based on environment is described. An assistant device can determine that speech has been spoken and determine the context of an environment of that speech. A user interface can then be generated based on the context of the environment and the content of the speech. Different context can result in different user interfaces being generated.

Abstract: Ambient assistance is described. An assistant device can operate in an active experience mode in which a response to a user's speech is provided if it includes a hardware activation phrase. Based on characteristics of the environment, the mode can be adjusted to a passive experience mode in which a response to speech is provided even if it does not include the hardware activation phrase.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.

Abstract: Management of devices on a wireless network is described. An assistant device can determine that a device is missing configuration settings to access resources within a connected environment. Characteristics of that device can be determined and configuration settings to a selection of the resources can be provided based on the characteristics.

Abstract: The present disclosure contemplates a variety of methods and systems for enabling users to automatically expand the set of commands a user can issue. An assistant device can receive a user instruction via microphone and determine a voice activatable command and device description. The assistant device can then identify that no adapter associated with the voice activatable command and device description is available. The user can be prompted to provide a second voice activatable command or a second device description which can then be used to identify an adapter. The assistant device can store the voice activatable command or the device description in association with the identified adapter.

Abstract: Management of devices on a wireless network is described. An assistant device can determine that another device is missing configuration settings to use a wireless network. Using another wireless network employing a different protocol, the missing configuration settings can be provided.

Abstract: Management of devices on a wireless network is described. An assistant device can determine how a user used resources and/or devices outside of an environment. Based on how the user used those resources and/or devices, configuration settings of local devices within the environment can be updated to provide new resources or settings.

Abstract: Facilitating a conversation using resources of devices within an environment is described. A user within an environment can be determined to be engaged in a conversation with another person via a mobile device. Characteristics of the environment can be determined and devices that can provide playback of content of the conversation or receive content of the conversation can be identified based on the characteristics of the environment. Playback of content and receiving of content can then be provided using the resources of the devices.

Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.

Abstract: Systems and methods for users of an automated retail store, vending unit, digital signage or interactive retail display (self-service units) to interact with such display/unit, collectively referred to in this text as a machine, directly and/or simultaneously using a one or more mobile devices. In addition, system and methods are provided that can recognize registered users within a set proximity to the machine and broadcast messages and notifications such as machine information, inventory information, rewards, discounts and free products, all of which could be tailored to the specific user based on understanding gathered through analysis of prior interactions.

Abstract: A vending arrangement for computerized vending machines, retail displays, automated retail stores, utilizes a centralized, robotic gantry associated with companion modules for vending selectable products. The modularized design enables deployment of half-sized or full-sized machines. The robotic gantry is deployed in a centralized module disposed adjacent display and inventory modules. The inventory modules can be fitted to both gantry sides, and doors can be fitted to the gantry front or rear. The gantry comprises an internal, vertically displaceable elevator utilizing a central conveyor for laterally, horizontally moving selected items from associated display and inventory positions to a vending position. The inventory modules comprise dispensing modules adjustably configurable to adjust the storage density of items to be vended.

Abstract: A vending system comprising numerous remote vending machines, retail displays, and automated retail stores connected to a communication network access a central database so that each remote machine provides and responds to personalized customer information. Each machine comprises a display containing products to be vended and a plurality of touchable product viewing areas for initiating a vend. A computer recognizes customer data derived from peripheral inputs. Software communicates with the database for establishing customer profiles and either recognizing customers or registering customers by generating a global unique identifier. Subroutines initiate the dispensing of items in response to preselected conditions associated with each GUID.

Abstract: A vending arrangement for computerized vending machines, retail displays, automated retail stores, utilizes a centralized, robotic gantry associated with companion modules for vending a plurality of selectable products. The modularized design enables deployment of half-sized or larger, full sized machines. The robotic gantry is deployed in a centralized module disposed adjacent display and inventory modules. Inventory modules can be fitted to both gantry sides, and doors can be fitted to the gantry front or rear. The gantry comprises an internal, vertically displaceable elevator utilizing a central conveyor for laterally, horizontally moving selected items from associated display and inventory positions to a vending position. Computerized software enables the display and vending functions, and controls elevator movement to dispense products from twin sides of the gantry by appropriately controlling the conveyor.

Abstract: Vending machines, automated retail stores, and retail displays with a computer controlled, activation system that senses either the gesture of a customer proximate product display tubes or a touch-screen selection on a computer screen. Item-based lighting produces variable visual effects in conjunction with actual or potential vends to provide an enhanced vending experience. Offered products are stored within display tubes that are arranged in orderly geometric arrays. RGB lighting through a plurality of LED banks associated with each display tube are controlled by the activation system Combinations of differently colored LED's are computer controlled on a per product basis to artistically illuminate available products and assist customers. Pre-programmed lighting sequences can switch LEDs off and on, vary their intensity, and alter resultant colors.