Abstract: In accordance with one aspect of the invention, an automation control device, such as a host or hub, is provided with functionality so that it becomes a multi-role automation control device. One such multi-role automation control device produces an on screen display which enables a user to select predetermined lighting scenes or television channels, and to control other devices.

Abstract: In accordance with one aspect of the invention, an automation control device, such as a host or hub, is provided with functionality so that it becomes a multi-role automation control device. The multi-role automation control device is capable of controlling an expanded variety of “smart” or other devices. The multi-role automation control device may be implemented using a variety of underlying devices including a host, hub, soundbar, “smart” thermostat, “smart” amplifier, audio speaker, or other device.

Abstract: In one embodiment, a user-navigable 3-D virtual room-based user interface for a home automation system is provided. A control app renders and displays the user-navigable 3-D virtual room from a perspective defined by a virtual camera, wherein the control app renders the user-navigable 3-D virtual room based on data from at least one of a plurality of 2-D images of the physical room captured from different respective positions in the physical room. In response to an explicit navigation command or implicit action, the control app alters a position or orientation of the virtual camera. The control app re-renders and displays the user-navigable 3-D virtual room from a new perspective defined by the altered position or orientation, wherein the new perspective does not coincide with the position in the physical room from which any of the 2-D images were captured, by blending data from multiple 2-D images captured from different positions.

Abstract: In one embodiment, a user-navigable, three-dimensional (3-D) virtual room-based user interface for a home automation system is provided. Each user-navigable 3-D virtual room shows a substantially photo-realistic depiction of a corresponding physical room of the structure, including substantially photo-realistic depictions of boundaries of the physical room, furnishings present in the physical room, and devices present in the physical room that are under the control of the home automation system. A user may use explicit navigation commands or implicit actions to navigate within the user-navigable 3-D virtual room, moving a virtual camera in 3-D space to view the virtual room from different perspectives. By interacting with (e.g., touching, clicking on, etc.) substantially photorealistic depictions of the devices within the user-navigable 3-D virtual room, a user may is indicate changes to the state of corresponding devices in the physical room.

Abstract: In one embodiment, a configuration application executing on a tablet computer or smartphone presents a configuration user interface on a touch screen for configuring a home automation system of a structure. A plurality of components of the home automation system that have wireless capabilities are detected. The configuration application receives an indication of a zone of the structure within which each component is located, the indication provided by the user dragging a representation of each component to a location provided in the configuration user interface. Based on the indication of the zone of the structure in which each component is located and the type of each component, automatically generate one or more user interface screens for accessing and controlling the components in each zone, where the automatically generated user interface screens are displayable during use of the home automation system.

Abstract: In one embodiment, a user-navigable, three-dimensional (3-D) virtual room-based user interface for a home automation system is provided. Each user-navigable 3-D virtual room shows a substantially photo-realistic depiction of a corresponding physical room of the structure, including substantially photo-realistic depictions of boundaries of the physical room, furnishings present in the physical room, and devices present in the physical room that are under the control of the home automation system. A user may use explicit navigation commands or implicit actions to navigate within the user-navigable 3-D virtual room, moving a virtual camera in 3-D space to view the virtual room from different perspectives. By interacting with (e.g., touching, clicking on, etc.) substantially photorealistic depictions of the devices within the user-navigable 3-D virtual room, a user may is indicate changes to the state of corresponding devices in the physical room.

Abstract: In accordance with one aspect of the invention, an automation control device, such as a host or hub, is provided with enhanced functionality so that it becomes a multi-role automation control device. The multi-role automation control device is capable of controlling an expanded variety of “smart” or other devices whose native control protocol is not generally compatible. The multi-role automation control device may be implemented using a variety of underlying devices including a host, hub, soundbar, “smart” thermostat, “smart” amplifier, audio speaker, or other device.

Abstract: In one embodiment, a technique is provided managing a plurality of home automation systems in different residential structures. The plurality of home automation systems are bound to a cloud-based residential management system (RMS). The RMS periodically receives status and diagnostics information from home automation systems, and displays, on a web-enabled device, a plurality of RMS user interface (UI) screens. The RMS UI screens provide an all systems view which lists each the plurality of home automation systems, a system details view which shows a summary of status information for a selected one of the plurality of home automation systems, and an equipment level view which shows status information for individual devices of the selected home automation system. At least some of the individual devices are non-network available devices that lack a direct connection to an Internet Protocol (IP)-based network.

Abstract: In one embodiment, a tiled video display is shown on a screen of a display device. The tiled video display includes a plurality of video tiles that each show video content of a different video stream. The video tiles are arranged on the screen according to a tiling layout. A user interface (UI) is shown on a touch sensitive screen of a wireless mobile device separate from the display device. The UI includes a plurality of UI tiles that each correspond to a respective video tile of the tiled video display. The UI tiles are arranged on the virtual display screen according to the tiling layout of the video tiles. In response to a gesture over at least a portion of a particular one of the UI tiles on the touch sensitive screen, a modification is made to both the particular UI tile and a correspond video tile.

Abstract: In one embodiment, a technique is provided for automatically generating a custom user interface (UI) of a control device usable to control a home automation system. A configuration database is maintained, for example, on a host controller, of the home automation system. The configuration database stores logical representations that describe a configuration. The configuration database is transferred (e.g., downloaded) to a control device. The control device accesses the configuration database for one or more of the logical representations, and translates returned information related to the one or more of the logical representations to UI element, using predefined mappings. The controll device then displays the UI elements as a custom UI.

Abstract: In various embodiments, techniques are provided for utilizing a WPAN (e.g., BLE) and an in-home LAN (e.g., Wi-Fi network) together to provision and/or configure hardware elements of a home automation system. In one embodiment, a first WPAN-discoverable hardware element (e.g., a host controller) of the home automation system advertises its presence on a WPAN. The first WPAN-discoverable hardware element receives user-provided network credentials from a mobile app, which are used to configure the first WPAN-discoverable hardware element on the in-home LAN, and which are stored in a storage device of the first WPAN-discoverable hardware element. To provision a second WPAN-discoverable hardware element (e.g., a device) of the home automation system on the in-home LAN, the first WPAN-discoverable hardware element transfers the network credentials back to the mobile app via the in-home LAN, and causes the mobile app to forward the network credentials via the WPAN to the second hardware element.

Abstract: In various embodiments, techniques are provided for utilizing a WPAN (e.g., BLE) and an in-home LAN (e.g., Wi-Fi network) together to provision and/or configure hardware elements of a home automation system. In one embodiment, a first WPAN-discoverable hardware element (e.g., a host controller) of the home automation system advertises its presence on a WPAN. The first WPAN-discoverable hardware element receives user-provided network credentials from a mobile app, which are used to configure the first WPAN-discoverable hardware element on the in-home LAN, and which are stored in a storage device of the first WPAN-discoverable hardware element. To provision a second WPAN-discoverable hardware element (e.g., a device) of the home automation system on the in-home LAN, the first WPAN-discoverable hardware element transfers the network credentials back to the mobile app via the in-home LAN, and causes the mobile app to forward the network credentials via the WPAN to the second hardware element.

Abstract: In one embodiment, a configuration application executing on a tablet computer or smartphone presents a configuration user interface on a touch screen for configuring a home automation system of a structure. A plurality of components of the home automation system that have wireless capabilities are detected. The configuration application receives an indication of a zone of the structure within which each component is located, the indication provided by the user dragging a representation of each component to a location provided in the configuration user interface. Based on the indication of the zone of the structure in which each component is located and the type of each component, automatically generate one or more user interface screens for accessing and controlling the components in each zone, where the automatically generated user interface screens are displayable during use of the home automation system.

Abstract: In one embodiment, a configuration application executing on a tablet computer or smartphone presents a configuration user interface on a touch screen for configuring a home automation system of a structure. A plurality of components of the home automation system that have wireless capabilities are detected. Component profile information for the detected components is obtained. The configuration application prompts a user of the tablet computer or smartphone to indicate a zone of the structure within which each component is located. Based on the component profile information and the indications of the zone of the structure in which each component is located, one or more services available in each zone are determined and one or more user interface screens are automatically generated for accessing and controlling the services, wherein the automatically generated user interface screens are displayable on the tablet computer or smartphone or another tablet computer or smartphone.

Abstract: In one embodiment, a custom user interface (UI) is provided for a plurality of devices of a home automation system within a structure. A configuration database is constructed that stores logical representations. The logical representations stored in the configuration database to include components, services, rooms, and zones. A mobile application (app) finds and connects to the configuration database. The mobile app then queries the configuration database. Based on the querying, the mobile app presents a custom user interface (UI) to the user on a display screen, wherein the custom UI is usable to control one or more of the plurality of devices of the home automation system.

Abstract: In one embodiment, a technique is provided for automatically generating a custom user interface (UI) of a control device usable to control a home automation system. A configuration database is maintained, for example, on a host controller, of the home automation system. The configuration database stores logical representations that describe a configuration. The configuration database is transferred (e.g., downloaded) to a control device. The control device accesses the configuration database for one or more of the logical representations, and translates returned information related to the one or more of the logical representations to UI element, using predefined mappings. The controll device then displays the UI elements as a custom UI.

Abstract: In one embodiment, a custom user interface (UI) is provided for a plurality of devices of a home automation system within a structure. A configuration database is constructed that stores logical representations. The logical representations stored in the configuration database to include components, services, rooms, and zones. A mobile application (app) finds and connects to the configuration database. The mobile app then queries the configuration database. Based on the querying, the mobile app presents a custom user interface (UI) to the user on a display screen, wherein the custom UI is usable to control one or more of the plurality of devices of the home automation system.

Abstract: In one embodiment, a configuration application executing on a tablet computer or smartphone presents a configuration user interface on a touch screen for configuring a home automation system of a structure. A plurality of components of the home automation system that have wireless capabilities are detected. Component profile information for the detected components is obtained. The configuration application prompts a user of the tablet computer or smartphone to indicate a zone of the structure within which each component is located. Based on the component profile information and the indications of the zone of the structure in which each component is located, one or more services available in each zone are determined and one or more user interface screens are automatically generated for accessing and controlling the services, wherein the automatically generated user interface screens are displayable on the tablet computer or smartphone or another tablet computer or smartphone.

Abstract: In one embodiment, a user selects a primary component of a multimedia system to be configured in a configuration user interface of a mobile device. The configuration user interface of the mobile device displays a photo-realistic depiction of a back panel of the primary component. The photo-realistic depiction of a back panel includes photo-realistic depictions of connection ports located thereon. The user selects another component to be connected to the primary component. One or more classes of potential connections are determined between the another component and the primary component, and for each class of potential connection, the configuration user interface on the mobile device graphically guides the user to select a particular connection port on the photo-realistic depiction of the back panel of the primary component for the class of potential connection. Based on selections of particular connection ports from the user, a set of configuration data is generated.

Abstract: In one embodiment, a tiled video display is shown on a screen of a display device. The tiled video display includes a plurality of video tiles that each show video content of a different video stream. The video tiles are arranged on the screen according to a tiling layout. A user interface (UI) is shown on a touch sensitive screen of a wireless mobile device separate from the display device. The UI includes a plurality of UI tiles that each correspond to a respective video tile of the tiled video display. The UI tiles are arranged on the virtual display screen according to the tiling layout of the video tiles. In response to a gesture over at least a portion of a particular one of the UI tiles on the touch sensitive screen, a modification is made to both the particular UI tile and a correspond video tile.