Abstract: In one embodiment, a technique is provided to configure and remotely control a system. A system configuration is created based, at least in part, on information collected from a user using speech synthesis and speech recognition. The system configuration includes information representing at least one zone that corresponds with at least one room in a physical structure, information identifying at least one physical component which represents at least a part of the system, information about at least one function which the at least one physical component is capable of performing, and information about at least one command which the at least one physical component recognizes. A cell phone is used to discover the system by transmitting a name service discovery request to the system, which responds with a name service registration confirmation. The cell phone is then used to remotely control the system.

Abstract: In one embodiment, graphical programming is used to configure a system of audio, video, lighting, HVAC and/or security components. Representations of audio, video, lighting, heating, HVAC and/or security components are displayed in a graphical user interface. Each representation corresponds to a physical component that is available for inclusion in the system. A zone map that represents one or more zones is displayed in the graphical user interface. A selected representation of an audio, video, lighting, heating, HVAC or security component is dragged and dropping to a selected zone of the zone map to indicate installation of a selected physical component in the corresponding room. One or more realized services that the system is capable of providing are determined based at least in part on the selected zone of the zone map. Thereafter, an output is provided based on the one or more realized services.

Abstract: In one embodiment, device addition to an expandable multimedia control system is performed without creating or modifying source code. A configuration bundle is stored on a first device of the expandable multimedia control system, the configuration bundle including a list of unique identifiers (UIDs) representing devices that are eligible to become a part of the expandable multimedia control system. The first device monitors a local area network (LAN), and determines a UID of a second device. The first device compares the UID of the second device with the list of UIDs in the configuration bundle. In response to a match of the UID of the second device with a UID of the list of UIDs in the configuration bundle, the second device is added to the expandable multimedia control system, and at least a portion of the configuration bundle is shared with it.

Abstract: In one embodiment, a remote control device is configured to receive a portable control device into a recess, such that the portable control device is mechanically and electrically coupled to the remote control device. The portable control device communicates with a programmable multimedia controller, by way of a bi-directional wireless communication path, and with a dedicated wireless receiver, providing a redundant communication path. The remote control device includes surface enhanced buttons that allow a user to make selections by the sense of touch for changing settings of components associated with the programmable multimedia controller.

Abstract: In one embodiment, a component library stores representations of audio/video components, the representations of audio/video components corresponding to physical audio/video components that are available for inclusion in a system. A configuration workspace is provided into which a selected plurality of representations of audio/video components from the component library are placed to indicate their inclusion in the system. A drawing tool may be used to draw connections between particular ones of the selected plurality of audio/video components in the configuration workspace. Further, a configuration compiler may determine one or more realized services that the system is capable of providing based on the selected plurality of audio/video components and the drawn connections between particular ones of the selected plurality of audio/video components, and may display to the user indications of the one or more realized services that the system is capable of providing.

Abstract: In one embodiment, a technique is provided to configure and remotely control a system. A system configuration is created based, at least in part, on information collected from a user using speech synthesis and speech recognition. The system configuration includes information representing at least one zone that corresponds with at least one room in a physical structure, information identifying at least one physical component which represents at least a part of the system, information about at least one function which the at least one physical component is capable of performing, and information about at least one command which the at least one physical component recognizes. A cell phone is used to discover the system by transmitting a name service discovery request to the system, which responds with a name service registration confirmation. The cell phone is then used to remotely control the system.

Abstract: In one embodiment, location aware operation is provided using Bluetooth positioning. A Bluetooth-enabled handheld device is operated within a structure. Received Bluetooth signal strengths are measured for a plurality of Bluetooth-enabled transmitter/receiver units dispersed within the structure, where respective ones of the plurality of Bluetooth-enabled transmitter/receiver units are located on separate floors, in separate rooms, or in different portions of a same room. Based on the received Bluetooth signal strengths, a single Bluetooth-enabled transmitter/receiver unit is selected. A location of the selected Bluetooth-enabled transmitter/receiver unit is assigned to the Bluetooth-enabled handheld device. A first electronic device is controlled based on the assigned location. In response to movement by a user of the Bluetooth-enabled handheld device within the structure, a location of a different Bluetooth-enabled transmitter/receiver unit is reassigned to the Bluetooth-enabled handheld device.

Abstract: In one embodiment, a configuration application executing on a tablet computer or smartphone presents a configuration user interface on a touch screen for configuring a home automation system of a structure. A plurality of components of the home automation system that have wireless capabilities are detected. Component profile information for the detected components is obtained. The configuration application prompts a user of the tablet computer or smartphone to indicate a zone of the structure within which each component is located. Based on the component profile information and the indications of the zone of the structure in which each component is located, one or more services available in each zone are determined and one or more user interface screens are automatically generated for accessing and controlling the services, wherein the automatically generated user interface screens are displayable on the tablet computer or smartphone or another tablet computer or smartphone.

Abstract: In one embodiment, a user selects a primary component of a multimedia system to be configured in a configuration user interface of a mobile device. The configuration user interface of the mobile device displays a photo-realistic depiction of a back panel of the primary component. The photo-realistic depiction of a back panel includes photo-realistic depictions of connection ports located thereon. The user selects another component to be connected to the primary component. One or more classes of potential connections are determined between the another component and the primary component, and for each class of potential connection, the configuration user interface on the mobile device graphically guides the user to select a particular connection port on the photo-realistic depiction of the back panel of the primary component for the class of potential connection. Based on selections of particular connection ports from the user, a set of configuration data is generated.

Abstract: A multimedia control system which may be expanded without creating or modifying source code. The system is based on a master programmable multimedia controller. The master programmable multimedia controller has a list of unique identifiers that indicate valid subordinate programmable multimedia controllers that are eligible to become part of the system. One or more subordinate programmable multimedia controllers having a matching unique identifier to a unique identifier on the master's list may be added to the system to provide additional control ports, increase audio or video processing or switching capacity. A method is provided for determining whether a particular subordinate programmable multimedia controller may be added to the system.

Abstract: A graphical user interface enables a user to create and modify graphical schedules for a wide variety of devices that may be controlled by a programmable multimedia controller. A graphical schedule graphically depicts a relationship between time and at least one user-selected condition to be satisfied or at least one user-selected action to be taken. The user may create or modify graphical schedules using familiar techniques such as taps and swipes, drag and drop and the like.

Abstract: The forgoing method, system, and apparatus relates to a touch sensitive display for use with a programmable multimedia controller. In the illustrative system, the user may select and designate a video input device to be implemented on a video output display device within the user's network of devices. The media input devices and output devices are selected by the user touching a touch sensitive button located on the display screen. To initiate an action the user touches, drags and drops a media input device button onto one or more video output display device buttons. Furthermore, when the user selects a media input device to be implemented on a video output display device, the user may also select a video signal source to apply to that media input device for a transaction. A live stream of what is playing on a given channel is provided on the screen.

Abstract: In one embodiment, two or more programmable multimedia controllers are provided a multimedia system that includes a plurality of audio/video (A/V) devices that source or output digital media streams. Each of the programmable multimedia controllers has at least a processing subsystem and a switch capable of switching the digital media streams. Arbitration is conducted among the programmable multimedia controllers to select one of the programmable multimedia controllers as winning the arbitration. Master status is assigned to the one of the programmable multimedia controllers that won the artitration. Subordinate status is assigned to at least one other programmable multimedia controller that did not win the arbitration. It is periodically verified whether the programmable multimedia controller assigned master status is operating.

Abstract: In one embodiment, a general-purpose wireless mobile device having a touch-sensitive screen and executing a remote control application is used to remotely control a vehicle (e.g., a marine vessel). The general-purpose wireless mobile device communicates via a wireless network with an interface (e.g., a server) that is coupled to an electronic control system of the vehicle (e.g., the vessel). In operation, environmental information and/or system status information is collected through the electronic control system, propagated to the interface (e.g., server), and then sent over the wireless network to the wireless mobile device. Similarly, control input is sent over the wireless network to the interface (e.g., server), which passes the information to the electronic control system, which in turn issues appropriate control signals to the vehicle subsystems (e.g., marine subsystems) to control the motion of the vehicle (e.g., the vessel).

Abstract: In one embodiment, a tiled video display is shown on a screen of a display device. The tiled video display includes a plurality of video tiles that each show video content of a different video stream. The video tiles are arranged on the screen according to a tiling layout. A user interface (UI) is shown on a touch sensitive screen of a wireless mobile device separate from the display device. The UI includes a plurality of UI tiles that each correspond to a respective video tile of the tiled video display. The UI tiles are arranged on the virtual display screen according to the tiling layout of the video tiles. In response to a gesture over at least a portion of a particular one of the UI tiles on the touch sensitive screen, a modification is made to both the particular UI tile and a correspond video tile.

Abstract: In one embodiment, a programmable multimedia controller that is capable of interfacing with and controlling audio, video, telephony or heating ventilation, and air conditioning (HVAC) devices. A first mobile device and a second mobile device of a same type are configured to communicate with the programmable multimedia controller. The first mobile device obtains a first copy of a sharable device configuration including data for rendering a user interface usable to control the programmable multimedia controller. It stores the first copy of the sharable device configuration and thereby is considered a master device with respect to other devices of the same type. The second mobile device obtains a second copy of the sharable device configuration for use on the second mobile device from the master device.

Abstract: A distributed switching system for use with a programmable multimedia controller. In the system, data streams originating from the controller or any of a plurality of devices interconnected with the controller are accessible by the other devices which may switch the streams as needed.

Abstract: In one embodiment, a menuing system is overlaid upon a portion of a video being shown on a display device coupled to a programmable multimedia controller. The portion of the video is less than an entire screen of the video such that at least some of the video is still visible. The menuing system has a plurality of selectable options. In response to a scrolling gesture in a direction, an element is moved in a corresponding direction within the menuing system to bring the element to a designated position in the menuing system to permit selection of a particular selectable option. In response to selection of the particular selectable option, one or more control commands are issued to a device coupled to the programmable multimedia controller to control an aspect of operation of the device.

Abstract: In one embodiment, a programmable multimedia controller controls electronic devices, including display devices. A remote control communicates with the programmable multimedia controller. An on screen display is displayed on a selected one of the display devices. The on screen display enables the selected one of the display devices to function as a virtual telephone that is user-operable to initiate outgoing telephone calls and to answer incoming telephone calls. When an outgoing telephone call or incoming telephone call is in progress, the on screen display shows text or graphics related to the outgoing telephone call or the incoming telephone call. The on screen display is overlaid on another video signal which is already being displayed on the selected one of the display devices.

Abstract: In one embodiment, a technique is utilized to generate a virtual-room of a virtual room-based user interface that controls one or more devices within a physical room of a structure. A user is prompted to select one or more services provided by the one or more devices within the physical room. A plurality of images of the physical room are obtained that each share substantially a same perspective. The plurality of images include an all-off image, in which all of the one or more of the services are in an inactive state, and one or more service-specific images, in which a single service is in an active state and any other services are in the inactive state. The plurality of images are aligned to create an aligned image stack. One or more hit boxes are designated. The virtual room is generated based on the aligned image stack and the designated one or more hit boxes.