Abstract: In one embodiment, a technique is provided to configure and remotely control a system. A system configuration is created based, at least in part, on information collected from a user using speech synthesis and speech recognition. The system configuration includes information representing at least one zone that corresponds with at least one room in a physical structure, information identifying at least one physical component which represents at least a part of the system, information about at least one function which the at least one physical component is capable of performing, and information about at least one command which the at least one physical component recognizes. A cell phone is used to discover the system by transmitting a name service discovery request to the system, which responds with a name service registration confirmation. The cell phone is then used to remotely control the system.

Abstract: In one embodiment, graphics frames are received, where each graphics frame includes one or more regions where pixels depict graphics that represent an on screen display (OSD) used to interact with a programmable multimedia controller, and a background region where pixels are set to the one or more predetermined colors. Further, video images are received, where at least some of the video images correspond to the plurality of graphics frames. Mixed images are created by mixing the graphics frames and the corresponding video images, the mixing to, where pixels of the graphics frame are not set to the one more predetermined colors, blend a color of at least some of the pixels of the graphics frame with a color of pixels of a corresponding video image, and, where pixels of the graphics frame are set to the one more predetermined colors, pass pixels of the corresponding video image.

Abstract: A touch-sensitive wireless device, such as a wireless telephone or wireless multimedia player, in conjunction with an interactive on screen display, effectively remotely controls a programmable multimedia controller or other system. User gestures, button presses or other touches to or movements of the touch-sensitive wireless device are effectively converted to information that is wirelessly transmitted to the programmable multimedia controller. Once received by the programmable multimedia controller, such information is processed and effectively translated so as to control the operation of the controller.

Abstract: In one embodiment, a virtual room-based user interface includes one or more virtual rooms. Each virtual room is rendered from one or more images captured of a corresponding physical room of a structure, and includes depictions of one or more light fixtures within the physical room, one or more furnishings within the physical room and one or more boundaries of the physical room. A user selects a particular depiction of a particular light fixture within a particular virtual room. In response, a state of the particular light fixture within the corresponding physical room is changed. Also, appearance of the particular virtual room is updated such that the depiction of the particular light fixture shows the particular light fixture with the changed state and the depictions of the one or more boundaries or the one or more furnishings show lighting effects resulting from the changed state.

Abstract: In one embodiment, a remote control device is configured to receive a portable control device into a recess, such that the portable control device is mechanically and electrically coupled to the remote control device. The portable control device communicates with a programmable multimedia controller, by way of a bi-directional wireless communication path, and with a dedicated wireless receiver, providing a redundant communication path. The remote control device includes surface enhanced buttons that allow a user to make selections by the sense of touch for changing settings of components associated with the programmable multimedia controller.

Abstract: In one embodiment, a component library stores representations of audio/video components, the representations of audio/video components corresponding to physical audio/video components that are available for inclusion in a system. A configuration workspace is provided into which a selected plurality of representations of audio/video components from the component library are placed to indicate their inclusion in the system. A drawing tool may be used to draw connections between particular ones of the selected plurality of audio/video components in the configuration workspace. Further, a configuration compiler may determine one or more realized services that the system is capable of providing based on the selected plurality of audio/video components and the drawn connections between particular ones of the selected plurality of audio/video components, and may display to the user indications of the one or more realized services that the system is capable of providing.

Abstract: In one embodiment, a user selects a primary component of a multimedia system to be configured in a configuration user interface of a mobile device. The configuration user interface of the mobile device displays a photo-realistic depiction of a back panel of the primary component. The photo-realistic depiction of a back panel includes photo-realistic depictions of connection ports located thereon. The user selects another component to be connected to the primary component. One or more classes of potential connections are determined between the another component and the primary component, and for each class of potential connection, the configuration user interface on the mobile device graphically guides the user to select a particular connection port on the photo-realistic depiction of the back panel of the primary component for the class of potential connection. Based on selections of particular connection ports from the user, a set of configuration data is generated.

Abstract: A multimedia control system which may be expanded without creating or modifying source code. The system is based on a master programmable multimedia controller. The master programmable multimedia controller has a list of unique identifiers that indicate valid subordinate programmable multimedia controllers that are eligible to become part of the system. One or more subordinate programmable multimedia controllers having a matching unique identifier to a unique identifier on the master's list may be added to the system to provide additional control ports, increase audio or video processing or switching capacity. A method is provided for determining whether a particular subordinate programmable multimedia controller may be added to the system.

Abstract: An automation system includes a lighting controller having a WiFi interface through which wireless communication may be established with one or more mobile devices such as smartphones, tablets and the like. Using a mobile device, an installer may rapidly and reliably configure the lighting controller including creating or modifying bindings and settings for keypads which are associated with the lighting controller. The lighting controller includes a dynamic snubber circuit which automatically adjusts itself to operate with different types of loads.

Abstract: A graphical user interface enables a user to create and modify graphical schedules for a wide variety of devices that may be controlled by a programmable multimedia controller. A graphical schedule graphically depicts a relationship between time and at least one user-selected condition to be satisfied or at least one user-selected action to be taken. The user may create or modify graphical schedules using familiar techniques such as taps and swipes, drag and drop and the like.

Abstract: The forgoing method, system, and apparatus relates to a touch sensitive display for use with a programmable multimedia controller. In the illustrative system, the user may select and designate a video input device to be implemented on a video output display device within the user's network of devices. The media input devices and output devices are selected by the user touching a touch sensitive button located on the display screen. To initiate an action the user touches, drags and drops a media input device button onto one or more video output display device buttons. Furthermore, when the user selects a media input device to be implemented on a video output display device, the user may also select a video signal source to apply to that media input device for a transaction. A live stream of what is playing on a given channel is provided on the screen.

Abstract: In one embodiment, a general-purpose wireless mobile device having a touch-sensitive screen and executing a remote control application is used to remotely control a vehicle (e.g., a marine vessel). The general-purpose wireless mobile device communicates via a wireless network with an interface (e.g., a server) that is coupled to an electronic control system of the vehicle (e.g., the vessel). In operation, environmental information and/or system status information is collected through the electronic control system, propagated to the interface (e.g., server), and then sent over the wireless network to the wireless mobile device. Similarly, control input is sent over the wireless network to the interface (e.g., server), which passes the information to the electronic control system, which in turn issues appropriate control signals to the vehicle subsystems (e.g., marine subsystems) to control the motion of the vehicle (e.g., the vessel).

Abstract: In one embodiment, a tiled video display is shown on a screen of a display device. The tiled video display includes a plurality of video tiles that each show video content of a different video stream. The video tiles are arranged on the screen according to a tiling layout. A user interface (UI) is shown on a touch sensitive screen of a wireless mobile device separate from the display device. The UI includes a plurality of UI tiles that each correspond to a respective video tile of the tiled video display. The UI tiles are arranged on the virtual display screen according to the tiling layout of the video tiles. In response to a gesture over at least a portion of a particular one of the UI tiles on the touch sensitive screen, a modification is made to both the particular UI tile and a correspond video tile.

Abstract: In one embodiment, a programmable multimedia controller that is capable of interfacing with and controlling audio, video, telephony or heating ventilation, and air conditioning (HVAC) devices. A first mobile device and a second mobile device of a same type are configured to communicate with the programmable multimedia controller. The first mobile device obtains a first copy of a sharable device configuration including data for rendering a user interface usable to control the programmable multimedia controller. It stores the first copy of the sharable device configuration and thereby is considered a master device with respect to other devices of the same type. The second mobile device obtains a second copy of the sharable device configuration for use on the second mobile device from the master device.

Abstract: A distributed switching system for use with a programmable multimedia controller. In the system, data streams originating from the controller or any of a plurality of devices interconnected with the controller are accessible by the other devices which may switch the streams as needed.

Abstract: In one embodiment, a menuing system is overlaid upon a portion of a video being shown on a display device coupled to a programmable multimedia controller. The portion of the video is less than an entire screen of the video such that at least some of the video is still visible. The menuing system has a plurality of selectable options. In response to a scrolling gesture in a direction, an element is moved in a corresponding direction within the menuing system to bring the element to a designated position in the menuing system to permit selection of a particular selectable option. In response to selection of the particular selectable option, one or more control commands are issued to a device coupled to the programmable multimedia controller to control an aspect of operation of the device.

Abstract: In one embodiment, a technique is utilized to generate a virtual-room of a virtual room-based user interface that controls one or more devices within a physical room of a structure. A user is prompted to select one or more services provided by the one or more devices within the physical room. A plurality of images of the physical room are obtained that each share substantially a same perspective. The plurality of images include an all-off image, in which all of the one or more of the services are in an inactive state, and one or more service-specific images, in which a single service is in an active state and any other services are in the inactive state. The plurality of images are aligned to create an aligned image stack. One or more hit boxes are designated. The virtual room is generated based on the aligned image stack and the designated one or more hit boxes.

Abstract: In one embodiment, a programmable multimedia controller controls electronic devices, including display devices. A remote control communicates with the programmable multimedia controller. An on screen display is displayed on a selected one of the display devices. The on screen display enables the selected one of the display devices to function as a virtual telephone that is user-operable to initiate outgoing telephone calls and to answer incoming telephone calls. When an outgoing telephone call or incoming telephone call is in progress, the on screen display shows text or graphics related to the outgoing telephone call or the incoming telephone call. The on screen display is overlaid on another video signal which is already being displayed on the selected one of the display devices.

Abstract: In one embodiment, a menu is semi-transparently overlaid upon a portion of a video being shown on a television coupled to a programmable multimedia controller. The menu has a plurality of selectable options and a selection cursor disposed on one of the plurality of selectable options. Input is received from a user on the remote control unit indicating a direction. In response to the input indicating the direction, the selection cursor is moved in a corresponding direction within the semi-transparently overlaid menu to bring the selection cursor to be disposed on a designated selectable option to permit selection of the designated selectable option. In response to selection of the designated selectable option, the programmable multimedia controller issues one or more control commands to a lighting system, a heating ventilation and air/conditioning (HVAC) system, and/or to an automatic shade system, to control operation of lighting, HVAC or window shades.