Abstract: Systems and methods for controlling devices remotely by embedding command information within video signals. The command information includes gestures or icons which are imbedded into the video signal and enable the user to interpret the command information by viewing the icon or gesture on a monitor or display device. By viewing the monitor or display device, the user can determine what command information is conveyed within the video signal. Further, imbedding the visually interpretable icon or gesture within the video signal facilitates transmitting the video signal having the command information imbedded therein using analog to digital conversions and reconversions and transmission through any of a various number of switching networks. The remote devices may by any of a number of electronically controlled electrical or mechanical devices. A device controller at the remote end receives, the decoded command information and generates the appropriate commands to operate the controlled device.

Abstract: Systems and methods for performing tele-operations with the active assistance and supervision of a cognitive agent, such as a human being, who generates a future path plan in real time for immediate use by an automated on-line controlled agent, such as a work robot or other manipulator, are disclosed. The systems and methods may employ a visual display to present images of the controlled agent, of a foward simulation of the controlled agent, and of the future path plan being generated to enable a human operator to assess and control the on-going activity. The system simultaneously operates the controlled agent and produces the forward simulation and path plan, all under real time conditions. The cognitive agent, display and forward simulation equipment may be at one location and the controlled agent and its controller at another remote location.