Abstract: A system for an extensible 3D interface programming framework is described. The system has a server portion for loading and processing software code and server modules having user interface software code and presentation software code. The server modules provide abstraction objects. A client portion for processing application specific software code capable of requesting one or more server modules to be loaded in the server portion for processing and requesting the server portion to instantiate objects and data from the server modules processing is shown. Software interface code interacts with the presentation software code. The server modules are loaded dynamically. One or more server modules may request one or more additional server modules to be loaded. The abstraction objects are attached to objects representing actual human interface devices. The client portion processes multiple applications having the application specific code. Multiple applications may make requests on one server module.