Abstract: A method and apparatus for interfacing graphically with a user of a computer system having selecting means, and display means, which identifies a relationship structure between physical objects and activities external to the computer system which are related to the information to be manipulated in the computer system. At least one data structure is created which corresponds to the identified relationship structure. A plurality of on-screen objects which correspond to information identified in the physical objects and activities external to the computer system is displayed on the display means. A user selection is detected among the displayed on-screen objects, where each on-screen object has initial size and position states. Intermediate and final size and positions states for each on-screen object are prepared according to the data structures.