Abstract: There is described a system and a method for assisting a user manipulating an object during a surgery, the method comprising: tracking the object in a sterile field in which surgery is being performed at a location using a tracking device which generates tracking data; processing the tracking data using a processing device located outside the sterile field to generate position and orientation information related to the object; and sending the position and orientation information related to the object to a displaying device positioned in the sterile field adjacent to the location at which the surgery is being performed, for display to the user.