Abstract: A system for an automatic multimodal real-time tracking of moving instruments for image plane alignment inside an MRI scanner includes: an MRI scanner, an MRI multi-plane pulse sequence generating unit allowing to interactively modify the position and orientation of one or several image planes in real-time, one or several external optical sensors with high frame rate, preferably a RGB-D sensor or other similar camera system like a stereovision systems, a multimodal marker including at least one MR visible feature and one visual feature able to be tracked by both the MRI scanner and the at least one external optical sensor, a computer for processing in real-time images from both MRI and optical sensor to fuse the detected marker position and orientation or pose from both modalities, and predict the next image plane position and orientation based on the estimated motion of the moving marker.