Abstract: It is a common desire for users of spatial computer environments (both in VR and AR) to be able to navigate in space and manipulate objects in much the same way as they are used to in physical reality. However, due to the large degrees of freedom of this problem, existing solutions operate either by restricting the number of operations that can be performed, or by proposing overly complicated solutions. Cognitive Navigation and Manipulation introduces a context dependent solution for navigation and object translation/rotation in VR, allowing users to perform operations in an intuitive way, even with only a very simple input device at their disposal. The device is required to have no more than 3 buttons and 3 continuous input dimensions.