Abstract: A hearing system comprising a hearing device, the hearing device being adapted for being worn by a user, the hearing system comprising an audio input unit configured to receive a multitude of audio signals comprising sound from a number of localized sound sources in an environment around the user, and a sensor unit configured to receive and/or provide sensor signals from one or more sensors, said one or more sensors being located in said environment and/or form part of said hearing system, and a first processor configured to generate and update over time data representative of a map of said environment of the user, said data being termed map data, said environment comprising a number of, stationary or mobile, landmarks, said landmarks comprising said number of localized sound sources, and said map data being representative of the physical location of said landmarks in the environment relative to the user, wherein the audio input unit comprises a microphone array comprising a multitude of microphones for