Abstract: The present invention provides for fitting a multimodal hearing system to a recipient. Such fitting may include determining a desired perception for an input signal, receiving a measurement of a perception evoked by applying to the recipient one or more stimulation signals that correspond to the input signal, wherein the one or more stimulation signals applied using two or more stimulation modes, and each stimulation signal is determined using stimulus mode weighting, and adjusting one or more of the stimulus mode weightings based on the difference between the measured evoked perception and the desired perception. A multimodal hearing system is able to stimulate using an acoustic, electrical, mechanical mode and/or photo effect mode.