Abstract: The housing of the drill press is provided with a bit storage compartment. A removable cover plate for the compartment has tabs on its inner surface for detachably holding a drill bit case of the type having two shell sections hingedly connected together with each of the shell sections provided with a rack containing arcuate recesses of progressively increasing size for detachably receiving drill bits of varying diameters. The tabs on the inside of the cover plate are adopted to hold the casing shell sections in their open position thereby to make all of the drill bits accessible upon opening of the cover plate or upon removal of the same from the housing of the drill press. A secondary drill bit holder is detachably and pivotally mounted in the storage compartment for swinging movement back and forth between an access position and a storage position.