Abstract: A handle assembly with a protector for luggage, which is formed with a caved recess on the top of the luggage where the pulling-rod handle is positioned, and a notch defined above the cave recess. The protector of the handle assembly is characterized that both lateral sides of the notch respectively have a bottom end with leading edge for latching. A plurality of apertures is defined through the bottom portion of the notch. A flexible spring plate member is received within the notch, and two hooks are fixed on both sides thereof. An upper plate portion of the member is fixed with a plurality of posts, and each of the posts is circumambulated arround by a spring with the end of the spring retained on the bottom of the upper plate portion. In assembly, the hooks of the spring plate member are latchingly snapped with the associated leading edges of the notch, and the posts are inserted through the apertures of the notch.