Abstract: An apparatus for taking liquid samples, particularly milk, from containers thereof under substantially sanitary conditions is shown. The apparatus includes an elongated shaft having a handle and a decapping means associated with its upper part and a collar adapted to hold a sample vial extending from its lower part. Attached to an upper part of the shaft are means for removing, retaining and thereafter replacing a sample vial cap upon a sample vial without touching that vial cap. These means include a partial collar and a spring clip extending over that partial collar. The spring clip is adapted to urge the sample vial cap downwardly upon the upper surface of the partial collar and to retain it thereon while the sample vial is sanitized and thereafter filled with a sample of a liquid such as raw milk.