Abstract: The disclosure provides for head pose and gaze angle estimation that includes using a face alignment method with an image of a two-dimensional (2D) face to generate a facial UV position image and facial UV texture image of the 2D face in which to decouple movement of the head and eyes of the 2D face. An eye UV texture image is extracted from the facial UV texture image and stored in a database. The eye region of the facial UV texture image may then be replaced with the eye UV texture image stored in the database to generate a modified facial UV texture image. The modified facial UV texture image is reconstructed to generate a modified 2D face image as training data stored in the database, and the head pose and gaze angles of a person are simultaneously estimated by training a convolutional neural network with the training data.