Abstract: Various embodiments of predicting human actions are disclosed. In one aspect, a human action prediction system first receives a sequence of video images including at least a first person. Next, for each image in the sequence of video image, the human action prediction system detects the first person in the video image; and subsequently extracts a skeleton figure of the detected first person from the detected image of the first person, wherein the skeleton figure is composed of a set of human keypoints of the detected first person. Next, human action prediction system combines a sequence of extracted skeleton figures of the detected first person from the sequence of video images to form a first skeleton sequence of the detected first person which depicts a continuous motion of the detected first person.