Abstract: A video processing apparatus and a processing method of video stream are provided. In the method, at least one encoding unit is formed in an image frame, sub-encoding units in multiple encoding units of an image sequence are encoded according to a correlation between a first sub-encoding unit and a second sub-encoding unit in the sub-encoding units, and a video stream is generated according to an encoded result of the image sequence. The image frame is an image of the image sequence, and each of the encoding units records encoding information of a belonging block.