Abstract: A moving image processing system includes an encoding apparatus encoding a moving image by encoding a picture order count (POC) while inserting a recovery point, and a decoding apparatus decoding the moving image encoded by the encoding apparatus. The encoding apparatus includes an insertion permission/rejection determining unit that determines whether a decoded frame is a reference frame and its frame number from an instantaneous decoding refresh frame is a positive integer times as large as a number of reference frames within a POC cycle, and a recovery point inserting unit that inserts the recovery point into the frame depending on a result of determination by the insertion permission/rejection determining unit. The decoding apparatus includes a POC decoding unit that decodes the POC by executing an initializing process such that the frame number within the POC cycle used in decoding the POC becomes zero, when decoding by random accessing is started.