Abstract: An information processing apparatus according to the present application includes the generation unit, the evaluation unit and the reinforcement learning unit. The generation unit generates suggestion information from predetermined content using the generation model which generates from content, suggestion information indicating content of the content. The evaluation unit evaluates the suggestion information generated by the generation unit using the evaluation model which has learned which of a plurality of pieces of suggestion information indicating content of the same target content is favorable. The reinforcement learning unit performs reinforcement learning of the generation model on the basis of the evaluation result by the evaluation unit.