Abstract: The present disclosure relates to methods for estimating an accuracy and robustness of a model and devices thereof. According to an embodiment of the present disclosure, the method comprises calculating a parameter representing a possibility that a sample in the first dataset appears in the second dataset; calculating an accuracy score of the model with respect to the sample in the first dataset; calculating a weighted accuracy score of the model with respect to the sample in the first dataset, based on the accuracy score, by taking the parameter as a weight; and calculating, as the estimation accuracy of the model with respect to the second dataset, an adjusted accuracy of the model with respect to the first dataset according to the weighted accuracy score.

Abstract: A training device and a training method for training a multi-goal model based on goals in a goal space are provided. The training device includes a memory and a processor coupled to the memory. The processor is configured to set the goal space, to acquire a plurality of sub-goal spaces of different levels of difficulty; change a sub-goal space to be processed from a current sub-goal space to a next sub-goal space of a higher level of difficulty; select, as sampling goals, goals at least from the current sub-goal space, and to acquire transitions related to the sampling goals by executing actions; train the multi-goal model based on the transitions, and evaluate the multi-goal model by calculating a success rate for achieving goals in the current sub-goal space.

Abstract: A robustness estimation method, a data processing method, and an information processing apparatus are provided.

Abstract: The present disclosure relates to methods for estimating an accuracy and robustness of a model and devices thereof. According to an embodiment of the present disclosure, the method comprises calculating a parameter representing a possibility that a sample in the first dataset appears in the second dataset; calculating an accuracy score of the model with respect to the sample in the first dataset; calculating a weighted accuracy score of the model with respect to the sample in the first dataset, based on the accuracy score, by taking the parameter as a weight; and calculating, as the estimation accuracy of the model with respect to the second dataset, an adjusted accuracy of the model with respect to the first dataset according to the weighted accuracy score.

Abstract: A training device and a training method for training a multi-goal model based on goals in a goal space are provided. The training device includes a memory and a processor coupled to the memory. The processor is configured to set the goal space, to acquire a plurality of sub-goal spaces of different levels of difficulty; change a sub-goal space to be processed from a current sub-goal space to a next sub-goal space of a higher level of difficulty; select, as sampling goals, goals at least from the current sub-goal space, and to acquire transitions related to the sampling goals by executing actions; train the multi-goal model based on the transitions, and evaluate the multi-goal model by calculating a success rate for achieving goals in the current sub-goal space.

Abstract: An information processing method comprises: generating an action sequence pair of a first action sequence of a first agent and a second action sequence of a second agent, the first and second action sequences performing an identical task; training a mapping model using the generated action sequence pair such that it is capable of generating an action sequence of the second agent according to an action sequence of the first agent; training a judgment model using the first action sequence of the first agent such that it is capable of judging whether a current action of an action sequence of the first agent is a last action of the action sequence; and constructing a mapping library using the trained mapping model and the trained judgment model, wherein the mapping library comprises a mapping from observation information of the second agent to an action sequence of the second agent.