Abstract: Disclosed are system, method and/or computer program product embodiments for improving the performance of a machine learning based algorithm used to provide a user experience to a user via a media device. An embodiment selects a first set of hyperparameter values, implements a first iteration of the algorithm based on the first set of hyperparameter values, utilizes the first iteration of the algorithm to provide a first user experience to the user, determines a response of the user to the first user experience, selects, by a hyperparameter tuning ML model implemented as a contextual multi-arm bandit model or a reinforcement learning model and based on at least the response of the user, a second set of hyperparameter values, implements a second iteration of the algorithm based on the second set of hyperparameter values, and utilizes the second iteration of the algorithm to provide a second user experience to the user.