Abstract: Deriving a skin profile from an image is disclosed, including: accessing an input image of a user; deriving a first sub-component based at least in part on the input image of the user; deriving a second sub-component based at least in part on the input image of the user; using a first machine learning model and the first sub-component to determine a predicted base skin color associated with the user; selecting a second machine learning model based at least in part on the predicted base skin color associated with the user; using the second machine learning model and the second sub-component to determine a predicted undertone color associated with the user; determining product recommendations based at least in part on the predicted base skin color associated with the user and the predicted undertone color associated with the user; and presenting the one or more product recommendations at a user interface.