Abstract: Systems and methods are disclosed for providing a privacy aware semantic searching system. A system can include at least one memory; and at least one processor coupled to the at least one memory and configured to receive a prompt to a target machine learning model and generate, via a semantic search machine learning model, a sensitivity score for the prompt based on a relevant of the prompt to a sensitive enterprise data. The system can use the score to redact sensitive data from the prompt. The system also can augment the prompt based on enterprise data to improve the prompt for processing by the machine leaning model. The system can include a pre-processing model for redacting and/or augmenting the prompt and a post-processing model for inserting or modifying the output of the machine learning model.