Abstract: Techniques for identifying components (e.g., application program interfaces (APIs)) relevant for a large language model (LLM) prompt are described. The shortlister includes one or more proposers that each select n components for performing an instant task. The n components from each proposer may be merged and reranked to produce a ranked list of K components for inclusion in the LLM prompt. The shortlister proposers can include, among others, a request-based proposer, query-based proposer, and/or rule-based proposer. In particular, the query-based proposer may utilize a LLM to generate a query to search component descriptions to identify n components the proposer determines are usable to perform the instant task.