Abstract: A method includes receiving a first query of a database, where the first query is at least in part generated by a machine learning model (MLM). The method also includes parsing the first query into an abstract syntax tree (AST) and analyzing the AST to detect an error. The error can include a divide-by-zero error, a quoted column error, or an incorrect argument order error. In response to detecting the error, the AST is modified to correct it. The method includes converting the modified AST to a second query of the database.

Abstract: A method for using a compiler to modify prompts for MLMs used to generate database queries includes receiving, at a query compiler, a first query of a database. The first query is at least in part generated by an MLM. The method includes determining, by the query compiler, whether the first query comprises an uncorrectable error. The method includes, responsive to determining that the first query comprises an uncorrectable error, generating a prompt element that describes the uncorrectable error and that is structured for inclusion in a prompt requesting the MLM to generate a modified first query that corrects the uncorrectable error. The method may include generating the prompt for the MLM, providing the prompt to the MLM, and responsive to providing the prompt, receiving, at the database query compiler, the modified first query that corrects the uncorrectable error.

Abstract: A method for using a compiler to modify prompts for MLMs used to generate database queries includes receiving, at a query compiler, a first query of a database. The first query is at least in part generated by an MLM. The method includes determining, by the query compiler, whether the first query comprises an uncorrectable error. The method includes, responsive to determining that the first query comprises an uncorrectable error, generating a prompt element that describes the uncorrectable error and that is structured for inclusion in a prompt requesting the MLM to generate a modified first query that corrects the uncorrectable error. The method may include generating the prompt for the MLM, providing the prompt to the MLM, and responsive to providing the prompt, receiving, at the database query compiler, the modified first query that corrects the uncorrectable error.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a task centric resource scheduling framework. A scheduler executing on a master node computer of a distributed parallel computing system allocates computing resources of the parallel computing system to a program according to one or more policies associated with the program. Each policy includes a set of pre-determined computing resource constraints. Allocation of the computing resources includes performing multiple iterations of negotiation between the scheduler and a resource manager of the parallel computing system. In each iteration, a policy engine of the scheduler submits requests to get more resources from, or requests to release already acquired resources to, the resource manager. The policy engine generates the requests by balancing suggestions provided by analyzer components of the policy engine and a corresponding policy.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a distributed parallel computing system to adapt a foreign program to execute on the distributed parallel computing system. The foreign program is a program written for a computing framework that is different from a computing framework of the parallel computing system. The distributed parallel computing system includes a master node computer and one or more worker node computers. A scheduler executing on the master node computer acts as an intermediary between the foreign program and the parallel computing system. The scheduler negotiates with a resource manager of the parallel computing system to acquire computing resources. The scheduler then allocates the computing resources to the worker node computers as containers. The foreign program executes in the containers on the worker node computers in parallel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a distributed parallel computing system to adapt a foreign program to execute on the distributed parallel computing system. The foreign program is a program written for a computing framework that is different from a computing framework of the parallel computing system. The distributed parallel computing system includes a master node computer and one or more worker node computers. A scheduler executing on the master node computer acts as an intermediary between the foreign program and the parallel computing system. The scheduler negotiates with a resource manager of the parallel computing system to acquire computing resources. The scheduler then allocates the computing resources to the worker node computers as containers. The foreign program executes in the containers on the worker node computers in parallel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a task centric resource scheduling framework. A scheduler executing on a master node computer of a distributed parallel computing system allocates computing resources of the parallel computing system to a program according to one or more policies associated with the program. Each policy includes a set of pre-determined computing resource constraints. Allocation of the computing resources includes performing multiple iterations of negotiation between the scheduler and a resource manager of the parallel computing system. In each iteration, a policy engine of the scheduler submits requests to get more resources from, or requests to release already acquired resources to, the resource manager. The policy engine generates the requests by balancing suggestions provided by analyzer components of the policy engine and a corresponding policy.